[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:17:15.788610 16329 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.242.126:45023
I20260709 13:17:15.790144 16329 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:17:15.791184 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:15.808133 16336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:15.809334 16338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:15.808161 16335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:15.810573 16329 server_base.cc:1061] running on GCE node
I20260709 13:17:17.011955 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:17.012178 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:17.012331 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603037012315 us; error 0 us; skew 500 ppm
I20260709 13:17:17.013106 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:17.018523 16329 webserver.cc:533] Webserver started at http://127.15.242.126:34107/ using document root <none> and password file <none>
I20260709 13:17:17.019388 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:17.019575 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:17.019958 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:17.025535 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/master-0-root/instance:
uuid: "934450e680764107809dad173ad2e238"
format_stamp: "Formatted at 2026-07-09 13:17:17 on dist-test-slave-fh5z"
I20260709 13:17:17.033035 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:17.038071 16344 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:17.039337 16329 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:17:17.039817 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/master-0-root
uuid: "934450e680764107809dad173ad2e238"
format_stamp: "Formatted at 2026-07-09 13:17:17 on dist-test-slave-fh5z"
I20260709 13:17:17.040141 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:17.090777 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:17.092304 16329 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:17:17.092783 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:17.164006 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.126:45023
I20260709 13:17:17.164079 16395 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.126:45023 every 8 connection(s)
I20260709 13:17:17.172165 16396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:17.193512 16396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238: Bootstrap starting.
I20260709 13:17:17.199589 16396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.201529 16396 log.cc:826] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238: Log is configured to *not* fsync() on all Append() calls
I20260709 13:17:17.206272 16396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238: No bootstrap required, opened a new log
I20260709 13:17:17.226619 16396 raft_consensus.cc:359] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934450e680764107809dad173ad2e238" member_type: VOTER }
I20260709 13:17:17.227213 16396 raft_consensus.cc:385] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.227552 16396 raft_consensus.cc:740] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 934450e680764107809dad173ad2e238, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.228477 16396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934450e680764107809dad173ad2e238" member_type: VOTER }
I20260709 13:17:17.228978 16396 raft_consensus.cc:399] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:17.229277 16396 raft_consensus.cc:493] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:17.229625 16396 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.233757 16396 raft_consensus.cc:515] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934450e680764107809dad173ad2e238" member_type: VOTER }
I20260709 13:17:17.234592 16396 leader_election.cc:304] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 934450e680764107809dad173ad2e238; no voters: 
I20260709 13:17:17.236366 16396 leader_election.cc:290] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:17.236812 16399 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.239552 16399 raft_consensus.cc:697] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [term 1 LEADER]: Becoming Leader. State: Replica: 934450e680764107809dad173ad2e238, State: Running, Role: LEADER
I20260709 13:17:17.240581 16399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934450e680764107809dad173ad2e238" member_type: VOTER }
I20260709 13:17:17.241636 16396 sys_catalog.cc:565] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:17.251652 16401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 934450e680764107809dad173ad2e238. Latest consensus state: current_term: 1 leader_uuid: "934450e680764107809dad173ad2e238" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934450e680764107809dad173ad2e238" member_type: VOTER } }
I20260709 13:17:17.251652 16400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "934450e680764107809dad173ad2e238" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934450e680764107809dad173ad2e238" member_type: VOTER } }
I20260709 13:17:17.252508 16401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:17.252511 16400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:17.257387 16408 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:17.269353 16408 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:17.271981 16329 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:17.287712 16408 catalog_manager.cc:1383] Generated new cluster ID: 5a302a1067ed4665b8b6f691c25423ba
I20260709 13:17:17.288028 16408 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:17.306068 16408 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:17.308241 16408 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:17.324138 16408 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238: Generated new TSK 0
I20260709 13:17:17.325299 16408 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:17.338791 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:17.346887 16418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:17.348453 16419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:17.352240 16329 server_base.cc:1061] running on GCE node
W20260709 13:17:17.352461 16421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:17.353516 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:17.353781 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:17.353986 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603037353966 us; error 0 us; skew 500 ppm
I20260709 13:17:17.354806 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:17.364660 16329 webserver.cc:533] Webserver started at http://127.15.242.65:43155/ using document root <none> and password file <none>
I20260709 13:17:17.365229 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:17.365455 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:17.365743 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:17.366915 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-0-root/instance:
uuid: "4cd17f3e18b4479e8277f3e33db3552a"
format_stamp: "Formatted at 2026-07-09 13:17:17 on dist-test-slave-fh5z"
I20260709 13:17:17.372766 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:17:17.377343 16426 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:17.378364 16329 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:17:17.378710 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-0-root
uuid: "4cd17f3e18b4479e8277f3e33db3552a"
format_stamp: "Formatted at 2026-07-09 13:17:17 on dist-test-slave-fh5z"
I20260709 13:17:17.379012 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:17.397789 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:17.399184 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:17.401957 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:17.406580 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:17.406852 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:17.407133 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:17.407357 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:17.514345 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.65:37915
I20260709 13:17:17.514405 16488 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.65:37915 every 8 connection(s)
I20260709 13:17:17.521692 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:17.532059 16493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:17.535439 16494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:17.545712 16496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:17.546335 16329 server_base.cc:1061] running on GCE node
I20260709 13:17:17.547201 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:17.547436 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:17.547629 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603037547610 us; error 0 us; skew 500 ppm
I20260709 13:17:17.548430 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:17.552273 16489 heartbeater.cc:344] Connected to a master server at 127.15.242.126:45023
I20260709 13:17:17.552935 16489 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:17.554435 16489 heartbeater.cc:507] Master 127.15.242.126:45023 requested a full tablet report, sending...
I20260709 13:17:17.554602 16329 webserver.cc:533] Webserver started at http://127.15.242.66:33853/ using document root <none> and password file <none>
I20260709 13:17:17.555246 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:17.555512 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:17.555902 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:17.557220 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-1-root/instance:
uuid: "548f92e80d9b43b08ae2ad252d925662"
format_stamp: "Formatted at 2026-07-09 13:17:17 on dist-test-slave-fh5z"
I20260709 13:17:17.558205 16361 ts_manager.cc:194] Registered new tserver with Master: 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915)
I20260709 13:17:17.561265 16361 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60882
I20260709 13:17:17.563459 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:17:17.568720 16501 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:17.569607 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:17:17.569882 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-1-root
uuid: "548f92e80d9b43b08ae2ad252d925662"
format_stamp: "Formatted at 2026-07-09 13:17:17 on dist-test-slave-fh5z"
I20260709 13:17:17.570211 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:17.594132 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:17.595427 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:17.598047 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:17.601554 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:17.601740 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:17.602083 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:17.602236 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:17:17.707612 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.66:36325
I20260709 13:17:17.707731 16563 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.66:36325 every 8 connection(s)
I20260709 13:17:17.720180 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:17.727751 16567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:17.730741 16568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:17.733964 16564 heartbeater.cc:344] Connected to a master server at 127.15.242.126:45023
I20260709 13:17:17.734447 16564 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:17.735625 16564 heartbeater.cc:507] Master 127.15.242.126:45023 requested a full tablet report, sending...
W20260709 13:17:17.736289 16570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:17.737998 16361 ts_manager.cc:194] Registered new tserver with Master: 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:17.738124 16329 server_base.cc:1061] running on GCE node
I20260709 13:17:17.739084 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:17.739301 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:17.739527 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603037739499 us; error 0 us; skew 500 ppm
I20260709 13:17:17.739907 16361 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60884
I20260709 13:17:17.740056 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:17.743520 16329 webserver.cc:533] Webserver started at http://127.15.242.67:34107/ using document root <none> and password file <none>
I20260709 13:17:17.743995 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:17.744203 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:17.744460 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:17.745520 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-2-root/instance:
uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
format_stamp: "Formatted at 2026-07-09 13:17:17 on dist-test-slave-fh5z"
I20260709 13:17:17.750119 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:17.753647 16575 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:17.754549 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:17.754930 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-2-root
uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
format_stamp: "Formatted at 2026-07-09 13:17:17 on dist-test-slave-fh5z"
I20260709 13:17:17.755223 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603035614178-16329-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:17.774300 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:17.775497 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:17.777067 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:17.780069 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:17.780309 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:17.780550 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:17.780735 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:17.881106 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.67:44955
I20260709 13:17:17.881201 16637 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.67:44955 every 8 connection(s)
I20260709 13:17:17.899619 16638 heartbeater.cc:344] Connected to a master server at 127.15.242.126:45023
I20260709 13:17:17.900025 16638 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:17.900822 16638 heartbeater.cc:507] Master 127.15.242.126:45023 requested a full tablet report, sending...
I20260709 13:17:17.903389 16361 ts_manager.cc:194] Registered new tserver with Master: 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:17.904367 16329 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015893247s
I20260709 13:17:17.904888 16361 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60888
I20260709 13:17:17.959512 16361 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60892:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:17.963514 16361 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:18.059203 16454 tablet_service.cc:1511] Processing CreateTablet for tablet 7702f414f3314380bc1c88b9661fdfee (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:18.059244 16453 tablet_service.cc:1511] Processing CreateTablet for tablet da2ad041f8d6442a8094dfd69529095a (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:18.063025 16454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7702f414f3314380bc1c88b9661fdfee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.065997 16452 tablet_service.cc:1511] Processing CreateTablet for tablet fc158be5105e468ab3b679463324eef7 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:18.064796 16451 tablet_service.cc:1511] Processing CreateTablet for tablet 16d9cbdb430e40c6a1b24bb8872bcb23 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:18.067168 16453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da2ad041f8d6442a8094dfd69529095a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.068779 16451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d9cbdb430e40c6a1b24bb8872bcb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.071693 16452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc158be5105e468ab3b679463324eef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.073680 16450 tablet_service.cc:1511] Processing CreateTablet for tablet c1627b5961294639bb5a94ce35b60745 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:18.078306 16528 tablet_service.cc:1511] Processing CreateTablet for tablet da2ad041f8d6442a8094dfd69529095a (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:18.078377 16529 tablet_service.cc:1511] Processing CreateTablet for tablet 7702f414f3314380bc1c88b9661fdfee (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:18.082645 16527 tablet_service.cc:1511] Processing CreateTablet for tablet fc158be5105e468ab3b679463324eef7 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:18.086381 16450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1627b5961294639bb5a94ce35b60745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.089001 16528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da2ad041f8d6442a8094dfd69529095a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.090341 16526 tablet_service.cc:1511] Processing CreateTablet for tablet 16d9cbdb430e40c6a1b24bb8872bcb23 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:18.087944 16525 tablet_service.cc:1511] Processing CreateTablet for tablet c1627b5961294639bb5a94ce35b60745 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:18.094466 16529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7702f414f3314380bc1c88b9661fdfee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.095680 16524 tablet_service.cc:1511] Processing CreateTablet for tablet de12aec11f9643fdb0229237761a9293 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:18.096724 16526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d9cbdb430e40c6a1b24bb8872bcb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.092492 16449 tablet_service.cc:1511] Processing CreateTablet for tablet de12aec11f9643fdb0229237761a9293 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:18.101485 16449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de12aec11f9643fdb0229237761a9293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.106432 16527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc158be5105e468ab3b679463324eef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.106503 16448 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3eb093022a42eca8fff5acf1cb4de7 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:18.109483 16523 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3eb093022a42eca8fff5acf1cb4de7 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:18.110800 16524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de12aec11f9643fdb0229237761a9293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.113306 16523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3eb093022a42eca8fff5acf1cb4de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.113778 16448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3eb093022a42eca8fff5acf1cb4de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.118085 16525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1627b5961294639bb5a94ce35b60745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.127816 16521 tablet_service.cc:1511] Processing CreateTablet for tablet e882198a4cfd4f128914c6fc89866929 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:18.129335 16521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e882198a4cfd4f128914c6fc89866929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.147737 16447 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4f3f4ec6b54e01b9abc58ba1192782 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:18.150267 16447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4f3f4ec6b54e01b9abc58ba1192782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.172325 16522 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4f3f4ec6b54e01b9abc58ba1192782 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:18.173966 16446 tablet_service.cc:1511] Processing CreateTablet for tablet e882198a4cfd4f128914c6fc89866929 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:18.187531 16446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e882198a4cfd4f128914c6fc89866929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.211566 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4f3f4ec6b54e01b9abc58ba1192782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.245769 16656 tablet_bootstrap.cc:492] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662: Bootstrap starting.
I20260709 13:17:18.260699 16600 tablet_service.cc:1511] Processing CreateTablet for tablet 16d9cbdb430e40c6a1b24bb8872bcb23 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:18.260798 16602 tablet_service.cc:1511] Processing CreateTablet for tablet da2ad041f8d6442a8094dfd69529095a (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:18.264424 16600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d9cbdb430e40c6a1b24bb8872bcb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.272207 16603 tablet_service.cc:1511] Processing CreateTablet for tablet 7702f414f3314380bc1c88b9661fdfee (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:18.273823 16602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da2ad041f8d6442a8094dfd69529095a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.273144 16601 tablet_service.cc:1511] Processing CreateTablet for tablet fc158be5105e468ab3b679463324eef7 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:18.267733 16599 tablet_service.cc:1511] Processing CreateTablet for tablet c1627b5961294639bb5a94ce35b60745 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:18.281363 16598 tablet_service.cc:1511] Processing CreateTablet for tablet de12aec11f9643fdb0229237761a9293 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
W20260709 13:17:18.279542 16407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:18.285076 16657 tablet_bootstrap.cc:492] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a: Bootstrap starting.
I20260709 13:17:18.288015 16603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7702f414f3314380bc1c88b9661fdfee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.289889 16597 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3eb093022a42eca8fff5acf1cb4de7 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:18.299809 16601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc158be5105e468ab3b679463324eef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.300537 16598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de12aec11f9643fdb0229237761a9293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.303020 16599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1627b5961294639bb5a94ce35b60745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.311342 16595 tablet_service.cc:1511] Processing CreateTablet for tablet e882198a4cfd4f128914c6fc89866929 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:18.309791 16596 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4f3f4ec6b54e01b9abc58ba1192782 (DEFAULT_TABLE table=test-workload [id=69f22ad2134d4daab1c38d691fb4ccf5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:18.322257 16597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3eb093022a42eca8fff5acf1cb4de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.336081 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e882198a4cfd4f128914c6fc89866929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.337244 16596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4f3f4ec6b54e01b9abc58ba1192782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.374667 16658 tablet_bootstrap.cc:492] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651: Bootstrap starting.
I20260709 13:17:18.378703 16656 tablet_bootstrap.cc:654] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.385804 16657 tablet_bootstrap.cc:654] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.407497 16656 tablet_bootstrap.cc:492] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662: No bootstrap required, opened a new log
I20260709 13:17:18.408156 16656 ts_tablet_manager.cc:1403] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662: Time spent bootstrapping tablet: real 0.193s	user 0.005s	sys 0.018s
I20260709 13:17:18.412503 16658 tablet_bootstrap.cc:654] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.411962 16656 raft_consensus.cc:359] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.413020 16656 raft_consensus.cc:385] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.413435 16656 raft_consensus.cc:740] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.416182 16656 consensus_queue.cc:260] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.420451 16657 tablet_bootstrap.cc:492] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a: No bootstrap required, opened a new log
I20260709 13:17:18.420882 16658 tablet_bootstrap.cc:492] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651: No bootstrap required, opened a new log
I20260709 13:17:18.421020 16657 ts_tablet_manager.cc:1403] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent bootstrapping tablet: real 0.167s	user 0.010s	sys 0.019s
I20260709 13:17:18.421474 16658 ts_tablet_manager.cc:1403] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.007s
I20260709 13:17:18.424981 16658 raft_consensus.cc:359] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.425840 16658 raft_consensus.cc:385] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.426257 16658 raft_consensus.cc:740] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.427268 16658 consensus_queue.cc:260] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.429252 16657 raft_consensus.cc:359] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.430248 16657 raft_consensus.cc:385] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.430635 16657 raft_consensus.cc:740] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.431510 16657 consensus_queue.cc:260] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.434099 16564 heartbeater.cc:499] Master 127.15.242.126:45023 was elected leader, sending a full tablet report...
I20260709 13:17:18.434581 16656 ts_tablet_manager.cc:1434] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662: Time spent starting tablet: real 0.026s	user 0.011s	sys 0.014s
I20260709 13:17:18.435505 16656 tablet_bootstrap.cc:492] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662: Bootstrap starting.
I20260709 13:17:18.437803 16658 ts_tablet_manager.cc:1434] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.006s
I20260709 13:17:18.438544 16638 heartbeater.cc:499] Master 127.15.242.126:45023 was elected leader, sending a full tablet report...
I20260709 13:17:18.441998 16656 tablet_bootstrap.cc:654] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.446816 16658 tablet_bootstrap.cc:492] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651: Bootstrap starting.
I20260709 13:17:18.454282 16658 tablet_bootstrap.cc:654] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.467408 16658 tablet_bootstrap.cc:492] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651: No bootstrap required, opened a new log
I20260709 13:17:18.468020 16658 ts_tablet_manager.cc:1403] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.008s
I20260709 13:17:18.469475 16657 ts_tablet_manager.cc:1434] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent starting tablet: real 0.048s	user 0.010s	sys 0.002s
I20260709 13:17:18.470389 16489 heartbeater.cc:499] Master 127.15.242.126:45023 was elected leader, sending a full tablet report...
W20260709 13:17:18.470801 16565 tablet.cc:2406] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:18.472649 16658 raft_consensus.cc:359] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.473415 16658 raft_consensus.cc:385] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.473717 16658 raft_consensus.cc:740] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.474607 16658 consensus_queue.cc:260] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.477106 16658 ts_tablet_manager.cc:1434] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:18.478322 16658 tablet_bootstrap.cc:492] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651: Bootstrap starting.
I20260709 13:17:18.481225 16657 tablet_bootstrap.cc:492] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a: Bootstrap starting.
I20260709 13:17:18.485077 16658 tablet_bootstrap.cc:654] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.497177 16658 tablet_bootstrap.cc:492] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651: No bootstrap required, opened a new log
I20260709 13:17:18.497664 16658 ts_tablet_manager.cc:1403] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 13:17:18.502065 16658 raft_consensus.cc:359] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.502985 16658 raft_consensus.cc:385] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.503316 16658 raft_consensus.cc:740] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.504173 16658 consensus_queue.cc:260] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.506220 16657 tablet_bootstrap.cc:654] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.506661 16658 ts_tablet_manager.cc:1434] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:17:18.507715 16658 tablet_bootstrap.cc:492] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651: Bootstrap starting.
I20260709 13:17:18.513865 16656 tablet_bootstrap.cc:492] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662: No bootstrap required, opened a new log
I20260709 13:17:18.514328 16656 ts_tablet_manager.cc:1403] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662: Time spent bootstrapping tablet: real 0.079s	user 0.037s	sys 0.032s
I20260709 13:17:18.514529 16658 tablet_bootstrap.cc:654] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.517166 16656 raft_consensus.cc:359] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.517932 16656 raft_consensus.cc:385] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.518254 16656 raft_consensus.cc:740] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.519502 16656 consensus_queue.cc:260] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.522267 16656 ts_tablet_manager.cc:1434] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:18.523931 16656 tablet_bootstrap.cc:492] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662: Bootstrap starting.
I20260709 13:17:18.526574 16658 tablet_bootstrap.cc:492] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651: No bootstrap required, opened a new log
I20260709 13:17:18.527069 16658 ts_tablet_manager.cc:1403] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:17:18.530340 16656 tablet_bootstrap.cc:654] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.530140 16658 raft_consensus.cc:359] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:18.530905 16658 raft_consensus.cc:385] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.531211 16658 raft_consensus.cc:740] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.532194 16658 consensus_queue.cc:260] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:18.534449 16663 raft_consensus.cc:493] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.534965 16663 raft_consensus.cc:515] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.539829 16663 leader_election.cc:290] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:18.545544 16657 tablet_bootstrap.cc:492] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a: No bootstrap required, opened a new log
I20260709 13:17:18.545965 16657 ts_tablet_manager.cc:1403] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent bootstrapping tablet: real 0.065s	user 0.005s	sys 0.014s
I20260709 13:17:18.548069 16658 ts_tablet_manager.cc:1434] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 13:17:18.549117 16658 tablet_bootstrap.cc:492] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651: Bootstrap starting.
I20260709 13:17:18.550333 16657 raft_consensus.cc:359] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.551291 16657 raft_consensus.cc:385] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.551676 16657 raft_consensus.cc:740] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.552573 16657 consensus_queue.cc:260] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.555270 16657 ts_tablet_manager.cc:1434] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:17:18.556250 16657 tablet_bootstrap.cc:492] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a: Bootstrap starting.
I20260709 13:17:18.564235 16658 tablet_bootstrap.cc:654] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.575752 16657 tablet_bootstrap.cc:654] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.577021 16656 tablet_bootstrap.cc:492] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662: No bootstrap required, opened a new log
I20260709 13:17:18.577528 16656 ts_tablet_manager.cc:1403] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.015s
I20260709 13:17:18.583617 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1627b5961294639bb5a94ce35b60745" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a" is_pre_election: true
I20260709 13:17:18.584247 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1627b5961294639bb5a94ce35b60745" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:18.584992 16539 raft_consensus.cc:2468] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 0.
I20260709 13:17:18.585384 16657 tablet_bootstrap.cc:492] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a: No bootstrap required, opened a new log
I20260709 13:17:18.585816 16657 ts_tablet_manager.cc:1403] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.003s
W20260709 13:17:18.585795 16579 leader_election.cc:343] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.586867 16577 leader_election.cc:304] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:18.588179 16663 raft_consensus.cc:2804] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.588560 16663 raft_consensus.cc:493] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.588999 16663 raft_consensus.cc:3060] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.588603 16658 tablet_bootstrap.cc:492] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651: No bootstrap required, opened a new log
I20260709 13:17:18.589641 16658 ts_tablet_manager.cc:1403] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.001s
I20260709 13:17:18.592339 16657 raft_consensus.cc:359] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.592664 16658 raft_consensus.cc:359] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.593086 16657 raft_consensus.cc:385] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.593307 16658 raft_consensus.cc:385] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.593441 16657 raft_consensus.cc:740] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.593631 16658 raft_consensus.cc:740] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.594398 16658 consensus_queue.cc:260] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.594398 16657 consensus_queue.cc:260] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.597035 16657 ts_tablet_manager.cc:1434] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:17:18.596773 16663 raft_consensus.cc:515] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.598073 16657 tablet_bootstrap.cc:492] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a: Bootstrap starting.
I20260709 13:17:18.600227 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1627b5961294639bb5a94ce35b60745" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
W20260709 13:17:18.601756 16579 leader_election.cc:343] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.604959 16657 tablet_bootstrap.cc:654] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.606832 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1627b5961294639bb5a94ce35b60745" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:18.607455 16539 raft_consensus.cc:3060] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.614849 16539 raft_consensus.cc:2468] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 1.
I20260709 13:17:18.616125 16577 leader_election.cc:304] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:18.619354 16676 raft_consensus.cc:2804] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.619818 16676 raft_consensus.cc:697] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Becoming Leader. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:18.620144 16658 ts_tablet_manager.cc:1434] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.010s
I20260709 13:17:18.621132 16658 tablet_bootstrap.cc:492] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651: Bootstrap starting.
I20260709 13:17:18.622148 16657 tablet_bootstrap.cc:492] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a: No bootstrap required, opened a new log
I20260709 13:17:18.622599 16657 ts_tablet_manager.cc:1403] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.010s
I20260709 13:17:18.623173 16664 raft_consensus.cc:493] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.623689 16664 raft_consensus.cc:515] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.626482 16664 leader_election.cc:290] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:18.604619 16656 raft_consensus.cc:359] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.633389 16663 leader_election.cc:290] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:18.633741 16656 raft_consensus.cc:385] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.634402 16656 raft_consensus.cc:740] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.634465 16663 raft_consensus.cc:493] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.635119 16663 raft_consensus.cc:515] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:18.635340 16656 consensus_queue.cc:260] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.636940 16658 tablet_bootstrap.cc:654] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.636106 16657 raft_consensus.cc:359] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.640700 16657 raft_consensus.cc:385] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.646790 16657 raft_consensus.cc:740] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.647159 16656 ts_tablet_manager.cc:1434] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.002s
I20260709 13:17:18.648495 16656 tablet_bootstrap.cc:492] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662: Bootstrap starting.
I20260709 13:17:18.653479 16663 leader_election.cc:290] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:18.654338 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a" is_pre_election: true
W20260709 13:17:18.655988 16579 leader_election.cc:343] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.647650 16676 consensus_queue.cc:237] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.647567 16657 consensus_queue.cc:260] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.667711 16657 ts_tablet_manager.cc:1434] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 13:17:18.668877 16657 tablet_bootstrap.cc:492] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a: Bootstrap starting.
W20260709 13:17:18.665586 16577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:36325, user_credentials={real_user=slave}} blocked reactor thread for 48993us
I20260709 13:17:18.676932 16656 tablet_bootstrap.cc:654] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.680352 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:18.684154 16657 tablet_bootstrap.cc:654] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:18.685566 16577 leader_election.cc:343] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.687263 16577 leader_election.cc:304] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651; no voters: 4cd17f3e18b4479e8277f3e33db3552a, 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:18.689445 16678 raft_consensus.cc:2749] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.705883 16359 catalog_manager.cc:5697] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.726227 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3eb093022a42eca8fff5acf1cb4de7" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:18.728050 16658 tablet_bootstrap.cc:492] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651: No bootstrap required, opened a new log
I20260709 13:17:18.728525 16658 ts_tablet_manager.cc:1403] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent bootstrapping tablet: real 0.108s	user 0.004s	sys 0.020s
I20260709 13:17:18.730037 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3eb093022a42eca8fff5acf1cb4de7" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:18.730639 16539 raft_consensus.cc:2468] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 0.
I20260709 13:17:18.731380 16658 raft_consensus.cc:359] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.732182 16658 raft_consensus.cc:385] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.732132 16428 leader_election.cc:304] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:18.732553 16658 raft_consensus.cc:740] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.733108 16664 raft_consensus.cc:2804] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.733472 16664 raft_consensus.cc:493] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.733795 16664 raft_consensus.cc:3060] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.733337 16658 consensus_queue.cc:260] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.739617 16658 ts_tablet_manager.cc:1434] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:17:18.740983 16658 tablet_bootstrap.cc:492] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651: Bootstrap starting.
I20260709 13:17:18.747085 16685 raft_consensus.cc:493] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.748330 16430 leader_election.cc:343] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.745666 16664 raft_consensus.cc:515] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.747834 16685 raft_consensus.cc:515] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.763471 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3eb093022a42eca8fff5acf1cb4de7" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:18.764055 16539 raft_consensus.cc:3060] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.764334 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3eb093022a42eca8fff5acf1cb4de7" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:18.765111 16613 raft_consensus.cc:3060] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.757544 16657 tablet_bootstrap.cc:492] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a: No bootstrap required, opened a new log
I20260709 13:17:18.767347 16664 leader_election.cc:290] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 election: Requested vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:18.770892 16657 ts_tablet_manager.cc:1403] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent bootstrapping tablet: real 0.102s	user 0.035s	sys 0.030s
I20260709 13:17:18.767534 16658 tablet_bootstrap.cc:654] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.773378 16662 raft_consensus.cc:493] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.774416 16662 raft_consensus.cc:515] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.774912 16664 raft_consensus.cc:493] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.784116 16664 raft_consensus.cc:515] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.784499 16662 leader_election.cc:290] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:18.791417 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:18.795368 16656 tablet_bootstrap.cc:492] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662: No bootstrap required, opened a new log
I20260709 13:17:18.795120 16539 raft_consensus.cc:2468] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 1.
I20260709 13:17:18.792013 16612 raft_consensus.cc:2468] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 0.
I20260709 13:17:18.788086 16685 leader_election.cc:290] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:18.798781 16664 leader_election.cc:290] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:18.799818 16613 raft_consensus.cc:2468] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 1.
I20260709 13:17:18.800225 16656 ts_tablet_manager.cc:1403] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662: Time spent bootstrapping tablet: real 0.151s	user 0.025s	sys 0.015s
I20260709 13:17:18.800083 16430 leader_election.cc:304] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 
I20260709 13:17:18.803246 16664 raft_consensus.cc:2804] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.806977 16664 raft_consensus.cc:493] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.805757 16657 raft_consensus.cc:359] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.807487 16664 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.807842 16657 raft_consensus.cc:385] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.809689 16657 raft_consensus.cc:740] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.806497 16430 leader_election.cc:304] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 
I20260709 13:17:18.810998 16685 raft_consensus.cc:2804] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.811280 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:18.810760 16657 consensus_queue.cc:260] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
W20260709 13:17:18.813081 16430 leader_election.cc:343] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.811385 16656 raft_consensus.cc:359] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.813952 16656 raft_consensus.cc:385] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.814421 16656 raft_consensus.cc:740] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.815342 16656 consensus_queue.cc:260] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.818267 16656 ts_tablet_manager.cc:1434] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:17:18.819388 16656 tablet_bootstrap.cc:492] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662: Bootstrap starting.
I20260709 13:17:18.828086 16664 raft_consensus.cc:515] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.833760 16676 raft_consensus.cc:493] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.834404 16676 raft_consensus.cc:515] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.835518 16658 tablet_bootstrap.cc:492] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651: No bootstrap required, opened a new log
I20260709 13:17:18.836074 16658 ts_tablet_manager.cc:1403] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent bootstrapping tablet: real 0.096s	user 0.021s	sys 0.005s
I20260709 13:17:18.837311 16676 leader_election.cc:290] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:18.838614 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a" is_pre_election: true
W20260709 13:17:18.840631 16579 leader_election.cc:343] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.842993 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:18.843613 16613 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.846454 16685 raft_consensus.cc:697] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 LEADER]: Becoming Leader. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:18.847481 16664 leader_election.cc:290] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 election: Requested vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:18.848001 16685 consensus_queue.cc:237] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.848918 16656 tablet_bootstrap.cc:654] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.855091 16658 raft_consensus.cc:359] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.860302 16692 raft_consensus.cc:493] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.860093 16658 raft_consensus.cc:385] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.860879 16692 raft_consensus.cc:515] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.868142 16658 raft_consensus.cc:740] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.871167 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:18.872165 16692 leader_election.cc:290] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:18.873241 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:18.873786 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:18.871287 16658 consensus_queue.cc:260] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.874773 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
W20260709 13:17:18.875474 16430 leader_election.cc:343] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.863530 16657 ts_tablet_manager.cc:1434] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent starting tablet: real 0.092s	user 0.021s	sys 0.015s
I20260709 13:17:18.876348 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:18.876837 16657 tablet_bootstrap.cc:492] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a: Bootstrap starting.
I20260709 13:17:18.876813 16613 raft_consensus.cc:2468] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 1.
I20260709 13:17:18.876559 16658 ts_tablet_manager.cc:1434] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.003s
I20260709 13:17:18.878156 16430 leader_election.cc:304] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 
W20260709 13:17:18.878201 16428 leader_election.cc:343] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.879004 16692 raft_consensus.cc:2804] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.879536 16658 tablet_bootstrap.cc:492] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651: Bootstrap starting.
I20260709 13:17:18.879617 16692 raft_consensus.cc:697] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 LEADER]: Becoming Leader. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
W20260709 13:17:18.879822 16428 leader_election.cc:343] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.880260 16428 leader_election.cc:304] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a; no voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:18.880789 16692 consensus_queue.cc:237] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.881757 16691 raft_consensus.cc:2749] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:18.883340 16428 leader_election.cc:343] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:18.884776 16428 leader_election.cc:343] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.885365 16428 leader_election.cc:304] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a; no voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:18.886323 16664 raft_consensus.cc:2749] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.888351 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:18.889050 16539 raft_consensus.cc:2468] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 0.
I20260709 13:17:18.890931 16577 leader_election.cc:304] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:18.891702 16676 raft_consensus.cc:2804] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.892108 16676 raft_consensus.cc:493] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.892493 16676 raft_consensus.cc:3060] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.893476 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc158be5105e468ab3b679463324eef7" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:18.894188 16613 raft_consensus.cc:2468] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 0.
I20260709 13:17:18.895771 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc158be5105e468ab3b679463324eef7" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a" is_pre_election: true
I20260709 13:17:18.895699 16505 leader_election.cc:304] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:18.896974 16662 raft_consensus.cc:2804] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:17:18.897343 16505 leader_election.cc:343] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.897401 16662 raft_consensus.cc:493] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.897974 16662 raft_consensus.cc:3060] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.899114 16676 raft_consensus.cc:515] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.899823 16657 tablet_bootstrap.cc:654] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.900738 16676 leader_election.cc:290] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:18.902258 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:18.902479 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:18.903021 16539 raft_consensus.cc:3060] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.906785 16658 tablet_bootstrap.cc:654] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:18.904232 16579 leader_election.cc:343] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.908352 16657 tablet_bootstrap.cc:492] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a: No bootstrap required, opened a new log
I20260709 13:17:18.909271 16657 ts_tablet_manager.cc:1403] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.007s
I20260709 13:17:18.910674 16662 raft_consensus.cc:515] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.912518 16656 tablet_bootstrap.cc:492] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662: No bootstrap required, opened a new log
I20260709 13:17:18.913527 16656 ts_tablet_manager.cc:1403] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.000s
I20260709 13:17:18.918263 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc158be5105e468ab3b679463324eef7" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:18.917313 16662 leader_election.cc:290] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
W20260709 13:17:18.920639 16505 leader_election.cc:343] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.920955 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc158be5105e468ab3b679463324eef7" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:18.921700 16613 raft_consensus.cc:3060] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.935024 16613 raft_consensus.cc:2468] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 1.
I20260709 13:17:18.936282 16505 leader_election.cc:304] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:18.937440 16662 raft_consensus.cc:2804] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.936421 16657 raft_consensus.cc:359] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.937958 16658 tablet_bootstrap.cc:492] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651: No bootstrap required, opened a new log
I20260709 13:17:18.938302 16657 raft_consensus.cc:385] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.939591 16657 raft_consensus.cc:740] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.939172 16539 raft_consensus.cc:2468] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 1.
I20260709 13:17:18.946801 16657 consensus_queue.cc:260] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.947525 16577 leader_election.cc:304] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:18.948603 16676 raft_consensus.cc:2804] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.939538 16656 raft_consensus.cc:359] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.938464 16658 ts_tablet_manager.cc:1403] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.001s
I20260709 13:17:18.949064 16676 raft_consensus.cc:697] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Becoming Leader. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:18.945928 16662 raft_consensus.cc:697] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Becoming Leader. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:18.949939 16676 consensus_queue.cc:237] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.950591 16662 consensus_queue.cc:237] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.951972 16658 raft_consensus.cc:359] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.952795 16658 raft_consensus.cc:385] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.953166 16658 raft_consensus.cc:740] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.949209 16656 raft_consensus.cc:385] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.943846 16361 catalog_manager.cc:5697] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65). New cstate: current_term: 1 leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.953935 16656 raft_consensus.cc:740] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.954797 16656 consensus_queue.cc:260] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.957108 16656 ts_tablet_manager.cc:1434] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 13:17:18.949075 16657 ts_tablet_manager.cc:1434] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:17:18.958853 16657 tablet_bootstrap.cc:492] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a: Bootstrap starting.
I20260709 13:17:18.963893 16656 tablet_bootstrap.cc:492] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662: Bootstrap starting.
I20260709 13:17:18.976449 16359 catalog_manager.cc:5697] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65). New cstate: current_term: 1 leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.978303 16658 consensus_queue.cc:260] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:18.982304 16658 ts_tablet_manager.cc:1434] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:17:18.983369 16658 tablet_bootstrap.cc:492] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651: Bootstrap starting.
I20260709 13:17:18.986567 16657 tablet_bootstrap.cc:654] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.993114 16656 tablet_bootstrap.cc:654] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.005611 16658 tablet_bootstrap.cc:654] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.009649 16662 raft_consensus.cc:493] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.010317 16662 raft_consensus.cc:515] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.011569 16359 catalog_manager.cc:5697] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 reported cstate change: term changed from 0 to 1, leader changed from <none> to 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "548f92e80d9b43b08ae2ad252d925662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.013622 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e882198a4cfd4f128914c6fc89866929" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a" is_pre_election: true
W20260709 13:17:19.015372 16505 leader_election.cc:343] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.017519 16662 leader_election.cc:290] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:19.017750 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e882198a4cfd4f128914c6fc89866929" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:19.018363 16613 raft_consensus.cc:2468] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 0.
I20260709 13:17:19.019788 16505 leader_election.cc:304] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:19.020864 16662 raft_consensus.cc:2804] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.021282 16662 raft_consensus.cc:493] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.021646 16662 raft_consensus.cc:3060] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.024003 16657 tablet_bootstrap.cc:492] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a: No bootstrap required, opened a new log
I20260709 13:17:19.024523 16657 ts_tablet_manager.cc:1403] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.007s
I20260709 13:17:19.027045 16361 catalog_manager.cc:5697] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.026691 16656 tablet_bootstrap.cc:492] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662: No bootstrap required, opened a new log
I20260709 13:17:19.029908 16656 ts_tablet_manager.cc:1403] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.017s
I20260709 13:17:19.031656 16658 tablet_bootstrap.cc:492] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651: No bootstrap required, opened a new log
I20260709 13:17:19.032338 16658 ts_tablet_manager.cc:1403] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.001s
I20260709 13:17:19.036743 16662 raft_consensus.cc:515] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.032472 16657 raft_consensus.cc:359] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.041083 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e882198a4cfd4f128914c6fc89866929" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:19.041994 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e882198a4cfd4f128914c6fc89866929" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:19.042567 16613 raft_consensus.cc:3060] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:19.042695 16505 leader_election.cc:343] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.043375 16657 raft_consensus.cc:385] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.043741 16657 raft_consensus.cc:740] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.044941 16657 consensus_queue.cc:260] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.047305 16657 ts_tablet_manager.cc:1434] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.002s
I20260709 13:17:19.048283 16657 tablet_bootstrap.cc:492] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a: Bootstrap starting.
I20260709 13:17:19.049300 16613 raft_consensus.cc:2468] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 1.
I20260709 13:17:19.050321 16505 leader_election.cc:304] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:19.051326 16699 raft_consensus.cc:2804] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.057000 16657 tablet_bootstrap.cc:654] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.058322 16662 leader_election.cc:290] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:19.057616 16656 raft_consensus.cc:359] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.059909 16656 raft_consensus.cc:385] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.060252 16656 raft_consensus.cc:740] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.070470 16656 consensus_queue.cc:260] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.072739 16658 raft_consensus.cc:359] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.074128 16699 raft_consensus.cc:697] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Becoming Leader. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:19.076152 16656 ts_tablet_manager.cc:1434] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:17:19.077600 16656 tablet_bootstrap.cc:492] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662: Bootstrap starting.
I20260709 13:17:19.077077 16699 consensus_queue.cc:237] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.080708 16658 raft_consensus.cc:385] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.082157 16658 raft_consensus.cc:740] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.082933 16658 consensus_queue.cc:260] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.105041 16657 tablet_bootstrap.cc:492] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a: No bootstrap required, opened a new log
I20260709 13:17:19.098285 16656 tablet_bootstrap.cc:654] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.106542 16657 ts_tablet_manager.cc:1403] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.023s
I20260709 13:17:19.108496 16658 ts_tablet_manager.cc:1434] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:17:19.121898 16657 raft_consensus.cc:359] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.126343 16657 raft_consensus.cc:385] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.126891 16657 raft_consensus.cc:740] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.128373 16656 tablet_bootstrap.cc:492] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662: No bootstrap required, opened a new log
I20260709 13:17:19.127959 16657 consensus_queue.cc:260] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.129070 16656 ts_tablet_manager.cc:1403] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662: Time spent bootstrapping tablet: real 0.052s	user 0.023s	sys 0.008s
I20260709 13:17:19.130362 16676 raft_consensus.cc:493] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.130997 16676 raft_consensus.cc:515] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.133682 16676 leader_election.cc:290] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:19.135982 16657 ts_tablet_manager.cc:1434] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 13:17:19.136742 16692 raft_consensus.cc:493] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.133831 16656 raft_consensus.cc:359] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:19.137458 16656 raft_consensus.cc:385] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.137336 16692 raft_consensus.cc:515] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.137540 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a" is_pre_election: true
I20260709 13:17:19.139467 16464 raft_consensus.cc:2468] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 0.
I20260709 13:17:19.141710 16579 leader_election.cc:304] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 
I20260709 13:17:19.142328 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1627b5961294639bb5a94ce35b60745" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:19.142704 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:19.114880 16361 catalog_manager.cc:5697] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 reported cstate change: term changed from 0 to 1, leader changed from <none> to 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "548f92e80d9b43b08ae2ad252d925662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.145537 16692 leader_election.cc:290] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:19.148368 16657 tablet_bootstrap.cc:492] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a: Bootstrap starting.
I20260709 13:17:19.145370 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1627b5961294639bb5a94ce35b60745" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:19.145429 16676 raft_consensus.cc:2804] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.150576 16676 raft_consensus.cc:493] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.151108 16539 raft_consensus.cc:2393] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cd17f3e18b4479e8277f3e33db3552a in current term 1: Already voted for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in this term.
I20260709 13:17:19.151281 16676 raft_consensus.cc:3060] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:19.146400 16577 leader_election.cc:343] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.137850 16656 raft_consensus.cc:740] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.153976 16428 leader_election.cc:304] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a; no voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:19.154605 16656 consensus_queue.cc:260] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:19.155369 16692 raft_consensus.cc:3060] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.163147 16656 ts_tablet_manager.cc:1434] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.006s
I20260709 13:17:19.164808 16656 tablet_bootstrap.cc:492] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662: Bootstrap starting.
I20260709 13:17:19.167514 16676 raft_consensus.cc:515] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.174733 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:19.175508 16464 raft_consensus.cc:3060] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.176461 16692 raft_consensus.cc:2749] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.177946 16676 leader_election.cc:290] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:19.179991 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:19.182446 16692 raft_consensus.cc:493] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:19.182775 16577 leader_election.cc:343] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.183827 16692 raft_consensus.cc:515] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.186841 16692 leader_election.cc:290] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:19.188898 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc158be5105e468ab3b679463324eef7" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:19.197753 16464 raft_consensus.cc:2468] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 1.
I20260709 13:17:19.198776 16613 raft_consensus.cc:2393] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cd17f3e18b4479e8277f3e33db3552a in current term 1: Already voted for candidate 548f92e80d9b43b08ae2ad252d925662 in this term.
I20260709 13:17:19.200042 16579 leader_election.cc:304] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:19.201289 16676 raft_consensus.cc:2804] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.202160 16676 raft_consensus.cc:697] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Becoming Leader. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:19.203418 16676 consensus_queue.cc:237] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.188984 16656 tablet_bootstrap.cc:654] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.216387 16359 catalog_manager.cc:5697] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.194221 16657 tablet_bootstrap.cc:654] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.193984 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc158be5105e468ab3b679463324eef7" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:19.223577 16676 raft_consensus.cc:493] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.224385 16676 raft_consensus.cc:515] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.226811 16428 leader_election.cc:304] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a; no voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:19.228055 16692 raft_consensus.cc:3060] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.233901 16678 consensus_queue.cc:1048] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.227535 16676 leader_election.cc:290] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:19.238829 16692 raft_consensus.cc:2749] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.241376 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:19.244186 16656 tablet_bootstrap.cc:492] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662: No bootstrap required, opened a new log
W20260709 13:17:19.244504 16577 leader_election.cc:343] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.244415 16678 consensus_queue.cc:1048] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.245046 16656 ts_tablet_manager.cc:1403] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.000s
I20260709 13:17:19.253762 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a" is_pre_election: true
I20260709 13:17:19.254874 16464 raft_consensus.cc:2468] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 0.
I20260709 13:17:19.256661 16579 leader_election.cc:304] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:19.257817 16657 tablet_bootstrap.cc:492] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a: No bootstrap required, opened a new log
I20260709 13:17:19.259011 16711 raft_consensus.cc:2804] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.259816 16711 raft_consensus.cc:493] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.260357 16711 raft_consensus.cc:3060] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.259090 16692 raft_consensus.cc:493] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.262871 16692 raft_consensus.cc:515] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.265882 16692 leader_election.cc:290] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:19.268841 16692 consensus_queue.cc:1048] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.269186 16699 raft_consensus.cc:493] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.269781 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:19.269897 16699 raft_consensus.cc:515] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.271457 16538 raft_consensus.cc:2393] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cd17f3e18b4479e8277f3e33db3552a in current term 1: Already voted for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in this term.
I20260709 13:17:19.273212 16699 leader_election.cc:290] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:19.279340 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:19.280517 16612 raft_consensus.cc:2393] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 548f92e80d9b43b08ae2ad252d925662 in current term 1: Already voted for candidate 4cd17f3e18b4479e8277f3e33db3552a in this term.
I20260709 13:17:19.280998 16657 ts_tablet_manager.cc:1403] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a: Time spent bootstrapping tablet: real 0.133s	user 0.015s	sys 0.003s
I20260709 13:17:19.282684 16656 raft_consensus.cc:359] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.283381 16656 raft_consensus.cc:385] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.283583 16656 raft_consensus.cc:740] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.280568 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:19.291486 16656 consensus_queue.cc:260] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.285729 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a" is_pre_election: true
I20260709 13:17:19.299088 16430 leader_election.cc:304] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a; no voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662
W20260709 13:17:19.299511 16407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:19.299372 16657 raft_consensus.cc:359] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:19.300503 16657 raft_consensus.cc:385] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.300868 16657 raft_consensus.cc:740] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.303092 16656 ts_tablet_manager.cc:1434] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.002s
I20260709 13:17:19.304602 16656 tablet_bootstrap.cc:492] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662: Bootstrap starting.
I20260709 13:17:19.302714 16699 raft_consensus.cc:493] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.310611 16699 raft_consensus.cc:515] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.319240 16505 leader_election.cc:304] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 548f92e80d9b43b08ae2ad252d925662; no voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:19.302906 16692 raft_consensus.cc:3060] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.322746 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a" is_pre_election: true
I20260709 13:17:19.323163 16685 consensus_queue.cc:1048] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.323791 16464 raft_consensus.cc:2468] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 0.
I20260709 13:17:19.324894 16657 consensus_queue.cc:260] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:19.330868 16705 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.333604 16505 leader_election.cc:304] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:19.334843 16662 raft_consensus.cc:2804] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.335413 16662 raft_consensus.cc:493] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.335947 16662 raft_consensus.cc:3060] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.351311 16657 ts_tablet_manager.cc:1434] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.008s
I20260709 13:17:19.311090 16711 raft_consensus.cc:515] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.357532 16699 leader_election.cc:290] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:19.373411 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:19.361919 16711 leader_election.cc:290] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:19.380115 16656 tablet_bootstrap.cc:654] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.381268 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:19.382244 16463 raft_consensus.cc:3060] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.379458 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:19.388718 16612 raft_consensus.cc:2393] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 548f92e80d9b43b08ae2ad252d925662 in current term 1: Already voted for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in this term.
I20260709 13:17:19.397884 16664 consensus_queue.cc:1048] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.404587 16692 raft_consensus.cc:2749] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.398208 16705 raft_consensus.cc:2749] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.417434 16662 raft_consensus.cc:515] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.425890 16463 raft_consensus.cc:2468] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 1.
I20260709 13:17:19.426990 16664 consensus_queue.cc:1048] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.428628 16579 leader_election.cc:304] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 
I20260709 13:17:19.429721 16678 raft_consensus.cc:2804] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.430332 16678 raft_consensus.cc:697] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Becoming Leader. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:19.431334 16678 consensus_queue.cc:237] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.430441 16538 raft_consensus.cc:2393] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fab174cdeb6404e87b5a5f33f3fd651 in current term 1: Already voted for candidate 548f92e80d9b43b08ae2ad252d925662 in this term.
I20260709 13:17:19.450459 16656 tablet_bootstrap.cc:492] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662: No bootstrap required, opened a new log
I20260709 13:17:19.451215 16656 ts_tablet_manager.cc:1403] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662: Time spent bootstrapping tablet: real 0.147s	user 0.015s	sys 0.007s
I20260709 13:17:19.482546 16662 leader_election.cc:290] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:19.483466 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:19.484987 16463 raft_consensus.cc:2393] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 548f92e80d9b43b08ae2ad252d925662 in current term 1: Already voted for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in this term.
I20260709 13:17:19.486487 16656 raft_consensus.cc:359] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.487267 16656 raft_consensus.cc:385] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.487686 16656 raft_consensus.cc:740] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.492585 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:19.493949 16656 consensus_queue.cc:260] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.499871 16656 ts_tablet_manager.cc:1434] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662: Time spent starting tablet: real 0.048s	user 0.014s	sys 0.000s
I20260709 13:17:19.500779 16662 raft_consensus.cc:493] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.501434 16662 raft_consensus.cc:515] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.503934 16662 leader_election.cc:290] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:19.503751 16505 leader_election.cc:304] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 548f92e80d9b43b08ae2ad252d925662; no voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:19.506418 16699 raft_consensus.cc:2749] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.508603 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:19.509433 16361 catalog_manager.cc:5697] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.512895 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a" is_pre_election: true
I20260709 13:17:19.521381 16662 raft_consensus.cc:493] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.522161 16662 raft_consensus.cc:515] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:19.526258 16662 leader_election.cc:290] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:19.526949 16662 consensus_queue.cc:1048] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.531402 16699 consensus_queue.cc:1048] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.530646 16678 consensus_queue.cc:1048] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.536125 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:19.537137 16611 raft_consensus.cc:2468] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 0.
I20260709 13:17:19.535117 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a" is_pre_election: true
I20260709 13:17:19.538638 16505 leader_election.cc:304] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:19.538938 16463 raft_consensus.cc:2468] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 0.
I20260709 13:17:19.539496 16699 raft_consensus.cc:2804] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.539958 16699 raft_consensus.cc:493] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.540361 16699 raft_consensus.cc:3060] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.534183 16464 raft_consensus.cc:2393] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 548f92e80d9b43b08ae2ad252d925662 in current term 1: Already voted for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in this term.
I20260709 13:17:19.535348 16676 consensus_queue.cc:1048] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:17:19.545576 16726 raft_consensus.cc:493] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.555557 16505 leader_election.cc:304] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 548f92e80d9b43b08ae2ad252d925662; no voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:19.557667 16662 raft_consensus.cc:3060] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.546458 16726 raft_consensus.cc:515] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:19.581884 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e882198a4cfd4f128914c6fc89866929" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" is_pre_election: true
I20260709 13:17:19.582531 16662 raft_consensus.cc:2749] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.583389 16613 raft_consensus.cc:2393] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cd17f3e18b4479e8277f3e33db3552a in current term 1: Already voted for candidate 548f92e80d9b43b08ae2ad252d925662 in this term.
I20260709 13:17:19.583508 16726 leader_election.cc:290] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:19.600551 16705 consensus_queue.cc:1048] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.595278 16699 raft_consensus.cc:515] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:19.607980 16699 leader_election.cc:290] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:19.614951 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e882198a4cfd4f128914c6fc89866929" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548f92e80d9b43b08ae2ad252d925662" is_pre_election: true
I20260709 13:17:19.619087 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:19.619938 16462 raft_consensus.cc:3060] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.627907 16462 raft_consensus.cc:2468] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 1.
I20260709 13:17:19.631000 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:19.631613 16428 leader_election.cc:304] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a; no voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:19.632000 16611 raft_consensus.cc:3060] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.633160 16726 raft_consensus.cc:3060] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.642628 16726 raft_consensus.cc:2749] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.645514 16505 leader_election.cc:304] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:19.646852 16699 raft_consensus.cc:2804] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.647440 16699 raft_consensus.cc:697] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Becoming Leader. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:19.648403 16699 consensus_queue.cc:237] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:19.650254 16678 consensus_queue.cc:1048] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.661674 16662 consensus_queue.cc:1048] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.646309 16611 raft_consensus.cc:2468] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 1.
I20260709 13:17:19.696681 16678 consensus_queue.cc:1048] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.717192 16359 catalog_manager.cc:5697] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 reported cstate change: term changed from 0 to 1, leader changed from <none> to 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "548f92e80d9b43b08ae2ad252d925662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.852237 16678 consensus_queue.cc:1048] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.866423 16676 consensus_queue.cc:1048] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.984372 16539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
mode: GRACEFUL
new_leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:44288
I20260709 13:17:19.985158 16539 raft_consensus.cc:606] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Received request to transfer leadership to TS 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:20.003896 16611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a"
dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
mode: GRACEFUL
new_leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:55118
I20260709 13:17:20.004678 16611 raft_consensus.cc:606] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Received request to transfer leadership to TS 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:20.012879 16539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc158be5105e468ab3b679463324eef7"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
mode: GRACEFUL
new_leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:44288
I20260709 13:17:20.013538 16539 raft_consensus.cc:606] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Received request to transfer leadership to TS 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:20.020450 16611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23"
dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
mode: GRACEFUL
new_leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:55118
I20260709 13:17:20.021144 16611 raft_consensus.cc:606] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Received request to transfer leadership to TS 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:20.028589 16611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1627b5961294639bb5a94ce35b60745"
dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
mode: GRACEFUL
new_leader_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:55118
I20260709 13:17:20.029276 16611 raft_consensus.cc:606] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Received request to transfer leadership to TS 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:20.048211 16461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de12aec11f9643fdb0229237761a9293"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
mode: GRACEFUL
new_leader_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:36908
I20260709 13:17:20.048978 16461 raft_consensus.cc:606] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 LEADER]: Received request to transfer leadership to TS 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:20.056483 16461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d3eb093022a42eca8fff5acf1cb4de7"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
mode: GRACEFUL
new_leader_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:36908
I20260709 13:17:20.057224 16461 raft_consensus.cc:606] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 LEADER]: Received request to transfer leadership to TS 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:20.059588 16733 raft_consensus.cc:993] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662: : Instructing follower 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:20.060158 16699 raft_consensus.cc:1081] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Signalling peer 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:20.062358 16461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc158be5105e468ab3b679463324eef7"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:36904
I20260709 13:17:20.063136 16461 raft_consensus.cc:493] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.063692 16461 raft_consensus.cc:3060] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.066264 16611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782"
dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
mode: GRACEFUL
new_leader_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:55118
I20260709 13:17:20.067018 16611 raft_consensus.cc:606] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Received request to transfer leadership to TS 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:20.070993 16461 raft_consensus.cc:515] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.073762 16461 leader_election.cc:290] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 2 election: Requested vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:20.074833 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc158be5105e468ab3b679463324eef7" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:20.075497 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc158be5105e468ab3b679463324eef7" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:20.075686 16539 raft_consensus.cc:3055] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.076058 16611 raft_consensus.cc:3060] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.076126 16539 raft_consensus.cc:740] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:20.077250 16539 consensus_queue.cc:260] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.079087 16539 raft_consensus.cc:3060] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.082486 16537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e882198a4cfd4f128914c6fc89866929"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
mode: GRACEFUL
new_leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
 from {username='slave'} at 127.0.0.1:44288
I20260709 13:17:20.083278 16537 raft_consensus.cc:606] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Received request to transfer leadership to TS 2fab174cdeb6404e87b5a5f33f3fd651
I20260709 13:17:20.085124 16611 raft_consensus.cc:2468] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 2.
I20260709 13:17:20.086746 16430 leader_election.cc:304] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 
I20260709 13:17:20.087613 16726 raft_consensus.cc:2804] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.088168 16726 raft_consensus.cc:697] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Becoming Leader. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:20.088284 16539 raft_consensus.cc:2468] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 2.
I20260709 13:17:20.089150 16726 consensus_queue.cc:237] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.127048 16699 consensus_queue.cc:1048] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.149629 16699 raft_consensus.cc:993] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662: : Instructing follower 2fab174cdeb6404e87b5a5f33f3fd651 to start an election
I20260709 13:17:20.150188 16699 raft_consensus.cc:1081] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Signalling peer 2fab174cdeb6404e87b5a5f33f3fd651 to start an election
I20260709 13:17:20.154968 16613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e882198a4cfd4f128914c6fc89866929"
dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
 from {username='slave'} at 127.0.0.1:55102
I20260709 13:17:20.155946 16613 raft_consensus.cc:493] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.156649 16613 raft_consensus.cc:3060] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.172806 16613 raft_consensus.cc:515] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.176033 16613 leader_election.cc:290] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 2 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:20.177328 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e882198a4cfd4f128914c6fc89866929" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:20.178114 16539 raft_consensus.cc:3055] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.178489 16539 raft_consensus.cc:740] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:20.179486 16539 consensus_queue.cc:260] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.180922 16539 raft_consensus.cc:3060] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.186923 16699 consensus_queue.cc:1048] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:20.190232 16539 raft_consensus.cc:2468] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 2.
I20260709 13:17:20.191685 16577 leader_election.cc:304] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:20.192852 16676 raft_consensus.cc:2804] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.193466 16676 raft_consensus.cc:697] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 LEADER]: Becoming Leader. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:20.194417 16676 consensus_queue.cc:237] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.201295 16733 raft_consensus.cc:993] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662: : Instructing follower 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:20.201871 16733 raft_consensus.cc:1081] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Signalling peer 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:20.204334 16461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:36904
I20260709 13:17:20.205226 16461 raft_consensus.cc:493] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.205722 16461 raft_consensus.cc:3060] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.214944 16461 raft_consensus.cc:515] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:20.217643 16461 leader_election.cc:290] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 2 election: Requested vote from peers 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:20.237610 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:20.238478 16539 raft_consensus.cc:3055] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.238312 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e882198a4cfd4f128914c6fc89866929" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:20.239127 16464 raft_consensus.cc:3060] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.241335 16692 raft_consensus.cc:993] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a: : Instructing follower 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:20.242436 16726 raft_consensus.cc:1081] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 LEADER]: Signalling peer 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:20.245829 16537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de12aec11f9643fdb0229237761a9293"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:44274
I20260709 13:17:20.246591 16537 raft_consensus.cc:493] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.247058 16537 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.250945 16676 raft_consensus.cc:993] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651: : Instructing follower 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:20.254266 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:20.255090 16611 raft_consensus.cc:3060] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.255535 16678 raft_consensus.cc:1081] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Signalling peer 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:20.257066 16539 raft_consensus.cc:740] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:20.260346 16461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:36888
I20260709 13:17:20.261178 16461 raft_consensus.cc:493] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.261730 16461 raft_consensus.cc:3060] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.262269 16464 raft_consensus.cc:2468] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 2.
I20260709 13:17:20.263881 16539 consensus_queue.cc:260] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:20.272066 16718 raft_consensus.cc:993] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651: : Instructing follower 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:20.272921 16718 raft_consensus.cc:1081] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Signalling peer 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:20.280380 16611 raft_consensus.cc:2468] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 2.
I20260709 13:17:20.294160 16461 raft_consensus.cc:515] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.304113 16461 leader_election.cc:290] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 2 election: Requested vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:20.320614 16430 leader_election.cc:304] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 
I20260709 13:17:20.321641 16747 raft_consensus.cc:2804] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.322218 16747 raft_consensus.cc:697] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Becoming Leader. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:20.323161 16747 consensus_queue.cc:237] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:20.338183 16360 catalog_manager.cc:5697] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a reported cstate change: term changed from 1 to 2, leader changed from 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66) to 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65). New cstate: current_term: 2 leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.348579 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:20.349236 16538 raft_consensus.cc:3060] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.358827 16538 raft_consensus.cc:2468] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 2.
I20260709 13:17:20.360236 16428 leader_election.cc:304] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:20.361145 16747 raft_consensus.cc:2804] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.361665 16747 raft_consensus.cc:697] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Becoming Leader. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:20.362591 16747 consensus_queue.cc:237] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.370267 16539 raft_consensus.cc:3060] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.377763 16539 raft_consensus.cc:2468] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 2.
I20260709 13:17:20.385035 16461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:36888
I20260709 13:17:20.385705 16461 raft_consensus.cc:493] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.386162 16461 raft_consensus.cc:3060] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.394341 16461 raft_consensus.cc:515] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.397600 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:20.398244 16539 raft_consensus.cc:3060] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.404014 16537 raft_consensus.cc:515] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.404321 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:20.404961 16611 raft_consensus.cc:3055] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.405263 16611 raft_consensus.cc:740] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:20.406008 16611 consensus_queue.cc:260] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.406466 16539 raft_consensus.cc:2468] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 2.
I20260709 13:17:20.407258 16611 raft_consensus.cc:3060] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.407925 16428 leader_election.cc:304] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:20.408826 16726 raft_consensus.cc:2804] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.409325 16726 raft_consensus.cc:697] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Becoming Leader. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:20.413338 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:20.413913 16464 raft_consensus.cc:3055] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.413965 16537 leader_election.cc:290] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 2 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:20.414326 16464 raft_consensus.cc:740] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:20.410187 16726 consensus_queue.cc:237] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.415096 16464 consensus_queue.cc:260] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.416319 16464 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.417490 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:20.417881 16676 raft_consensus.cc:993] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651: : Instructing follower 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:20.418068 16613 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.418283 16676 raft_consensus.cc:1081] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Signalling peer 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:20.424719 16613 raft_consensus.cc:2468] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 2.
I20260709 13:17:20.426056 16505 leader_election.cc:304] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:20.426855 16699 raft_consensus.cc:2804] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.427026 16464 raft_consensus.cc:2468] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 2.
I20260709 13:17:20.427390 16699 raft_consensus.cc:697] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Becoming Leader. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:20.428195 16699 consensus_queue.cc:237] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.430132 16539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:44260
I20260709 13:17:20.430677 16539 raft_consensus.cc:493] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.431032 16539 raft_consensus.cc:3060] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.433058 16718 raft_consensus.cc:993] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651: : Instructing follower 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:20.437542 16539 raft_consensus.cc:515] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.438544 16611 raft_consensus.cc:2468] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 2.
I20260709 13:17:20.440934 16718 raft_consensus.cc:1081] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Signalling peer 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:20.439837 16360 catalog_manager.cc:5697] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a reported cstate change: term changed from 1 to 2, leader changed from 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66) to 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65). New cstate: current_term: 2 leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.443084 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:20.447094 16611 raft_consensus.cc:3055] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.447484 16611 raft_consensus.cc:740] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:20.448377 16611 consensus_queue.cc:260] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.447585 16360 catalog_manager.cc:5697] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a reported cstate change: term changed from 1 to 2, leader changed from 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67) to 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65). New cstate: current_term: 2 leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.449543 16611 raft_consensus.cc:3060] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.452872 16538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1627b5961294639bb5a94ce35b60745"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:44260
I20260709 13:17:20.453420 16538 raft_consensus.cc:493] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.453780 16538 raft_consensus.cc:3060] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.453088 16358 catalog_manager.cc:5697] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 reported cstate change: term changed from 1 to 2, leader changed from 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65) to 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "548f92e80d9b43b08ae2ad252d925662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.443373 16539 leader_election.cc:290] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 2 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:20.443621 16461 leader_election.cc:290] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 2 election: Requested vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:20.445168 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:20.458117 16611 raft_consensus.cc:2468] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 2.
I20260709 13:17:20.458233 16464 raft_consensus.cc:3060] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.445413 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:20.465816 16612 raft_consensus.cc:3055] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.466418 16612 raft_consensus.cc:740] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:20.467208 16612 consensus_queue.cc:260] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.468714 16612 raft_consensus.cc:3060] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.461953 16538 raft_consensus.cc:515] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.473304 16464 raft_consensus.cc:2468] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 2.
I20260709 13:17:20.476339 16612 raft_consensus.cc:2468] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 2.
I20260709 13:17:20.477202 16505 leader_election.cc:304] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:20.477891 16699 raft_consensus.cc:2804] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.478576 16699 raft_consensus.cc:697] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Becoming Leader. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:20.479463 16699 consensus_queue.cc:237] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.480798 16359 catalog_manager.cc:5697] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 reported cstate change: term changed from 1 to 2, leader changed from 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66) to 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.479490 16538 leader_election.cc:290] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 2 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:20.483449 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1627b5961294639bb5a94ce35b60745" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:20.484012 16612 raft_consensus.cc:3055] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.484330 16612 raft_consensus.cc:740] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:20.485128 16612 consensus_queue.cc:260] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.486308 16612 raft_consensus.cc:3060] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.481518 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1627b5961294639bb5a94ce35b60745" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:20.490437 16464 raft_consensus.cc:3060] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.492777 16613 raft_consensus.cc:1275] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.494282 16726 consensus_queue.cc:1048] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.497537 16464 raft_consensus.cc:2468] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 2.
I20260709 13:17:20.498745 16505 leader_election.cc:304] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:20.499759 16699 raft_consensus.cc:2804] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.499344 16358 catalog_manager.cc:5697] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 reported cstate change: term changed from 1 to 2, leader changed from 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67) to 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "548f92e80d9b43b08ae2ad252d925662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.500301 16699 raft_consensus.cc:697] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Becoming Leader. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:20.501173 16699 consensus_queue.cc:237] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.502775 16360 catalog_manager.cc:5697] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a reported cstate change: term changed from 1 to 2, leader changed from 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67) to 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65). New cstate: current_term: 2 leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.508266 16538 raft_consensus.cc:1275] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.509894 16692 consensus_queue.cc:1048] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.518308 16612 raft_consensus.cc:2468] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 2.
I20260709 13:17:20.519279 16726 raft_consensus.cc:993] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a: : Instructing follower 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:20.519876 16726 raft_consensus.cc:1081] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 LEADER]: Signalling peer 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:20.522645 16539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d3eb093022a42eca8fff5acf1cb4de7"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:44274
I20260709 13:17:20.523212 16539 raft_consensus.cc:493] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.523602 16539 raft_consensus.cc:3060] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.533247 16539 raft_consensus.cc:515] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.535983 16360 catalog_manager.cc:5697] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 reported cstate change: term changed from 1 to 2, leader changed from 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67) to 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "548f92e80d9b43b08ae2ad252d925662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.537094 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3eb093022a42eca8fff5acf1cb4de7" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:20.537575 16612 raft_consensus.cc:3060] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.538223 16539 leader_election.cc:290] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 2 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:20.542414 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3eb093022a42eca8fff5acf1cb4de7" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:20.543044 16464 raft_consensus.cc:3055] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.543226 16612 raft_consensus.cc:2468] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 2.
I20260709 13:17:20.543403 16464 raft_consensus.cc:740] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:20.544250 16505 leader_election.cc:304] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:20.544423 16464 consensus_queue.cc:260] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.545115 16699 raft_consensus.cc:2804] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.545568 16699 raft_consensus.cc:697] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Becoming Leader. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:20.545822 16464 raft_consensus.cc:3060] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.546591 16699 consensus_queue.cc:237] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:20.553053 16464 raft_consensus.cc:2468] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 2.
I20260709 13:17:20.560164 16359 catalog_manager.cc:5697] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 reported cstate change: term changed from 1 to 2, leader changed from 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65) to 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "548f92e80d9b43b08ae2ad252d925662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.673205 16464 raft_consensus.cc:1275] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Refusing update from remote peer 2fab174cdeb6404e87b5a5f33f3fd651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.674543 16718 consensus_queue.cc:1048] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.682814 16539 raft_consensus.cc:1275] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Refusing update from remote peer 2fab174cdeb6404e87b5a5f33f3fd651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.684986 16718 consensus_queue.cc:1048] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.755616 16539 raft_consensus.cc:1275] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.757085 16726 consensus_queue.cc:1048] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.766319 16612 raft_consensus.cc:1275] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.768787 16692 consensus_queue.cc:1048] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.801646 16612 raft_consensus.cc:1275] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.803329 16726 consensus_queue.cc:1048] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:20.812588 16539 raft_consensus.cc:1275] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.817708 16726 consensus_queue.cc:1048] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.866609 16464 raft_consensus.cc:1275] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.867692 16699 consensus_queue.cc:1048] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.871284 16612 raft_consensus.cc:1275] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.872829 16747 consensus_queue.cc:1048] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.875241 16612 raft_consensus.cc:1275] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.876762 16733 consensus_queue.cc:1048] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.884558 16539 raft_consensus.cc:1275] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.888336 16692 consensus_queue.cc:1048] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.949874 16464 raft_consensus.cc:1275] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.951198 16733 consensus_queue.cc:1048] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.963380 16612 raft_consensus.cc:1275] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.965423 16612 raft_consensus.cc:1275] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.965263 16756 consensus_queue.cc:1048] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.966645 16761 consensus_queue.cc:1048] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.978422 16464 raft_consensus.cc:1275] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.979893 16762 consensus_queue.cc:1048] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:21.018285 16613 raft_consensus.cc:1275] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:21.018491 16464 raft_consensus.cc:1275] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:21.019471 16762 consensus_queue.cc:1048] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:21.020089 16761 consensus_queue.cc:1048] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:21.290552 16485 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7060 after lost signal to thread 16332
W20260709 13:17:21.291363 16485 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7740 after lost signal to thread 16395
W20260709 13:17:21.292135 16485 debug-util.cc:398] Leaking SignalData structure 0x7b08001eaee0 after lost signal to thread 16488
W20260709 13:17:21.292799 16485 debug-util.cc:398] Leaking SignalData structure 0x7b08000ef760 after lost signal to thread 16563
W20260709 13:17:21.293576 16485 debug-util.cc:398] Leaking SignalData structure 0x7b08001a5200 after lost signal to thread 16637
I20260709 13:17:23.220533 16329 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:17:23.221903 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:23.244143 16464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
mode: GRACEFUL
new_leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
 from {username='slave'} at 127.0.0.1:58216
I20260709 13:17:23.244786 16464 raft_consensus.cc:606] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Received request to transfer leadership to TS 2fab174cdeb6404e87b5a5f33f3fd651
I20260709 13:17:23.255255 16539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de12aec11f9643fdb0229237761a9293"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
mode: GRACEFUL
new_leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
 from {username='slave'} at 127.0.0.1:34228
I20260709 13:17:23.255710 16539 raft_consensus.cc:606] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Received request to transfer leadership to TS 2fab174cdeb6404e87b5a5f33f3fd651
I20260709 13:17:23.256819 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:23.257253 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:23.498852 16768 raft_consensus.cc:993] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a: : Instructing follower 2fab174cdeb6404e87b5a5f33f3fd651 to start an election
I20260709 13:17:23.499352 16747 raft_consensus.cc:1081] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Signalling peer 2fab174cdeb6404e87b5a5f33f3fd651 to start an election
I20260709 13:17:23.500819 16612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a"
dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
 from {username='slave'} at 127.0.0.1:55086
I20260709 13:17:23.501257 16612 raft_consensus.cc:493] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:23.501554 16612 raft_consensus.cc:3060] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.505972 16612 raft_consensus.cc:515] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:23.507543 16612 leader_election.cc:290] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 3 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:23.508569 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:23.508704 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:23.509095 16539 raft_consensus.cc:3060] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.509336 16464 raft_consensus.cc:3055] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:23.509703 16464 raft_consensus.cc:740] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:23.510646 16464 consensus_queue.cc:260] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:23.512001 16464 raft_consensus.cc:3060] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.513437 16539 raft_consensus.cc:2468] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 3.
I20260709 13:17:23.514380 16577 leader_election.cc:304] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:23.515074 16678 raft_consensus.cc:2804] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:23.516269 16678 raft_consensus.cc:697] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 LEADER]: Becoming Leader. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:23.517038 16678 consensus_queue.cc:237] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:23.519646 16464 raft_consensus.cc:2468] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 3.
I20260709 13:17:23.524463 16360 catalog_manager.cc:5697] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 reported cstate change: term changed from 2 to 3, leader changed from 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65) to 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67). New cstate: current_term: 3 leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.572608 16778 raft_consensus.cc:993] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662: : Instructing follower 2fab174cdeb6404e87b5a5f33f3fd651 to start an election
I20260709 13:17:23.573055 16761 raft_consensus.cc:1081] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Signalling peer 2fab174cdeb6404e87b5a5f33f3fd651 to start an election
I20260709 13:17:23.574550 16612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de12aec11f9643fdb0229237761a9293"
dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
 from {username='slave'} at 127.0.0.1:55102
I20260709 13:17:23.575006 16612 raft_consensus.cc:493] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:23.575306 16612 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.579999 16612 raft_consensus.cc:515] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:23.581636 16612 leader_election.cc:290] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 3 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:23.582758 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:23.582677 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:23.583441 16539 raft_consensus.cc:3055] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:23.583478 16464 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.583863 16539 raft_consensus.cc:740] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:23.584604 16539 consensus_queue.cc:260] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:23.585387 16539 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.589026 16539 raft_consensus.cc:2468] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 3.
I20260709 13:17:23.589893 16577 leader_election.cc:304] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:23.590611 16678 raft_consensus.cc:2804] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:23.591033 16678 raft_consensus.cc:697] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 LEADER]: Becoming Leader. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:23.590982 16464 raft_consensus.cc:2468] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 3.
I20260709 13:17:23.591935 16678 consensus_queue.cc:237] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:23.600100 16360 catalog_manager.cc:5697] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 reported cstate change: term changed from 2 to 3, leader changed from 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66) to 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67). New cstate: current_term: 3 leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.957749 16539 raft_consensus.cc:1275] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Refusing update from remote peer 2fab174cdeb6404e87b5a5f33f3fd651: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:23.959092 16678 consensus_queue.cc:1048] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:23.968963 16464 raft_consensus.cc:1275] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Refusing update from remote peer 2fab174cdeb6404e87b5a5f33f3fd651: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:23.970283 16678 consensus_queue.cc:1048] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.011236 16464 raft_consensus.cc:1275] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Refusing update from remote peer 2fab174cdeb6404e87b5a5f33f3fd651: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:24.012490 16678 consensus_queue.cc:1048] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.023058 16539 raft_consensus.cc:1275] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Refusing update from remote peer 2fab174cdeb6404e87b5a5f33f3fd651: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:24.024267 16678 consensus_queue.cc:1048] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.258010 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:24.267437 16464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
mode: GRACEFUL
new_leader_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:36908
I20260709 13:17:24.268092 16464 raft_consensus.cc:606] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Received request to transfer leadership to TS 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:24.272729 16612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a"
dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
mode: GRACEFUL
new_leader_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:55118
I20260709 13:17:24.273187 16612 raft_consensus.cc:606] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 LEADER]: Received request to transfer leadership to TS 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:24.277431 16464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc158be5105e468ab3b679463324eef7"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
mode: GRACEFUL
new_leader_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:36908
I20260709 13:17:24.277926 16464 raft_consensus.cc:606] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Received request to transfer leadership to TS 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:24.282176 16464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
mode: GRACEFUL
new_leader_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:36908
I20260709 13:17:24.282568 16464 raft_consensus.cc:606] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Received request to transfer leadership to TS 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:24.288606 16612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de12aec11f9643fdb0229237761a9293"
dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
mode: GRACEFUL
new_leader_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:55118
I20260709 13:17:24.289044 16612 raft_consensus.cc:606] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 LEADER]: Received request to transfer leadership to TS 548f92e80d9b43b08ae2ad252d925662
I20260709 13:17:24.344923 16747 raft_consensus.cc:993] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a: : Instructing follower 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:24.345332 16788 raft_consensus.cc:1081] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Signalling peer 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:24.346614 16539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:44274
I20260709 13:17:24.347033 16539 raft_consensus.cc:493] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:24.347308 16539 raft_consensus.cc:3060] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.351058 16539 raft_consensus.cc:515] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:24.352263 16539 leader_election.cc:290] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 3 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:24.352977 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:24.353224 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d9cbdb430e40c6a1b24bb8872bcb23" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:24.353529 16464 raft_consensus.cc:3055] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:24.353771 16612 raft_consensus.cc:3060] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.353825 16464 raft_consensus.cc:740] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:24.354638 16464 consensus_queue.cc:260] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:24.355400 16464 raft_consensus.cc:3060] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.358316 16612 raft_consensus.cc:2468] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 3.
I20260709 13:17:24.359259 16505 leader_election.cc:304] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:24.359511 16464 raft_consensus.cc:2468] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 3.
I20260709 13:17:24.359879 16761 raft_consensus.cc:2804] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:24.360745 16761 raft_consensus.cc:697] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 3 LEADER]: Becoming Leader. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:24.361534 16761 consensus_queue.cc:237] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:24.367343 16359 catalog_manager.cc:5697] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 reported cstate change: term changed from 2 to 3, leader changed from 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65) to 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66). New cstate: current_term: 3 leader_uuid: "548f92e80d9b43b08ae2ad252d925662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.404080 16747 raft_consensus.cc:993] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a: : Instructing follower 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:24.404501 16788 raft_consensus.cc:1081] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Signalling peer 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:24.405833 16539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc158be5105e468ab3b679463324eef7"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:44274
I20260709 13:17:24.406296 16539 raft_consensus.cc:493] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:24.406577 16539 raft_consensus.cc:3060] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.412927 16539 raft_consensus.cc:515] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:24.414426 16539 leader_election.cc:290] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 3 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:24.415066 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc158be5105e468ab3b679463324eef7" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:24.415422 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc158be5105e468ab3b679463324eef7" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:24.415632 16464 raft_consensus.cc:3055] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:24.415936 16464 raft_consensus.cc:740] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:24.415964 16612 raft_consensus.cc:3060] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.416708 16464 consensus_queue.cc:260] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:24.417788 16464 raft_consensus.cc:3060] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.422531 16612 raft_consensus.cc:2468] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 3.
I20260709 13:17:24.423524 16505 leader_election.cc:304] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:24.423702 16464 raft_consensus.cc:2468] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 3.
I20260709 13:17:24.424263 16761 raft_consensus.cc:2804] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:24.424695 16761 raft_consensus.cc:697] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 3 LEADER]: Becoming Leader. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:24.425343 16761 consensus_queue.cc:237] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:24.431149 16359 catalog_manager.cc:5697] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 reported cstate change: term changed from 2 to 3, leader changed from 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65) to 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66). New cstate: current_term: 3 leader_uuid: "548f92e80d9b43b08ae2ad252d925662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.453059 16747 raft_consensus.cc:993] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a: : Instructing follower 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:24.453462 16788 raft_consensus.cc:1081] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Signalling peer 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:24.454751 16539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:44274
I20260709 13:17:24.455255 16539 raft_consensus.cc:493] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:24.455506 16539 raft_consensus.cc:3060] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.459712 16539 raft_consensus.cc:515] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:24.461259 16539 leader_election.cc:290] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 3 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:24.461958 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:24.462075 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:24.462538 16464 raft_consensus.cc:3055] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:24.462566 16612 raft_consensus.cc:3060] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.462962 16464 raft_consensus.cc:740] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:24.463615 16464 consensus_queue.cc:260] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:24.464376 16464 raft_consensus.cc:3060] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.467149 16612 raft_consensus.cc:2468] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 3.
I20260709 13:17:24.468123 16505 leader_election.cc:304] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:24.468256 16464 raft_consensus.cc:2468] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 3.
I20260709 13:17:24.468719 16761 raft_consensus.cc:2804] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:24.469177 16761 raft_consensus.cc:697] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 3 LEADER]: Becoming Leader. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:24.469861 16761 consensus_queue.cc:237] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:24.475666 16359 catalog_manager.cc:5697] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 reported cstate change: term changed from 2 to 3, leader changed from 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65) to 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66). New cstate: current_term: 3 leader_uuid: "548f92e80d9b43b08ae2ad252d925662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.500533 16786 raft_consensus.cc:993] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651: : Instructing follower 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:24.500998 16678 raft_consensus.cc:1081] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 LEADER]: Signalling peer 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:24.502552 16539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de12aec11f9643fdb0229237761a9293"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:44260
I20260709 13:17:24.503047 16539 raft_consensus.cc:493] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:24.503405 16539 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:24.508287 16786 raft_consensus.cc:993] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651: : Instructing follower 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:24.508777 16678 raft_consensus.cc:1081] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 LEADER]: Signalling peer 548f92e80d9b43b08ae2ad252d925662 to start an election
I20260709 13:17:24.510330 16538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
 from {username='slave'} at 127.0.0.1:44260
I20260709 13:17:24.510862 16538 raft_consensus.cc:493] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:24.511241 16538 raft_consensus.cc:3060] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:24.510972 16539 raft_consensus.cc:515] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:24.512825 16539 leader_election.cc:290] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 4 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:24.513433 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:24.513676 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:24.514004 16464 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:24.514350 16612 raft_consensus.cc:3055] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:24.514662 16612 raft_consensus.cc:740] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:24.515488 16612 consensus_queue.cc:260] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:24.516499 16612 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:24.516410 16538 raft_consensus.cc:515] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:24.517786 16538 leader_election.cc:290] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 4 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:24.519819 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:24.520064 16464 raft_consensus.cc:2468] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 4.
I20260709 13:17:24.520498 16613 raft_consensus.cc:3055] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:24.520825 16613 raft_consensus.cc:740] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:24.521117 16505 leader_election.cc:304] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:24.521807 16761 raft_consensus.cc:2804] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:24.519553 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ad041f8d6442a8094dfd69529095a" candidate_uuid: "548f92e80d9b43b08ae2ad252d925662" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:24.521605 16613 consensus_queue.cc:260] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:24.522464 16461 raft_consensus.cc:3060] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:24.522475 16761 raft_consensus.cc:697] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 4 LEADER]: Becoming Leader. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:24.522842 16613 raft_consensus.cc:3060] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:24.523608 16761 consensus_queue.cc:237] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:24.526922 16612 raft_consensus.cc:2468] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 4.
I20260709 13:17:24.528964 16461 raft_consensus.cc:2468] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 4.
I20260709 13:17:24.530119 16505 leader_election.cc:304] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:24.530692 16761 raft_consensus.cc:2804] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:24.531102 16761 raft_consensus.cc:697] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 4 LEADER]: Becoming Leader. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:24.531746 16761 consensus_queue.cc:237] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:24.531991 16359 catalog_manager.cc:5697] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 reported cstate change: term changed from 3 to 4, leader changed from 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67) to 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66). New cstate: current_term: 4 leader_uuid: "548f92e80d9b43b08ae2ad252d925662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.532727 16613 raft_consensus.cc:2468] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548f92e80d9b43b08ae2ad252d925662 in term 4.
I20260709 13:17:24.542665 16359 catalog_manager.cc:5697] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 reported cstate change: term changed from 3 to 4, leader changed from 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67) to 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66). New cstate: current_term: 4 leader_uuid: "548f92e80d9b43b08ae2ad252d925662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.838907 16461 raft_consensus.cc:1275] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:24.840075 16789 consensus_queue.cc:1048] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.849781 16613 raft_consensus.cc:1275] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:24.851035 16799 consensus_queue.cc:1048] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.886874 16464 raft_consensus.cc:1275] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:24.888131 16461 raft_consensus.cc:1275] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:24.888147 16799 consensus_queue.cc:1048] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.889323 16761 consensus_queue.cc:1048] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.901834 16612 raft_consensus.cc:1275] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:24.903712 16799 consensus_queue.cc:1048] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.904222 16613 raft_consensus.cc:1275] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:24.907044 16804 consensus_queue.cc:1048] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.941725 16464 raft_consensus.cc:1275] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:24.942792 16804 consensus_queue.cc:1048] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.949515 16613 raft_consensus.cc:1275] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:24.950924 16804 consensus_queue.cc:1048] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.954097 16464 raft_consensus.cc:1275] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:24.955408 16804 consensus_queue.cc:1048] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:24.960850 16613 raft_consensus.cc:1275] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Refusing update from remote peer 548f92e80d9b43b08ae2ad252d925662: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:24.962193 16804 consensus_queue.cc:1048] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:27.297220 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:27.303911 16538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
mode: GRACEFUL
new_leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:34228
I20260709 13:17:27.304560 16538 raft_consensus.cc:606] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Received request to transfer leadership to TS 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:27.306910 16538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d3eb093022a42eca8fff5acf1cb4de7"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
mode: GRACEFUL
new_leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
 from {username='slave'} at 127.0.0.1:34228
I20260709 13:17:27.307335 16538 raft_consensus.cc:606] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Received request to transfer leadership to TS 2fab174cdeb6404e87b5a5f33f3fd651
I20260709 13:17:27.309238 16538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
mode: GRACEFUL
new_leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:34228
I20260709 13:17:27.309633 16538 raft_consensus.cc:606] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 3 LEADER]: Received request to transfer leadership to TS 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:27.311625 16538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de12aec11f9643fdb0229237761a9293"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
mode: GRACEFUL
new_leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:34228
I20260709 13:17:27.312011 16538 raft_consensus.cc:606] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 4 LEADER]: Received request to transfer leadership to TS 4cd17f3e18b4479e8277f3e33db3552a
I20260709 13:17:27.313941 16538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc158be5105e468ab3b679463324eef7"
dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
mode: GRACEFUL
new_leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
 from {username='slave'} at 127.0.0.1:34228
I20260709 13:17:27.314309 16538 raft_consensus.cc:606] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 3 LEADER]: Received request to transfer leadership to TS 2fab174cdeb6404e87b5a5f33f3fd651
I20260709 13:17:27.315145 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:27.315485 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:27.377991 16761 raft_consensus.cc:993] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662: : Instructing follower 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:27.378544 16804 raft_consensus.cc:1081] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Signalling peer 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:27.379992 16464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:36904
I20260709 13:17:27.380622 16464 raft_consensus.cc:493] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.381094 16464 raft_consensus.cc:3060] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.386539 16464 raft_consensus.cc:515] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:27.388209 16464 leader_election.cc:290] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 3 election: Requested vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:27.389014 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:27.389540 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4f3f4ec6b54e01b9abc58ba1192782" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:27.389696 16538 raft_consensus.cc:3055] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:27.390007 16613 raft_consensus.cc:3060] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.390070 16538 raft_consensus.cc:740] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:27.390954 16538 consensus_queue.cc:260] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:27.391896 16538 raft_consensus.cc:3060] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.394418 16613 raft_consensus.cc:2468] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 3.
I20260709 13:17:27.395548 16430 leader_election.cc:304] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 
I20260709 13:17:27.396576 16538 raft_consensus.cc:2468] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 3.
I20260709 13:17:27.397213 16808 raft_consensus.cc:2804] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.398092 16808 raft_consensus.cc:697] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 LEADER]: Becoming Leader. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:27.398805 16808 consensus_queue.cc:237] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:27.405546 16359 catalog_manager.cc:5697] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a reported cstate change: term changed from 2 to 3, leader changed from 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66) to 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65). New cstate: current_term: 3 leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.503978 16761 raft_consensus.cc:993] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662: : Instructing follower 2fab174cdeb6404e87b5a5f33f3fd651 to start an election
I20260709 13:17:27.504424 16804 raft_consensus.cc:1081] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Signalling peer 2fab174cdeb6404e87b5a5f33f3fd651 to start an election
I20260709 13:17:27.505882 16613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d3eb093022a42eca8fff5acf1cb4de7"
dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
 from {username='slave'} at 127.0.0.1:55102
I20260709 13:17:27.506378 16613 raft_consensus.cc:493] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.506691 16613 raft_consensus.cc:3060] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.510730 16613 raft_consensus.cc:515] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:27.512326 16613 leader_election.cc:290] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 3 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:27.512993 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3eb093022a42eca8fff5acf1cb4de7" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:27.513208 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3eb093022a42eca8fff5acf1cb4de7" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:27.513549 16464 raft_consensus.cc:3060] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.513753 16538 raft_consensus.cc:3055] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:27.514081 16538 raft_consensus.cc:740] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:27.514838 16538 consensus_queue.cc:260] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:27.515964 16538 raft_consensus.cc:3060] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.519546 16464 raft_consensus.cc:2468] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 3.
I20260709 13:17:27.520746 16579 leader_election.cc:304] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 
I20260709 13:17:27.521518 16678 raft_consensus.cc:2804] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.521956 16538 raft_consensus.cc:2468] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 3.
I20260709 13:17:27.522728 16678 raft_consensus.cc:697] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 LEADER]: Becoming Leader. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:27.523620 16678 consensus_queue.cc:237] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:27.530367 16359 catalog_manager.cc:5697] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 reported cstate change: term changed from 2 to 3, leader changed from 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66) to 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67). New cstate: current_term: 3 leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.612357 16761 raft_consensus.cc:993] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662: : Instructing follower 2fab174cdeb6404e87b5a5f33f3fd651 to start an election
I20260709 13:17:27.612766 16804 raft_consensus.cc:1081] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 3 LEADER]: Signalling peer 2fab174cdeb6404e87b5a5f33f3fd651 to start an election
I20260709 13:17:27.614166 16613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc158be5105e468ab3b679463324eef7"
dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
 from {username='slave'} at 127.0.0.1:55102
I20260709 13:17:27.614600 16613 raft_consensus.cc:493] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.614861 16613 raft_consensus.cc:3060] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.619021 16613 raft_consensus.cc:515] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:27.620012 16761 raft_consensus.cc:993] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662: : Instructing follower 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:27.620410 16761 raft_consensus.cc:1081] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 4 LEADER]: Signalling peer 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:27.620956 16613 leader_election.cc:290] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 4 election: Requested vote from peers 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:27.621318 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc158be5105e468ab3b679463324eef7" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
I20260709 13:17:27.621487 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc158be5105e468ab3b679463324eef7" candidate_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:27.621997 16464 raft_consensus.cc:3060] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.622241 16461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de12aec11f9643fdb0229237761a9293"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:36904
I20260709 13:17:27.622692 16538 raft_consensus.cc:3055] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:27.622850 16461 raft_consensus.cc:493] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.623054 16538 raft_consensus.cc:740] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:27.623275 16461 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:27.624007 16538 consensus_queue.cc:260] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:27.625233 16538 raft_consensus.cc:3060] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.627962 16461 raft_consensus.cc:515] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:27.628408 16464 raft_consensus.cc:2468] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 4.
I20260709 13:17:27.629426 16579 leader_election.cc:304] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 
I20260709 13:17:27.629714 16461 leader_election.cc:290] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 5 election: Requested vote from peers 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325), 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955)
I20260709 13:17:27.630692 16678 raft_consensus.cc:2804] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:27.630645 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:27.631258 16678 raft_consensus.cc:697] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 LEADER]: Becoming Leader. State: Replica: 2fab174cdeb6404e87b5a5f33f3fd651, State: Running, Role: LEADER
I20260709 13:17:27.631268 16539 raft_consensus.cc:3055] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:27.631304 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de12aec11f9643fdb0229237761a9293" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:27.631958 16539 raft_consensus.cc:740] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:27.632140 16613 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:27.632407 16678 consensus_queue.cc:237] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:27.632764 16539 consensus_queue.cc:260] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:27.633746 16539 raft_consensus.cc:3060] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:27.631529 16538 raft_consensus.cc:2468] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fab174cdeb6404e87b5a5f33f3fd651 in term 4.
I20260709 13:17:27.639088 16539 raft_consensus.cc:2468] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 5.
I20260709 13:17:27.639977 16428 leader_election.cc:304] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cd17f3e18b4479e8277f3e33db3552a, 548f92e80d9b43b08ae2ad252d925662; no voters: 
I20260709 13:17:27.640043 16359 catalog_manager.cc:5697] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 reported cstate change: term changed from 3 to 4, leader changed from 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66) to 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67). New cstate: current_term: 4 leader_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.640628 16808 raft_consensus.cc:2804] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:27.638129 16613 raft_consensus.cc:2468] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 5.
I20260709 13:17:27.641093 16808 raft_consensus.cc:697] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 5 LEADER]: Becoming Leader. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:27.641952 16808 consensus_queue.cc:237] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } }
I20260709 13:17:27.649726 16360 catalog_manager.cc:5697] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a reported cstate change: term changed from 4 to 5, leader changed from 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66) to 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65). New cstate: current_term: 5 leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.716653 16804 raft_consensus.cc:993] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662: : Instructing follower 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:27.717029 16761 raft_consensus.cc:1081] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 3 LEADER]: Signalling peer 4cd17f3e18b4479e8277f3e33db3552a to start an election
I20260709 13:17:27.718225 16464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee"
dest_uuid: "4cd17f3e18b4479e8277f3e33db3552a"
 from {username='slave'} at 127.0.0.1:36904
I20260709 13:17:27.718590 16464 raft_consensus.cc:493] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.718798 16464 raft_consensus.cc:3060] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.722585 16464 raft_consensus.cc:515] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:27.723969 16464 leader_election.cc:290] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 4 election: Requested vote from peers 2fab174cdeb6404e87b5a5f33f3fd651 (127.15.242.67:44955), 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325)
I20260709 13:17:27.724733 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2fab174cdeb6404e87b5a5f33f3fd651"
I20260709 13:17:27.724870 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7702f414f3314380bc1c88b9661fdfee" candidate_uuid: "4cd17f3e18b4479e8277f3e33db3552a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "548f92e80d9b43b08ae2ad252d925662"
I20260709 13:17:27.725160 16613 raft_consensus.cc:3060] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.725354 16539 raft_consensus.cc:3055] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:27.725661 16539 raft_consensus.cc:740] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 548f92e80d9b43b08ae2ad252d925662, State: Running, Role: LEADER
I20260709 13:17:27.726235 16539 consensus_queue.cc:260] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:27.726994 16539 raft_consensus.cc:3060] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.729269 16613 raft_consensus.cc:2468] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 4.
I20260709 13:17:27.730168 16430 leader_election.cc:304] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fab174cdeb6404e87b5a5f33f3fd651, 4cd17f3e18b4479e8277f3e33db3552a; no voters: 
I20260709 13:17:27.730922 16808 raft_consensus.cc:2804] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:27.731055 16539 raft_consensus.cc:2468] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cd17f3e18b4479e8277f3e33db3552a in term 4.
I20260709 13:17:27.731412 16808 raft_consensus.cc:697] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 4 LEADER]: Becoming Leader. State: Replica: 4cd17f3e18b4479e8277f3e33db3552a, State: Running, Role: LEADER
I20260709 13:17:27.732323 16808 consensus_queue.cc:237] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } }
I20260709 13:17:27.739140 16360 catalog_manager.cc:5697] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a reported cstate change: term changed from 3 to 4, leader changed from 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66) to 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65). New cstate: current_term: 4 leader_uuid: "4cd17f3e18b4479e8277f3e33db3552a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.948571 16613 raft_consensus.cc:1275] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:27.949784 16808 consensus_queue.cc:1048] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.960354 16539 raft_consensus.cc:1275] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:27.961534 16808 consensus_queue.cc:1048] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:28.030920 16539 raft_consensus.cc:1275] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Refusing update from remote peer 2fab174cdeb6404e87b5a5f33f3fd651: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:28.031944 16678 consensus_queue.cc:1048] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:28.041030 16464 raft_consensus.cc:1275] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Refusing update from remote peer 2fab174cdeb6404e87b5a5f33f3fd651: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:28.042960 16815 consensus_queue.cc:1048] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:28.046466 16539 raft_consensus.cc:1275] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 5 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:28.047796 16808 consensus_queue.cc:1048] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:28.057857 16613 raft_consensus.cc:1275] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 5 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:28.059386 16822 consensus_queue.cc:1048] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:28.146723 16539 raft_consensus.cc:1275] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Refusing update from remote peer 2fab174cdeb6404e87b5a5f33f3fd651: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:28.147816 16815 consensus_queue.cc:1048] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.157440 16464 raft_consensus.cc:1275] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Refusing update from remote peer 2fab174cdeb6404e87b5a5f33f3fd651: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:28.159042 16832 consensus_queue.cc:1048] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cd17f3e18b4479e8277f3e33db3552a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 37915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:28.231967 16539 raft_consensus.cc:1275] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:28.233067 16822 consensus_queue.cc:1048] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "548f92e80d9b43b08ae2ad252d925662" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.241343 16613 raft_consensus.cc:1275] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Refusing update from remote peer 4cd17f3e18b4479e8277f3e33db3552a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:28.242755 16822 consensus_queue.cc:1048] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fab174cdeb6404e87b5a5f33f3fd651" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 44955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.316208 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:28.321761 16329 tablet_server.cc:179] TabletServer@127.15.242.65:0 shutting down...
I20260709 13:17:28.344877 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:28.345563 16329 tablet_replica.cc:333] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a: stopping tablet replica
I20260709 13:17:28.346285 16329 raft_consensus.cc:2243] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.347113 16329 raft_consensus.cc:2272] T 7702f414f3314380bc1c88b9661fdfee P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.349526 16329 tablet_replica.cc:333] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a: stopping tablet replica
I20260709 13:17:28.350134 16329 raft_consensus.cc:2243] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.350564 16329 raft_consensus.cc:2272] T e882198a4cfd4f128914c6fc89866929 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.352124 16329 tablet_replica.cc:333] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a: stopping tablet replica
I20260709 13:17:28.352649 16329 raft_consensus.cc:2243] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.353061 16329 raft_consensus.cc:2272] T fc158be5105e468ab3b679463324eef7 P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.355034 16329 tablet_replica.cc:333] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a: stopping tablet replica
I20260709 13:17:28.355512 16329 raft_consensus.cc:2243] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.356029 16329 raft_consensus.cc:2272] T c1627b5961294639bb5a94ce35b60745 P 4cd17f3e18b4479e8277f3e33db3552a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.357761 16329 tablet_replica.cc:333] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a: stopping tablet replica
I20260709 13:17:28.358266 16329 raft_consensus.cc:2243] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.358659 16329 raft_consensus.cc:2272] T da2ad041f8d6442a8094dfd69529095a P 4cd17f3e18b4479e8277f3e33db3552a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.360118 16329 tablet_replica.cc:333] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a: stopping tablet replica
I20260709 13:17:28.360564 16329 raft_consensus.cc:2243] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.361233 16329 raft_consensus.cc:2272] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.363019 16329 tablet_replica.cc:333] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a: stopping tablet replica
I20260709 13:17:28.363488 16329 raft_consensus.cc:2243] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.364166 16329 raft_consensus.cc:2272] T de12aec11f9643fdb0229237761a9293 P 4cd17f3e18b4479e8277f3e33db3552a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.365859 16329 tablet_replica.cc:333] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a: stopping tablet replica
I20260709 13:17:28.366344 16329 raft_consensus.cc:2243] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.366731 16329 raft_consensus.cc:2272] T 2d3eb093022a42eca8fff5acf1cb4de7 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.368498 16329 tablet_replica.cc:333] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a: stopping tablet replica
I20260709 13:17:28.368937 16329 raft_consensus.cc:2243] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.369311 16329 raft_consensus.cc:2272] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 4cd17f3e18b4479e8277f3e33db3552a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.466751 16579 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.65:37915: connect: Connection refused (error 111)
W20260709 13:17:28.470687 16579 consensus_peers.cc:597] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 -> Peer 4cd17f3e18b4479e8277f3e33db3552a (127.15.242.65:37915): Couldn't send request to peer 4cd17f3e18b4479e8277f3e33db3552a. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:37915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.490415 16329 tablet_server.cc:196] TabletServer@127.15.242.65:0 shutdown complete.
I20260709 13:17:28.508239 16329 tablet_server.cc:179] TabletServer@127.15.242.66:0 shutting down...
I20260709 13:17:28.532167 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:28.532786 16329 tablet_replica.cc:333] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662: stopping tablet replica
I20260709 13:17:28.533315 16329 raft_consensus.cc:2243] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.533742 16329 raft_consensus.cc:2272] T de12aec11f9643fdb0229237761a9293 P 548f92e80d9b43b08ae2ad252d925662 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.535750 16329 tablet_replica.cc:333] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662: stopping tablet replica
I20260709 13:17:28.536249 16329 raft_consensus.cc:2243] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.536665 16329 raft_consensus.cc:2272] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.538810 16329 tablet_replica.cc:333] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662: stopping tablet replica
I20260709 13:17:28.539326 16329 raft_consensus.cc:2243] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.540077 16329 raft_consensus.cc:2272] T da2ad041f8d6442a8094dfd69529095a P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.541853 16329 tablet_replica.cc:333] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662: stopping tablet replica
I20260709 13:17:28.542364 16329 raft_consensus.cc:2243] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.543160 16329 raft_consensus.cc:2272] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.544848 16329 tablet_replica.cc:333] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662: stopping tablet replica
I20260709 13:17:28.545301 16329 raft_consensus.cc:2243] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.545676 16329 raft_consensus.cc:2272] T 2d3eb093022a42eca8fff5acf1cb4de7 P 548f92e80d9b43b08ae2ad252d925662 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.547758 16329 tablet_replica.cc:333] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662: stopping tablet replica
I20260709 13:17:28.548234 16329 raft_consensus.cc:2243] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.548977 16329 raft_consensus.cc:2272] T c1627b5961294639bb5a94ce35b60745 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.550647 16329 tablet_replica.cc:333] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662: stopping tablet replica
I20260709 13:17:28.551095 16329 raft_consensus.cc:2243] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.551472 16329 raft_consensus.cc:2272] T fc158be5105e468ab3b679463324eef7 P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.553484 16329 tablet_replica.cc:333] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662: stopping tablet replica
I20260709 13:17:28.553941 16329 raft_consensus.cc:2243] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.554363 16329 raft_consensus.cc:2272] T 7702f414f3314380bc1c88b9661fdfee P 548f92e80d9b43b08ae2ad252d925662 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.556353 16329 tablet_replica.cc:333] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662: stopping tablet replica
I20260709 13:17:28.556787 16329 raft_consensus.cc:2243] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.557225 16329 raft_consensus.cc:2272] T e882198a4cfd4f128914c6fc89866929 P 548f92e80d9b43b08ae2ad252d925662 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.583076 16329 tablet_server.cc:196] TabletServer@127.15.242.66:0 shutdown complete.
W20260709 13:17:28.592412 16577 consensus_peers.cc:597] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 -> Peer 548f92e80d9b43b08ae2ad252d925662 (127.15.242.66:36325): Couldn't send request to peer 548f92e80d9b43b08ae2ad252d925662. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:36325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.600283 16329 tablet_server.cc:179] TabletServer@127.15.242.67:0 shutting down...
I20260709 13:17:28.621886 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:28.622548 16329 tablet_replica.cc:333] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651: stopping tablet replica
I20260709 13:17:28.623109 16329 raft_consensus.cc:2243] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.623569 16329 raft_consensus.cc:2272] T 16d9cbdb430e40c6a1b24bb8872bcb23 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.625244 16329 tablet_replica.cc:333] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651: stopping tablet replica
I20260709 13:17:28.625756 16329 raft_consensus.cc:2243] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.626508 16329 raft_consensus.cc:2272] T 2d3eb093022a42eca8fff5acf1cb4de7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.628298 16329 tablet_replica.cc:333] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651: stopping tablet replica
I20260709 13:17:28.628789 16329 raft_consensus.cc:2243] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.629509 16329 raft_consensus.cc:2272] T e882198a4cfd4f128914c6fc89866929 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.631057 16329 tablet_replica.cc:333] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651: stopping tablet replica
I20260709 13:17:28.631529 16329 raft_consensus.cc:2243] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.631940 16329 raft_consensus.cc:2272] T 7702f414f3314380bc1c88b9661fdfee P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.633836 16329 tablet_replica.cc:333] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651: stopping tablet replica
I20260709 13:17:28.634346 16329 raft_consensus.cc:2243] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.635018 16329 raft_consensus.cc:2272] T fc158be5105e468ab3b679463324eef7 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.636786 16329 tablet_replica.cc:333] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651: stopping tablet replica
I20260709 13:17:28.637265 16329 raft_consensus.cc:2243] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.637669 16329 raft_consensus.cc:2272] T c1627b5961294639bb5a94ce35b60745 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.639213 16329 tablet_replica.cc:333] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651: stopping tablet replica
I20260709 13:17:28.639672 16329 raft_consensus.cc:2243] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.640072 16329 raft_consensus.cc:2272] T 1d4f3f4ec6b54e01b9abc58ba1192782 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.641767 16329 tablet_replica.cc:333] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651: stopping tablet replica
I20260709 13:17:28.642287 16329 raft_consensus.cc:2243] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.642691 16329 raft_consensus.cc:2272] T da2ad041f8d6442a8094dfd69529095a P 2fab174cdeb6404e87b5a5f33f3fd651 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.644294 16329 tablet_replica.cc:333] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651: stopping tablet replica
I20260709 13:17:28.644716 16329 raft_consensus.cc:2243] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.645113 16329 raft_consensus.cc:2272] T de12aec11f9643fdb0229237761a9293 P 2fab174cdeb6404e87b5a5f33f3fd651 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.670926 16329 tablet_server.cc:196] TabletServer@127.15.242.67:0 shutdown complete.
I20260709 13:17:28.686901 16329 master.cc:562] Master@127.15.242.126:45023 shutting down...
I20260709 13:17:28.890524 16329 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.891091 16329 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.891441 16329 tablet_replica.cc:333] T 00000000000000000000000000000000 P 934450e680764107809dad173ad2e238: stopping tablet replica
I20260709 13:17:28.910847 16329 master.cc:584] Master@127.15.242.126:45023 shutdown complete.
2fab174cdeb6404e87b5a5f33f3fd651  1
4cd17f3e18b4479e8277f3e33db3552a  4
548f92e80d9b43b08ae2ad252d925662  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13162 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:17:28.948520 16329 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.242.126:34059
I20260709 13:17:28.949661 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:28.955291 16838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:28.955636 16839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:28.956709 16329 server_base.cc:1061] running on GCE node
W20260709 13:17:28.956750 16841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:28.957849 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:28.958093 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:28.958251 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603048958234 us; error 0 us; skew 500 ppm
I20260709 13:17:28.958777 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:28.961119 16329 webserver.cc:533] Webserver started at http://127.15.242.126:42457/ using document root <none> and password file <none>
I20260709 13:17:28.961627 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:28.961840 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:28.962430 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:28.963541 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/master-0-root/instance:
uuid: "d92c2dfb79eb485c8b034baa3b86b114"
format_stamp: "Formatted at 2026-07-09 13:17:28 on dist-test-slave-fh5z"
I20260709 13:17:28.967840 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:17:28.971148 16846 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:28.972019 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:17:28.972266 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/master-0-root
uuid: "d92c2dfb79eb485c8b034baa3b86b114"
format_stamp: "Formatted at 2026-07-09 13:17:28 on dist-test-slave-fh5z"
I20260709 13:17:28.972538 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:28.991578 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:28.992720 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:29.044420 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.126:34059
I20260709 13:17:29.044509 16897 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.126:34059 every 8 connection(s)
I20260709 13:17:29.048640 16898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.058866 16898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114: Bootstrap starting.
I20260709 13:17:29.063931 16898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.068310 16898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114: No bootstrap required, opened a new log
I20260709 13:17:29.070603 16898 raft_consensus.cc:359] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d92c2dfb79eb485c8b034baa3b86b114" member_type: VOTER }
I20260709 13:17:29.071027 16898 raft_consensus.cc:385] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.071283 16898 raft_consensus.cc:740] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d92c2dfb79eb485c8b034baa3b86b114, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.071965 16898 consensus_queue.cc:260] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d92c2dfb79eb485c8b034baa3b86b114" member_type: VOTER }
I20260709 13:17:29.072459 16898 raft_consensus.cc:399] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:29.072710 16898 raft_consensus.cc:493] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:29.073004 16898 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.077520 16898 raft_consensus.cc:515] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d92c2dfb79eb485c8b034baa3b86b114" member_type: VOTER }
I20260709 13:17:29.078123 16898 leader_election.cc:304] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d92c2dfb79eb485c8b034baa3b86b114; no voters: 
I20260709 13:17:29.079324 16898 leader_election.cc:290] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:29.079639 16901 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:29.080953 16901 raft_consensus.cc:697] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [term 1 LEADER]: Becoming Leader. State: Replica: d92c2dfb79eb485c8b034baa3b86b114, State: Running, Role: LEADER
I20260709 13:17:29.081564 16901 consensus_queue.cc:237] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d92c2dfb79eb485c8b034baa3b86b114" member_type: VOTER }
I20260709 13:17:29.082472 16898 sys_catalog.cc:565] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:29.086131 16902 sys_catalog.cc:455] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d92c2dfb79eb485c8b034baa3b86b114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d92c2dfb79eb485c8b034baa3b86b114" member_type: VOTER } }
I20260709 13:17:29.086277 16903 sys_catalog.cc:455] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d92c2dfb79eb485c8b034baa3b86b114. Latest consensus state: current_term: 1 leader_uuid: "d92c2dfb79eb485c8b034baa3b86b114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d92c2dfb79eb485c8b034baa3b86b114" member_type: VOTER } }
I20260709 13:17:29.086994 16902 sys_catalog.cc:458] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:29.087044 16903 sys_catalog.cc:458] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:29.091511 16907 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:29.100734 16907 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:29.102821 16329 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:29.109975 16907 catalog_manager.cc:1383] Generated new cluster ID: 19edfb535c2f489081c10b28536ed71a
I20260709 13:17:29.110242 16907 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:29.124393 16907 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:29.125515 16907 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:29.135614 16907 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114: Generated new TSK 0
I20260709 13:17:29.136186 16907 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:29.169266 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:29.175102 16919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:29.176360 16920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:29.177771 16329 server_base.cc:1061] running on GCE node
W20260709 13:17:29.178273 16922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:29.179160 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:29.179443 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:29.179621 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603049179605 us; error 0 us; skew 500 ppm
I20260709 13:17:29.180155 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:29.182411 16329 webserver.cc:533] Webserver started at http://127.15.242.65:34505/ using document root <none> and password file <none>
I20260709 13:17:29.182897 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:29.183099 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:29.183368 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:29.184430 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-0-root/instance:
uuid: "292edd1aea2f4e048e5e49a200779e4a"
format_stamp: "Formatted at 2026-07-09 13:17:29 on dist-test-slave-fh5z"
I20260709 13:17:29.189169 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:17:29.192452 16927 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:29.193254 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:29.193549 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-0-root
uuid: "292edd1aea2f4e048e5e49a200779e4a"
format_stamp: "Formatted at 2026-07-09 13:17:29 on dist-test-slave-fh5z"
I20260709 13:17:29.193841 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:29.202471 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:29.203610 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:29.204970 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:29.207227 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:29.207450 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:29.207705 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:29.207898 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:29.261075 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.65:43881
I20260709 13:17:29.261250 16989 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.65:43881 every 8 connection(s)
I20260709 13:17:29.267132 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:29.274941 16994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:29.276328 16995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:29.282466 16329 server_base.cc:1061] running on GCE node
I20260709 13:17:29.283313 16990 heartbeater.cc:344] Connected to a master server at 127.15.242.126:34059
I20260709 13:17:29.283766 16990 heartbeater.cc:461] Registering TS with master...
W20260709 13:17:29.283828 16997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:29.285012 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:29.285000 16990 heartbeater.cc:507] Master 127.15.242.126:34059 requested a full tablet report, sending...
W20260709 13:17:29.285481 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:29.285744 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603049285724 us; error 0 us; skew 500 ppm
I20260709 13:17:29.286530 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:29.287979 16863 ts_manager.cc:194] Registered new tserver with Master: 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881)
I20260709 13:17:29.289364 16329 webserver.cc:533] Webserver started at http://127.15.242.66:46443/ using document root <none> and password file <none>
I20260709 13:17:29.289889 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:29.289851 16863 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36076
I20260709 13:17:29.290272 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:29.290601 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:29.291780 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-1-root/instance:
uuid: "ca1c4bfd5a414128951fb23cb402b699"
format_stamp: "Formatted at 2026-07-09 13:17:29 on dist-test-slave-fh5z"
I20260709 13:17:29.296169 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:29.299396 17002 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:29.300355 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:17:29.300590 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-1-root
uuid: "ca1c4bfd5a414128951fb23cb402b699"
format_stamp: "Formatted at 2026-07-09 13:17:29 on dist-test-slave-fh5z"
I20260709 13:17:29.300824 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:29.354875 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:29.355986 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:29.357381 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:29.359773 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:29.359951 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:29.360258 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:29.360420 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:29.402593 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.66:44429
I20260709 13:17:29.402709 17064 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.66:44429 every 8 connection(s)
I20260709 13:17:29.407181 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:29.413369 17068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:29.414487 17069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:29.417573 16329 server_base.cc:1061] running on GCE node
W20260709 13:17:29.418938 17071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:29.419214 17065 heartbeater.cc:344] Connected to a master server at 127.15.242.126:34059
I20260709 13:17:29.419638 17065 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:29.419921 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:29.420178 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:29.420368 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603049420334 us; error 0 us; skew 500 ppm
I20260709 13:17:29.420425 17065 heartbeater.cc:507] Master 127.15.242.126:34059 requested a full tablet report, sending...
I20260709 13:17:29.421053 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:29.422775 16863 ts_manager.cc:194] Registered new tserver with Master: ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:29.423517 16329 webserver.cc:533] Webserver started at http://127.15.242.67:37961/ using document root <none> and password file <none>
I20260709 13:17:29.424018 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:29.424206 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:29.424268 16863 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36090
I20260709 13:17:29.424504 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:29.425829 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-2-root/instance:
uuid: "e467738a24f84b7bb0d451dda890555f"
format_stamp: "Formatted at 2026-07-09 13:17:29 on dist-test-slave-fh5z"
I20260709 13:17:29.430160 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:17:29.433264 17076 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:29.434192 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:29.434434 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-2-root
uuid: "e467738a24f84b7bb0d451dda890555f"
format_stamp: "Formatted at 2026-07-09 13:17:29 on dist-test-slave-fh5z"
I20260709 13:17:29.434664 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603035614178-16329-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:29.468319 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:29.469472 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:29.471123 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:29.473102 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:29.473274 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:29.473570 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:29.473745 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:29.513814 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.67:40605
I20260709 13:17:29.514005 17138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.67:40605 every 8 connection(s)
I20260709 13:17:29.527127 17139 heartbeater.cc:344] Connected to a master server at 127.15.242.126:34059
I20260709 13:17:29.527521 17139 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:29.528218 17139 heartbeater.cc:507] Master 127.15.242.126:34059 requested a full tablet report, sending...
I20260709 13:17:29.529992 16863 ts_manager.cc:194] Registered new tserver with Master: e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:29.530181 16329 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013310444s
I20260709 13:17:29.531288 16863 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36106
I20260709 13:17:29.553839 16863 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36114:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:29.556592 16863 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:29.632500 17104 tablet_service.cc:1511] Processing CreateTablet for tablet 883019cb720f42ff97fee10ee735c4db (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:29.633980 17104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883019cb720f42ff97fee10ee735c4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.635106 17102 tablet_service.cc:1511] Processing CreateTablet for tablet 0a48a385ed8b4d7aa4359dcb2f2dbb25 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:29.635281 17100 tablet_service.cc:1511] Processing CreateTablet for tablet 40dbf105b3ff4886bf930dc6d3c0f59f (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:29.636536 17102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a48a385ed8b4d7aa4359dcb2f2dbb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.636283 17103 tablet_service.cc:1511] Processing CreateTablet for tablet e8bc1265ff53457ebe0bc964db347748 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:29.637580 17100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40dbf105b3ff4886bf930dc6d3c0f59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.638172 17101 tablet_service.cc:1511] Processing CreateTablet for tablet 64e0696aadae411fab2f7aa16109cd72 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:29.639477 17101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e0696aadae411fab2f7aa16109cd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.639336 17029 tablet_service.cc:1511] Processing CreateTablet for tablet e8bc1265ff53457ebe0bc964db347748 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:29.640573 17029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8bc1265ff53457ebe0bc964db347748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.642328 17103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8bc1265ff53457ebe0bc964db347748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.646477 17030 tablet_service.cc:1511] Processing CreateTablet for tablet 883019cb720f42ff97fee10ee735c4db (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:29.647760 17030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883019cb720f42ff97fee10ee735c4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.651780 17028 tablet_service.cc:1511] Processing CreateTablet for tablet 0a48a385ed8b4d7aa4359dcb2f2dbb25 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:29.652279 17027 tablet_service.cc:1511] Processing CreateTablet for tablet 64e0696aadae411fab2f7aa16109cd72 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:29.653117 17028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a48a385ed8b4d7aa4359dcb2f2dbb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.653750 17027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e0696aadae411fab2f7aa16109cd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.667832 17026 tablet_service.cc:1511] Processing CreateTablet for tablet 40dbf105b3ff4886bf930dc6d3c0f59f (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:29.669275 17026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40dbf105b3ff4886bf930dc6d3c0f59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.673810 16955 tablet_service.cc:1511] Processing CreateTablet for tablet 883019cb720f42ff97fee10ee735c4db (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:29.675092 16955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883019cb720f42ff97fee10ee735c4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.675925 16954 tablet_service.cc:1511] Processing CreateTablet for tablet e8bc1265ff53457ebe0bc964db347748 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:29.676362 17025 tablet_service.cc:1511] Processing CreateTablet for tablet ee3dbba336de444b8b7d99cc9412da65 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:29.677166 16954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8bc1265ff53457ebe0bc964db347748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.677768 17025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3dbba336de444b8b7d99cc9412da65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.679194 16953 tablet_service.cc:1511] Processing CreateTablet for tablet 0a48a385ed8b4d7aa4359dcb2f2dbb25 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:29.681334 16952 tablet_service.cc:1511] Processing CreateTablet for tablet 64e0696aadae411fab2f7aa16109cd72 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:29.683444 16951 tablet_service.cc:1511] Processing CreateTablet for tablet 40dbf105b3ff4886bf930dc6d3c0f59f (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:29.684126 17099 tablet_service.cc:1511] Processing CreateTablet for tablet ee3dbba336de444b8b7d99cc9412da65 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:29.685544 17099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3dbba336de444b8b7d99cc9412da65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.685586 16950 tablet_service.cc:1511] Processing CreateTablet for tablet ee3dbba336de444b8b7d99cc9412da65 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:29.687863 16949 tablet_service.cc:1511] Processing CreateTablet for tablet de6a767f69af4afc897f144343ff0545 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:29.704433 17024 tablet_service.cc:1511] Processing CreateTablet for tablet de6a767f69af4afc897f144343ff0545 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:29.705757 17024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6a767f69af4afc897f144343ff0545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.707280 16949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6a767f69af4afc897f144343ff0545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.708012 16950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3dbba336de444b8b7d99cc9412da65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.714085 16952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e0696aadae411fab2f7aa16109cd72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.722422 16953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a48a385ed8b4d7aa4359dcb2f2dbb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.726457 16951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40dbf105b3ff4886bf930dc6d3c0f59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.728349 16948 tablet_service.cc:1511] Processing CreateTablet for tablet f544d85f55a24b28a284b58b48127c72 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:29.729648 16948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f544d85f55a24b28a284b58b48127c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.731030 17100 tablet_service.cc:1511] Processing CreateTablet for tablet de6a767f69af4afc897f144343ff0545 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:29.732232 17100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6a767f69af4afc897f144343ff0545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.756006 17154 tablet_bootstrap.cc:492] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f: Bootstrap starting.
I20260709 13:17:29.771081 17156 tablet_bootstrap.cc:492] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a: Bootstrap starting.
I20260709 13:17:29.773554 17025 tablet_service.cc:1511] Processing CreateTablet for tablet f544d85f55a24b28a284b58b48127c72 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:29.774852 17025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f544d85f55a24b28a284b58b48127c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.774614 16947 tablet_service.cc:1511] Processing CreateTablet for tablet f5d19d8de82e4e3d8ef07688f87dfbc4 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:29.776000 16947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d19d8de82e4e3d8ef07688f87dfbc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.777849 17156 tablet_bootstrap.cc:654] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.781493 17154 tablet_bootstrap.cc:654] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.792723 17103 tablet_service.cc:1511] Processing CreateTablet for tablet f544d85f55a24b28a284b58b48127c72 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:29.761837 17155 tablet_bootstrap.cc:492] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699: Bootstrap starting.
I20260709 13:17:29.794003 17103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f544d85f55a24b28a284b58b48127c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.803452 16952 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0ca61a18c447d782fb606388d14c65 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:29.803449 17026 tablet_service.cc:1511] Processing CreateTablet for tablet f5d19d8de82e4e3d8ef07688f87dfbc4 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:29.807008 17026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d19d8de82e4e3d8ef07688f87dfbc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.809056 17101 tablet_service.cc:1511] Processing CreateTablet for tablet f5d19d8de82e4e3d8ef07688f87dfbc4 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:29.805954 16952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0ca61a18c447d782fb606388d14c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.810232 17101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d19d8de82e4e3d8ef07688f87dfbc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.814395 17155 tablet_bootstrap.cc:654] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.829589 17024 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0ca61a18c447d782fb606388d14c65 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:29.830884 17024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0ca61a18c447d782fb606388d14c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.832229 17099 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0ca61a18c447d782fb606388d14c65 (DEFAULT_TABLE table=test-workload [id=1a844890e9994e6c801e34a852950364]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:29.833410 17099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0ca61a18c447d782fb606388d14c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.859668 17154 tablet_bootstrap.cc:492] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f: No bootstrap required, opened a new log
I20260709 13:17:29.860313 17154 ts_tablet_manager.cc:1403] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.005s
I20260709 13:17:29.870812 17156 tablet_bootstrap.cc:492] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a: No bootstrap required, opened a new log
I20260709 13:17:29.872344 17154 raft_consensus.cc:359] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:29.873234 17155 tablet_bootstrap.cc:492] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699: No bootstrap required, opened a new log
I20260709 13:17:29.873762 17154 raft_consensus.cc:385] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.873984 17155 ts_tablet_manager.cc:1403] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699: Time spent bootstrapping tablet: real 0.113s	user 0.019s	sys 0.013s
I20260709 13:17:29.873234 17156 ts_tablet_manager.cc:1403] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a: Time spent bootstrapping tablet: real 0.102s	user 0.046s	sys 0.040s
I20260709 13:17:29.874186 17154 raft_consensus.cc:740] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.877067 17155 raft_consensus.cc:359] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:29.877887 17155 raft_consensus.cc:385] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.878235 17155 raft_consensus.cc:740] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.878937 17156 raft_consensus.cc:359] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:29.879113 17155 consensus_queue.cc:260] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:29.877022 17154 consensus_queue.cc:260] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:29.879729 17156 raft_consensus.cc:385] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.881403 17156 raft_consensus.cc:740] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.886721 17139 heartbeater.cc:499] Master 127.15.242.126:34059 was elected leader, sending a full tablet report...
I20260709 13:17:29.886813 17156 consensus_queue.cc:260] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:29.887269 17065 heartbeater.cc:499] Master 127.15.242.126:34059 was elected leader, sending a full tablet report...
I20260709 13:17:29.887279 17154 ts_tablet_manager.cc:1434] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f: Time spent starting tablet: real 0.027s	user 0.012s	sys 0.002s
I20260709 13:17:29.888357 17154 tablet_bootstrap.cc:492] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f: Bootstrap starting.
I20260709 13:17:29.893200 17155 ts_tablet_manager.cc:1434] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:17:29.894479 17155 tablet_bootstrap.cc:492] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699: Bootstrap starting.
I20260709 13:17:29.894578 17154 tablet_bootstrap.cc:654] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.903615 17155 tablet_bootstrap.cc:654] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.905055 16990 heartbeater.cc:499] Master 127.15.242.126:34059 was elected leader, sending a full tablet report...
I20260709 13:17:29.905596 17156 ts_tablet_manager.cc:1434] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.012s
I20260709 13:17:29.906484 17156 tablet_bootstrap.cc:492] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a: Bootstrap starting.
I20260709 13:17:29.912878 17156 tablet_bootstrap.cc:654] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.918040 17160 raft_consensus.cc:493] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.918754 17160 raft_consensus.cc:515] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:29.937943 17160 leader_election.cc:290] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:29.997675 17154 tablet_bootstrap.cc:492] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f: No bootstrap required, opened a new log
I20260709 13:17:29.998255 17154 ts_tablet_manager.cc:1403] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f: Time spent bootstrapping tablet: real 0.110s	user 0.043s	sys 0.066s
I20260709 13:17:30.001067 17154 raft_consensus.cc:359] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.001756 17154 raft_consensus.cc:385] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.002058 17154 raft_consensus.cc:740] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.002910 17154 consensus_queue.cc:260] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.005298 17154 ts_tablet_manager.cc:1434] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:30.006258 17154 tablet_bootstrap.cc:492] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f: Bootstrap starting.
I20260709 13:17:30.012588 17154 tablet_bootstrap.cc:654] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.023897 17154 tablet_bootstrap.cc:492] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f: No bootstrap required, opened a new log
I20260709 13:17:30.024398 17154 ts_tablet_manager.cc:1403] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:17:30.027304 17154 raft_consensus.cc:359] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:30.027974 17154 raft_consensus.cc:385] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.028254 17154 raft_consensus.cc:740] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.029114 17154 consensus_queue.cc:260] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:30.033424 17154 ts_tablet_manager.cc:1434] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:17:30.034340 17154 tablet_bootstrap.cc:492] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f: Bootstrap starting.
I20260709 13:17:30.040616 17154 tablet_bootstrap.cc:654] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.041828 17156 tablet_bootstrap.cc:492] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a: No bootstrap required, opened a new log
I20260709 13:17:30.042318 17156 ts_tablet_manager.cc:1403] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a: Time spent bootstrapping tablet: real 0.136s	user 0.059s	sys 0.075s
I20260709 13:17:30.042217 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
I20260709 13:17:30.043725 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f" is_pre_election: true
W20260709 13:17:30.045343 17006 leader_election.cc:343] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.045765 17154 tablet_bootstrap.cc:492] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f: No bootstrap required, opened a new log
I20260709 13:17:30.046277 17154 ts_tablet_manager.cc:1403] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:17:30.046147 17156 raft_consensus.cc:359] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.047413 17156 raft_consensus.cc:385] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.047793 17156 raft_consensus.cc:740] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.048386 17155 tablet_bootstrap.cc:492] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699: No bootstrap required, opened a new log
I20260709 13:17:30.048832 17155 ts_tablet_manager.cc:1403] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699: Time spent bootstrapping tablet: real 0.155s	user 0.068s	sys 0.050s
I20260709 13:17:30.048563 17156 consensus_queue.cc:260] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.049701 16965 raft_consensus.cc:2468] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 0.
I20260709 13:17:30.049530 17154 raft_consensus.cc:359] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.050319 17154 raft_consensus.cc:385] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.050628 17154 raft_consensus.cc:740] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.051134 17156 ts_tablet_manager.cc:1434] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:17:30.051378 17154 consensus_queue.cc:260] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.052278 17156 tablet_bootstrap.cc:492] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a: Bootstrap starting.
I20260709 13:17:30.052126 17155 raft_consensus.cc:359] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.052850 17155 raft_consensus.cc:385] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.053153 17155 raft_consensus.cc:740] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.053696 17154 ts_tablet_manager.cc:1434] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:17:30.054045 17155 consensus_queue.cc:260] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.054427 17005 leader_election.cc:304] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: e467738a24f84b7bb0d451dda890555f
I20260709 13:17:30.054675 17154 tablet_bootstrap.cc:492] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f: Bootstrap starting.
I20260709 13:17:30.055341 17160 raft_consensus.cc:2804] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.055727 17160 raft_consensus.cc:493] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.056080 17160 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.059412 17156 tablet_bootstrap.cc:654] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.062783 17154 tablet_bootstrap.cc:654] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.074245 17154 tablet_bootstrap.cc:492] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f: No bootstrap required, opened a new log
I20260709 13:17:30.074762 17154 ts_tablet_manager.cc:1403] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.003s
I20260709 13:17:30.075790 17155 ts_tablet_manager.cc:1434] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:17:30.077033 17155 tablet_bootstrap.cc:492] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699: Bootstrap starting.
I20260709 13:17:30.077596 17154 raft_consensus.cc:359] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.078408 17154 raft_consensus.cc:385] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.078749 17154 raft_consensus.cc:740] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.079538 17154 consensus_queue.cc:260] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.081782 17154 ts_tablet_manager.cc:1434] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:30.081877 17160 raft_consensus.cc:515] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.082737 17154 tablet_bootstrap.cc:492] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f: Bootstrap starting.
I20260709 13:17:30.085927 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f"
W20260709 13:17:30.088241 17006 leader_election.cc:343] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.089933 17154 tablet_bootstrap.cc:654] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.093508 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:30.093819 17160 leader_election.cc:290] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.094274 16965 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:30.097353 16911 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:30.101666 17154 tablet_bootstrap.cc:492] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f: No bootstrap required, opened a new log
I20260709 13:17:30.102233 17154 ts_tablet_manager.cc:1403] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:17:30.103490 16965 raft_consensus.cc:2468] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 1.
I20260709 13:17:30.104703 17005 leader_election.cc:304] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: e467738a24f84b7bb0d451dda890555f
I20260709 13:17:30.105777 17160 raft_consensus.cc:2804] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.105667 17154 raft_consensus.cc:359] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.106282 17160 raft_consensus.cc:697] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Becoming Leader. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:30.106526 17154 raft_consensus.cc:385] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.106900 17154 raft_consensus.cc:740] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.107244 17160 consensus_queue.cc:237] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.106132 17155 tablet_bootstrap.cc:654] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.108062 17154 consensus_queue.cc:260] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.113340 17154 ts_tablet_manager.cc:1434] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:17:30.114190 17156 tablet_bootstrap.cc:492] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a: No bootstrap required, opened a new log
I20260709 13:17:30.114677 17156 ts_tablet_manager.cc:1403] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a: Time spent bootstrapping tablet: real 0.063s	user 0.026s	sys 0.034s
I20260709 13:17:30.114786 17154 tablet_bootstrap.cc:492] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f: Bootstrap starting.
I20260709 13:17:30.117497 17156 raft_consensus.cc:359] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.118239 17156 raft_consensus.cc:385] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.119336 17156 raft_consensus.cc:740] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.120002 17156 consensus_queue.cc:260] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.122625 17162 raft_consensus.cc:493] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.123116 17162 raft_consensus.cc:515] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:30.125787 17162 leader_election.cc:290] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:30.127535 17154 tablet_bootstrap.cc:654] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.131402 17155 tablet_bootstrap.cc:492] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699: No bootstrap required, opened a new log
I20260709 13:17:30.132001 17155 ts_tablet_manager.cc:1403] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.004s
I20260709 13:17:30.135589 17155 raft_consensus.cc:359] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.136749 17155 raft_consensus.cc:385] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.137130 17155 raft_consensus.cc:740] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.138245 17155 consensus_queue.cc:260] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.141435 17155 ts_tablet_manager.cc:1434] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:17:30.142721 17155 tablet_bootstrap.cc:492] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699: Bootstrap starting.
I20260709 13:17:30.147714 17161 raft_consensus.cc:493] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.147840 17156 ts_tablet_manager.cc:1434] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.021s
I20260709 13:17:30.148229 17161 raft_consensus.cc:515] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.148890 17156 tablet_bootstrap.cc:492] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a: Bootstrap starting.
I20260709 13:17:30.149456 17154 tablet_bootstrap.cc:492] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f: No bootstrap required, opened a new log
I20260709 13:17:30.149886 17154 ts_tablet_manager.cc:1403] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.013s
I20260709 13:17:30.150810 17155 tablet_bootstrap.cc:654] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.152751 17154 raft_consensus.cc:359] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.153560 17154 raft_consensus.cc:385] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.153926 17154 raft_consensus.cc:740] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.154951 17161 leader_election.cc:290] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:30.155457 17156 tablet_bootstrap.cc:654] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.154870 17154 consensus_queue.cc:260] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.157835 17154 ts_tablet_manager.cc:1434] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:17:30.158983 17154 tablet_bootstrap.cc:492] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f: Bootstrap starting.
I20260709 13:17:30.166956 17154 tablet_bootstrap.cc:654] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.180385 17154 tablet_bootstrap.cc:492] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f: No bootstrap required, opened a new log
I20260709 13:17:30.181160 17154 ts_tablet_manager.cc:1403] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.002s
I20260709 13:17:30.181810 17161 raft_consensus.cc:493] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.182587 17161 raft_consensus.cc:515] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.184453 17154 raft_consensus.cc:359] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.185316 17154 raft_consensus.cc:385] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.185647 17154 raft_consensus.cc:740] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.186525 17154 consensus_queue.cc:260] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.189067 17154 ts_tablet_manager.cc:1434] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:30.190444 17154 tablet_bootstrap.cc:492] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f: Bootstrap starting.
I20260709 13:17:30.197635 17154 tablet_bootstrap.cc:654] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.207259 17161 leader_election.cc:290] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:30.210112 17154 tablet_bootstrap.cc:492] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f: No bootstrap required, opened a new log
I20260709 13:17:30.210685 17154 ts_tablet_manager.cc:1403] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:17:30.213872 17154 raft_consensus.cc:359] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.214754 17154 raft_consensus.cc:385] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.215088 17154 raft_consensus.cc:740] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.215838 17154 consensus_queue.cc:260] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.218822 17154 ts_tablet_manager.cc:1434] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:30.219949 17154 tablet_bootstrap.cc:492] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f: Bootstrap starting.
I20260709 13:17:30.226536 17160 raft_consensus.cc:493] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.227159 17160 raft_consensus.cc:515] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.229844 17160 leader_election.cc:290] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.231702 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3dbba336de444b8b7d99cc9412da65" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
I20260709 13:17:30.231979 17154 tablet_bootstrap.cc:654] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.232338 16965 raft_consensus.cc:2468] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 0.
I20260709 13:17:30.233721 17005 leader_election.cc:304] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:30.234917 17160 raft_consensus.cc:2804] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.235368 17160 raft_consensus.cc:493] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.235798 17160 raft_consensus.cc:3060] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.244247 17170 raft_consensus.cc:493] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.244457 17154 tablet_bootstrap.cc:492] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f: No bootstrap required, opened a new log
I20260709 13:17:30.245034 17154 ts_tablet_manager.cc:1403] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 13:17:30.244863 17170 raft_consensus.cc:515] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.247567 17170 leader_election.cc:290] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.248344 17154 raft_consensus.cc:359] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.249200 17154 raft_consensus.cc:385] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.249548 17154 raft_consensus.cc:740] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.249570 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
I20260709 13:17:30.250658 17160 raft_consensus.cc:515] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
W20260709 13:17:30.251132 17005 leader_election.cc:343] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.250563 17154 consensus_queue.cc:260] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.253655 17154 ts_tablet_manager.cc:1434] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:17:30.254158 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3dbba336de444b8b7d99cc9412da65" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:30.254886 16965 raft_consensus.cc:3060] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.265669 16965 raft_consensus.cc:2468] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 1.
I20260709 13:17:30.267252 17005 leader_election.cc:304] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:30.268375 17170 raft_consensus.cc:2804] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.280154 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3dbba336de444b8b7d99cc9412da65" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f" is_pre_election: true
I20260709 13:17:30.281013 17114 raft_consensus.cc:2468] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 0.
I20260709 13:17:30.288676 17170 raft_consensus.cc:697] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Becoming Leader. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:30.289891 17170 consensus_queue.cc:237] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.292680 17160 leader_election.cc:290] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.294734 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f" is_pre_election: true
I20260709 13:17:30.295542 17114 raft_consensus.cc:2468] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 0.
I20260709 13:17:30.298471 17184 raft_consensus.cc:493] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.298941 17184 raft_consensus.cc:515] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.301622 17184 leader_election.cc:290] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:30.303704 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3dbba336de444b8b7d99cc9412da65" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:30.312572 17114 raft_consensus.cc:3060] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.323179 17155 tablet_bootstrap.cc:492] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699: No bootstrap required, opened a new log
I20260709 13:17:30.323335 17156 tablet_bootstrap.cc:492] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a: No bootstrap required, opened a new log
I20260709 13:17:30.323767 17155 ts_tablet_manager.cc:1403] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699: Time spent bootstrapping tablet: real 0.181s	user 0.054s	sys 0.107s
I20260709 13:17:30.323879 17156 ts_tablet_manager.cc:1403] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a: Time spent bootstrapping tablet: real 0.175s	user 0.058s	sys 0.107s
I20260709 13:17:30.326799 17155 raft_consensus.cc:359] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:30.327633 17155 raft_consensus.cc:385] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.327968 17155 raft_consensus.cc:740] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.305975 17006 leader_election.cc:304] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:30.264719 16862 catalog_manager.cc:5697] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ca1c4bfd5a414128951fb23cb402b699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.329205 17160 raft_consensus.cc:2804] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.328717 17155 consensus_queue.cc:260] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:30.329636 17160 raft_consensus.cc:493] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.330400 17160 raft_consensus.cc:3060] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.331324 17155 ts_tablet_manager.cc:1434] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:17:30.331912 17184 raft_consensus.cc:493] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.332386 17184 raft_consensus.cc:515] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:30.332821 17155 tablet_bootstrap.cc:492] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699: Bootstrap starting.
I20260709 13:17:30.332942 17156 raft_consensus.cc:359] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.333736 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
I20260709 13:17:30.334383 17184 leader_election.cc:290] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881)
I20260709 13:17:30.335180 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3dbba336de444b8b7d99cc9412da65" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
I20260709 13:17:30.335438 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.336041 16964 raft_consensus.cc:2393] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e467738a24f84b7bb0d451dda890555f in current term 1: Already voted for candidate ca1c4bfd5a414128951fb23cb402b699 in this term.
I20260709 13:17:30.337035 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a767f69af4afc897f144343ff0545" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
I20260709 13:17:30.328600 17114 raft_consensus.cc:2468] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 1.
W20260709 13:17:30.338634 17079 leader_election.cc:343] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.338737 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3dbba336de444b8b7d99cc9412da65" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.340018 17155 tablet_bootstrap.cc:654] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.340569 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883019cb720f42ff97fee10ee735c4db" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
I20260709 13:17:30.341185 16963 raft_consensus.cc:2468] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 0.
I20260709 13:17:30.341399 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a767f69af4afc897f144343ff0545" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
W20260709 13:17:30.342437 17079 leader_election.cc:343] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.343410 17160 raft_consensus.cc:515] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.343591 17079 leader_election.cc:304] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:30.350416 17184 raft_consensus.cc:2804] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.350876 17040 raft_consensus.cc:2393] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e467738a24f84b7bb0d451dda890555f in current term 1: Already voted for candidate ca1c4bfd5a414128951fb23cb402b699 in this term.
I20260709 13:17:30.350901 17184 raft_consensus.cc:493] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.351534 17184 raft_consensus.cc:3060] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.333691 17156 raft_consensus.cc:385] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.353688 17160 leader_election.cc:290] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.353688 17156 raft_consensus.cc:740] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.353938 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:30.354497 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883019cb720f42ff97fee10ee735c4db" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f" is_pre_election: true
W20260709 13:17:30.355297 17005 leader_election.cc:343] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.345197 17080 leader_election.cc:304] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e467738a24f84b7bb0d451dda890555f; no voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699
W20260709 13:17:30.356854 17080 leader_election.cc:343] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.357381 17080 leader_election.cc:304] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e467738a24f84b7bb0d451dda890555f; no voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699
I20260709 13:17:30.358204 17161 raft_consensus.cc:2749] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.359059 17156 consensus_queue.cc:260] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.361207 17156 ts_tablet_manager.cc:1434] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.004s
I20260709 13:17:30.362258 17156 tablet_bootstrap.cc:492] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a: Bootstrap starting.
I20260709 13:17:30.363091 17161 raft_consensus.cc:2749] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.368584 17156 tablet_bootstrap.cc:654] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.368237 17184 raft_consensus.cc:515] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:30.371667 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883019cb720f42ff97fee10ee735c4db" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.375887 17155 tablet_bootstrap.cc:492] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699: No bootstrap required, opened a new log
I20260709 13:17:30.376097 17040 raft_consensus.cc:2468] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 0.
I20260709 13:17:30.376341 17155 ts_tablet_manager.cc:1403] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.008s
I20260709 13:17:30.376559 17156 tablet_bootstrap.cc:492] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a: No bootstrap required, opened a new log
I20260709 13:17:30.373032 17080 leader_election.cc:304] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e467738a24f84b7bb0d451dda890555f; no voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699
I20260709 13:17:30.375101 17113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:30.377000 17156 ts_tablet_manager.cc:1403] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:17:30.377193 17113 raft_consensus.cc:3060] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.379426 17155 raft_consensus.cc:359] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.380132 17155 raft_consensus.cc:385] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.379840 17156 raft_consensus.cc:359] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.380541 17156 raft_consensus.cc:385] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.380439 17155 raft_consensus.cc:740] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.380932 17156 raft_consensus.cc:740] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.381630 17155 consensus_queue.cc:260] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.382402 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883019cb720f42ff97fee10ee735c4db" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.382337 17156 consensus_queue.cc:260] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.383152 17040 raft_consensus.cc:2468] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 0.
I20260709 13:17:30.384166 17155 ts_tablet_manager.cc:1434] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:30.384490 16931 leader_election.cc:304] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:30.385241 17155 tablet_bootstrap.cc:492] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699: Bootstrap starting.
I20260709 13:17:30.385380 17176 raft_consensus.cc:2804] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.385741 17176 raft_consensus.cc:493] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.386096 17176 raft_consensus.cc:3060] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.394330 17156 ts_tablet_manager.cc:1434] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:17:30.395911 17155 tablet_bootstrap.cc:654] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.398506 17113 raft_consensus.cc:2468] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 1.
I20260709 13:17:30.400367 17161 raft_consensus.cc:2749] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.402197 17156 tablet_bootstrap.cc:492] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a: Bootstrap starting.
I20260709 13:17:30.405431 17006 leader_election.cc:304] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:30.406456 17160 raft_consensus.cc:2804] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.397513 17176 raft_consensus.cc:515] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:30.406903 17160 raft_consensus.cc:697] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Becoming Leader. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:30.407717 17160 consensus_queue.cc:237] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.410287 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883019cb720f42ff97fee10ee735c4db" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:30.410787 17114 raft_consensus.cc:2393] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 292edd1aea2f4e048e5e49a200779e4a in current term 1: Already voted for candidate e467738a24f84b7bb0d451dda890555f in this term.
I20260709 13:17:30.411652 17156 tablet_bootstrap.cc:654] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.410809 17040 raft_consensus.cc:3060] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.412482 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883019cb720f42ff97fee10ee735c4db" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:30.413905 16963 raft_consensus.cc:2393] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e467738a24f84b7bb0d451dda890555f in current term 1: Already voted for candidate 292edd1aea2f4e048e5e49a200779e4a in this term.
I20260709 13:17:30.416620 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883019cb720f42ff97fee10ee735c4db" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:30.418315 17184 leader_election.cc:290] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881)
I20260709 13:17:30.419987 17155 tablet_bootstrap.cc:492] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699: No bootstrap required, opened a new log
I20260709 13:17:30.420518 17155 ts_tablet_manager.cc:1403] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.010s
I20260709 13:17:30.418742 17176 leader_election.cc:290] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 election: Requested vote from peers e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:30.421850 17113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883019cb720f42ff97fee10ee735c4db" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:30.422601 17113 raft_consensus.cc:2393] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 292edd1aea2f4e048e5e49a200779e4a in current term 1: Already voted for candidate e467738a24f84b7bb0d451dda890555f in this term.
I20260709 13:17:30.423866 17184 raft_consensus.cc:493] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.424115 16931 leader_election.cc:304] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a; no voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f
I20260709 13:17:30.424822 17040 raft_consensus.cc:2468] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 1.
I20260709 13:17:30.424597 17184 raft_consensus.cc:515] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.425374 17176 raft_consensus.cc:2749] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.425877 17080 leader_election.cc:304] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:30.426614 17155 raft_consensus.cc:359] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.427004 17161 raft_consensus.cc:2804] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.429268 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
I20260709 13:17:30.430157 16963 raft_consensus.cc:2468] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 0.
I20260709 13:17:30.431747 17079 leader_election.cc:304] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:30.427671 17155 raft_consensus.cc:385] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.434206 17155 raft_consensus.cc:740] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.436228 17155 consensus_queue.cc:260] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.440459 17155 ts_tablet_manager.cc:1434] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:17:30.443137 17184 leader_election.cc:290] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:30.443972 17184 raft_consensus.cc:493] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.444773 17155 tablet_bootstrap.cc:492] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699: Bootstrap starting.
I20260709 13:17:30.444732 17184 raft_consensus.cc:515] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.450855 17200 raft_consensus.cc:2804] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.451567 17200 raft_consensus.cc:493] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.451965 17200 raft_consensus.cc:3060] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.453401 17156 tablet_bootstrap.cc:492] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a: No bootstrap required, opened a new log
I20260709 13:17:30.453536 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.454193 17156 ts_tablet_manager.cc:1403] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.031s
I20260709 13:17:30.455883 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.459625 17040 raft_consensus.cc:2468] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 0.
I20260709 13:17:30.457875 16862 catalog_manager.cc:5697] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ca1c4bfd5a414128951fb23cb402b699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.458997 17184 leader_election.cc:290] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:30.461954 16862 catalog_manager.cc:5697] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ca1c4bfd5a414128951fb23cb402b699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.464272 17155 tablet_bootstrap.cc:654] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.465687 17161 raft_consensus.cc:697] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Becoming Leader. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:30.469930 17161 consensus_queue.cc:237] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:30.470541 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
I20260709 13:17:30.471324 16963 raft_consensus.cc:2393] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e467738a24f84b7bb0d451dda890555f in current term 1: Already voted for candidate ca1c4bfd5a414128951fb23cb402b699 in this term.
I20260709 13:17:30.458143 17156 raft_consensus.cc:359] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.470450 17155 tablet_bootstrap.cc:492] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699: No bootstrap required, opened a new log
I20260709 13:17:30.471719 17156 raft_consensus.cc:385] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.472015 17155 ts_tablet_manager.cc:1403] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.006s
I20260709 13:17:30.472060 17156 raft_consensus.cc:740] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.472625 17079 leader_election.cc:304] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e467738a24f84b7bb0d451dda890555f; no voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699
I20260709 13:17:30.472927 17156 consensus_queue.cc:260] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.473901 17201 raft_consensus.cc:493] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.474364 17201 raft_consensus.cc:515] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.475132 17155 raft_consensus.cc:359] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.475833 17155 raft_consensus.cc:385] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.475926 17156 ts_tablet_manager.cc:1434] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:17:30.476156 17155 raft_consensus.cc:740] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.476545 17201 leader_election.cc:290] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:30.477025 17201 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.476888 17155 consensus_queue.cc:260] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.477707 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0ca61a18c447d782fb606388d14c65" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
W20260709 13:17:30.478976 17080 leader_election.cc:343] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.479453 17155 ts_tablet_manager.cc:1434] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:30.480417 17155 tablet_bootstrap.cc:492] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699: Bootstrap starting.
I20260709 13:17:30.482707 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0ca61a18c447d782fb606388d14c65" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
W20260709 13:17:30.484364 17079 leader_election.cc:343] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.484865 17079 leader_election.cc:304] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e467738a24f84b7bb0d451dda890555f; no voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699
I20260709 13:17:30.486099 17202 raft_consensus.cc:2749] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.488970 17156 tablet_bootstrap.cc:492] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a: Bootstrap starting.
I20260709 13:17:30.459354 17200 raft_consensus.cc:515] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.489400 16863 catalog_manager.cc:5697] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f reported cstate change: term changed from 0 to 1, leader changed from <none> to e467738a24f84b7bb0d451dda890555f (127.15.242.67). New cstate: current_term: 1 leader_uuid: "e467738a24f84b7bb0d451dda890555f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.492048 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:30.492374 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:30.496068 17156 tablet_bootstrap.cc:654] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.496145 17040 raft_consensus.cc:3060] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.496196 16963 raft_consensus.cc:3060] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.493003 17200 leader_election.cc:290] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:30.486647 17155 tablet_bootstrap.cc:654] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.500177 17201 raft_consensus.cc:2749] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.505936 16963 raft_consensus.cc:2468] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 1.
I20260709 13:17:30.505879 17160 consensus_queue.cc:1048] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:30.507296 17040 raft_consensus.cc:2468] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 1.
I20260709 13:17:30.508224 17080 leader_election.cc:304] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:30.510951 17202 raft_consensus.cc:2804] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.511438 17202 raft_consensus.cc:697] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Becoming Leader. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:30.512497 17202 consensus_queue.cc:237] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.513847 17156 tablet_bootstrap.cc:492] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a: No bootstrap required, opened a new log
I20260709 13:17:30.513913 17155 tablet_bootstrap.cc:492] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699: No bootstrap required, opened a new log
I20260709 13:17:30.514333 17161 raft_consensus.cc:493] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.514405 17156 ts_tablet_manager.cc:1403] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 13:17:30.514475 17155 ts_tablet_manager.cc:1403] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.004s
I20260709 13:17:30.514842 17161 raft_consensus.cc:515] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.516803 17161 leader_election.cc:290] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:30.517163 17155 raft_consensus.cc:359] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.517681 17156 raft_consensus.cc:359] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.518481 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d19d8de82e4e3d8ef07688f87dfbc4" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.518738 17156 raft_consensus.cc:385] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.519145 17156 raft_consensus.cc:740] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.519228 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d19d8de82e4e3d8ef07688f87dfbc4" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
W20260709 13:17:30.519969 17080 leader_election.cc:343] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.517859 17155 raft_consensus.cc:385] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.520539 17155 raft_consensus.cc:740] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Initialized, Role: FOLLOWER
W20260709 13:17:30.520493 17079 leader_election.cc:343] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.520219 17156 consensus_queue.cc:260] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.521063 17079 leader_election.cc:304] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e467738a24f84b7bb0d451dda890555f; no voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699
I20260709 13:17:30.522650 17156 ts_tablet_manager.cc:1434] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:30.527401 17156 tablet_bootstrap.cc:492] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a: Bootstrap starting.
I20260709 13:17:30.522873 17201 raft_consensus.cc:2749] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.531299 17176 raft_consensus.cc:493] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.531750 17176 raft_consensus.cc:515] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.533830 17176 leader_election.cc:290] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.521405 17155 consensus_queue.cc:260] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.534834 17156 tablet_bootstrap.cc:654] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.536126 17155 ts_tablet_manager.cc:1434] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 13:17:30.536690 17160 raft_consensus.cc:493] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.537434 17155 tablet_bootstrap.cc:492] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699: Bootstrap starting.
I20260709 13:17:30.537248 17160 raft_consensus.cc:515] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.537875 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.538479 17040 raft_consensus.cc:2468] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 0.
I20260709 13:17:30.541134 17160 leader_election.cc:290] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.543498 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
I20260709 13:17:30.544566 17155 tablet_bootstrap.cc:654] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.545733 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f" is_pre_election: true
I20260709 13:17:30.546162 16931 leader_election.cc:304] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:30.546463 17112 raft_consensus.cc:2468] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 0.
I20260709 13:17:30.547734 17006 leader_election.cc:304] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:30.548740 17188 consensus_queue.cc:1048] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:30.548990 17160 raft_consensus.cc:2804] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.549348 17156 tablet_bootstrap.cc:492] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a: No bootstrap required, opened a new log
I20260709 13:17:30.549443 17160 raft_consensus.cc:493] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.549964 17160 raft_consensus.cc:3060] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.550170 17156 ts_tablet_manager.cc:1403] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.000s
I20260709 13:17:30.544107 16963 raft_consensus.cc:2468] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 0.
I20260709 13:17:30.552398 17113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f" is_pre_election: true
I20260709 13:17:30.552913 17176 raft_consensus.cc:2804] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.552994 17113 raft_consensus.cc:2468] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 0.
I20260709 13:17:30.554139 17176 raft_consensus.cc:493] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.554700 17176 raft_consensus.cc:3060] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.554207 17156 raft_consensus.cc:359] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.555380 17156 raft_consensus.cc:385] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.555804 17156 raft_consensus.cc:740] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.556716 17156 consensus_queue.cc:260] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.559696 17156 ts_tablet_manager.cc:1434] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:30.560842 17156 tablet_bootstrap.cc:492] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a: Bootstrap starting.
I20260709 13:17:30.568256 17156 tablet_bootstrap.cc:654] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.568969 17201 raft_consensus.cc:493] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.569574 17201 raft_consensus.cc:515] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.573439 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bc1265ff53457ebe0bc964db347748" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.574081 17040 raft_consensus.cc:2468] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 0.
I20260709 13:17:30.574331 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bc1265ff53457ebe0bc964db347748" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a" is_pre_election: true
I20260709 13:17:30.575589 17080 leader_election.cc:304] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:30.575203 17201 leader_election.cc:290] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:30.575937 16963 raft_consensus.cc:2468] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 0.
I20260709 13:17:30.576977 17201 raft_consensus.cc:2804] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.578908 17201 raft_consensus.cc:493] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.579640 17201 raft_consensus.cc:3060] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.584288 17176 raft_consensus.cc:515] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.585956 16863 catalog_manager.cc:5697] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f reported cstate change: term changed from 0 to 1, leader changed from <none> to e467738a24f84b7bb0d451dda890555f (127.15.242.67). New cstate: current_term: 1 leader_uuid: "e467738a24f84b7bb0d451dda890555f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.594848 17156 tablet_bootstrap.cc:492] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a: No bootstrap required, opened a new log
I20260709 13:17:30.595537 17156 ts_tablet_manager.cc:1403] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.007s
I20260709 13:17:30.599926 17201 raft_consensus.cc:515] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.600783 17160 raft_consensus.cc:515] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.603037 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bc1265ff53457ebe0bc964db347748" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:30.603593 17040 raft_consensus.cc:3060] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.604575 17162 raft_consensus.cc:493] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.608194 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bc1265ff53457ebe0bc964db347748" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:30.608927 16964 raft_consensus.cc:3060] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.611423 17040 raft_consensus.cc:2468] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 1.
I20260709 13:17:30.612519 17080 leader_election.cc:304] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:30.613340 17202 raft_consensus.cc:2804] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.613780 17202 raft_consensus.cc:697] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Becoming Leader. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:30.614588 17202 consensus_queue.cc:237] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.617913 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:30.605165 17162 raft_consensus.cc:515] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.622185 17039 raft_consensus.cc:2393] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 292edd1aea2f4e048e5e49a200779e4a in current term 1: Already voted for candidate ca1c4bfd5a414128951fb23cb402b699 in this term.
I20260709 13:17:30.623343 17162 leader_election.cc:290] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.622910 17156 raft_consensus.cc:359] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.623937 17156 raft_consensus.cc:385] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.624390 17156 raft_consensus.cc:740] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.625385 17113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a767f69af4afc897f144343ff0545" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f" is_pre_election: true
I20260709 13:17:30.625968 17113 raft_consensus.cc:2468] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 0.
I20260709 13:17:30.626854 17160 leader_election.cc:290] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.627562 17176 leader_election.cc:290] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.627432 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:30.628276 16931 leader_election.cc:304] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:30.628487 16963 raft_consensus.cc:2393] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1c4bfd5a414128951fb23cb402b699 in current term 1: Already voted for candidate 292edd1aea2f4e048e5e49a200779e4a in this term.
I20260709 13:17:30.629626 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:30.606518 17201 leader_election.cc:290] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 1 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:30.630193 17112 raft_consensus.cc:3060] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.630422 17156 consensus_queue.cc:260] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.631358 17176 raft_consensus.cc:2804] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.631551 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a767f69af4afc897f144343ff0545" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.631754 17176 raft_consensus.cc:493] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.632089 17176 raft_consensus.cc:3060] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.632148 17039 raft_consensus.cc:2468] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 0.
I20260709 13:17:30.634311 17113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:30.635752 17006 leader_election.cc:304] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699; no voters: 292edd1aea2f4e048e5e49a200779e4a, e467738a24f84b7bb0d451dda890555f
I20260709 13:17:30.636410 17160 raft_consensus.cc:2749] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.640051 17156 ts_tablet_manager.cc:1434] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 13:17:30.640868 17156 tablet_bootstrap.cc:492] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a: Bootstrap starting.
I20260709 13:17:30.642753 17112 raft_consensus.cc:2468] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 1.
I20260709 13:17:30.643698 16931 leader_election.cc:304] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, e467738a24f84b7bb0d451dda890555f; no voters: ca1c4bfd5a414128951fb23cb402b699
I20260709 13:17:30.644632 17162 raft_consensus.cc:2804] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.644757 17155 tablet_bootstrap.cc:492] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699: No bootstrap required, opened a new log
I20260709 13:17:30.645179 17155 ts_tablet_manager.cc:1403] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699: Time spent bootstrapping tablet: real 0.108s	user 0.038s	sys 0.055s
I20260709 13:17:30.646646 17162 raft_consensus.cc:697] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:30.647737 17162 consensus_queue.cc:237] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.648572 17155 raft_consensus.cc:359] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.649253 17155 raft_consensus.cc:385] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.649574 17155 raft_consensus.cc:740] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.650485 17155 consensus_queue.cc:260] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.652040 17176 raft_consensus.cc:515] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.655160 17155 ts_tablet_manager.cc:1434] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:17:30.656136 17155 tablet_bootstrap.cc:492] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699: Bootstrap starting.
I20260709 13:17:30.656899 16861 catalog_manager.cc:5697] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f reported cstate change: term changed from 0 to 1, leader changed from <none> to e467738a24f84b7bb0d451dda890555f (127.15.242.67). New cstate: current_term: 1 leader_uuid: "e467738a24f84b7bb0d451dda890555f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.657595 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a767f69af4afc897f144343ff0545" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:30.659508 17039 raft_consensus.cc:3060] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.661190 17156 tablet_bootstrap.cc:654] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.665130 17155 tablet_bootstrap.cc:654] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.655629 16964 raft_consensus.cc:2468] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 1.
I20260709 13:17:30.664296 16860 catalog_manager.cc:5697] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 1 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.670389 17039 raft_consensus.cc:2468] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 1.
I20260709 13:17:30.671548 16931 leader_election.cc:304] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:30.674511 17218 raft_consensus.cc:2804] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.676362 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a767f69af4afc897f144343ff0545" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:30.676937 17112 raft_consensus.cc:3060] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.679853 17218 raft_consensus.cc:697] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:30.681368 17218 consensus_queue.cc:237] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.686841 17112 raft_consensus.cc:2468] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 1.
I20260709 13:17:30.688532 17176 leader_election.cc:290] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.692759 17156 tablet_bootstrap.cc:492] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a: No bootstrap required, opened a new log
I20260709 13:17:30.693166 17156 ts_tablet_manager.cc:1403] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.003s
I20260709 13:17:30.693552 16862 catalog_manager.cc:5697] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 1 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.695533 17156 raft_consensus.cc:359] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.696079 17156 raft_consensus.cc:385] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.696293 17155 tablet_bootstrap.cc:492] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699: No bootstrap required, opened a new log
I20260709 13:17:30.696352 17156 raft_consensus.cc:740] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.696869 17155 ts_tablet_manager.cc:1403] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.017s
I20260709 13:17:30.697176 17156 consensus_queue.cc:260] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.698905 17155 raft_consensus.cc:359] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.699173 17156 ts_tablet_manager.cc:1434] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:30.699414 17155 raft_consensus.cc:385] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.699684 17155 raft_consensus.cc:740] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.700188 17155 consensus_queue.cc:260] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.701860 17155 ts_tablet_manager.cc:1434] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:17:30.793991 17218 raft_consensus.cc:493] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.794499 17218 raft_consensus.cc:515] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.796226 17218 leader_election.cc:290] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.797098 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d19d8de82e4e3d8ef07688f87dfbc4" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.797362 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d19d8de82e4e3d8ef07688f87dfbc4" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f" is_pre_election: true
I20260709 13:17:30.797621 17039 raft_consensus.cc:2468] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 0.
I20260709 13:17:30.798050 17112 raft_consensus.cc:2468] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 0.
I20260709 13:17:30.798650 16931 leader_election.cc:304] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:30.799409 17218 raft_consensus.cc:2804] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.799676 17218 raft_consensus.cc:493] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.799962 17218 raft_consensus.cc:3060] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.804587 17218 raft_consensus.cc:515] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.806114 17218 leader_election.cc:290] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.806870 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d19d8de82e4e3d8ef07688f87dfbc4" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:30.807124 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d19d8de82e4e3d8ef07688f87dfbc4" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:30.807323 17039 raft_consensus.cc:3060] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.807672 17112 raft_consensus.cc:3060] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.811651 17039 raft_consensus.cc:2468] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 1.
I20260709 13:17:30.811832 17112 raft_consensus.cc:2468] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 1.
I20260709 13:17:30.812744 16931 leader_election.cc:304] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:30.813377 17218 raft_consensus.cc:2804] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.813777 17218 raft_consensus.cc:697] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:30.814610 17218 consensus_queue.cc:237] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.816610 17160 consensus_queue.cc:1048] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:30.822840 16861 catalog_manager.cc:5697] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 1 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.827373 17170 consensus_queue.cc:1048] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:30.862759 17170 consensus_queue.cc:1048] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:30.870745 16964 raft_consensus.cc:3060] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.878433 17218 raft_consensus.cc:493] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.878485 17188 consensus_queue.cc:1048] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:30.878918 17218 raft_consensus.cc:515] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.880752 17218 leader_election.cc:290] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.881524 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.881918 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f" is_pre_election: true
I20260709 13:17:30.882922 17218 raft_consensus.cc:493] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.883460 16931 leader_election.cc:304] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a; no voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f
I20260709 13:17:30.884346 17176 raft_consensus.cc:2749] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.883378 17218 raft_consensus.cc:515] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.887171 17218 leader_election.cc:290] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.887995 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0ca61a18c447d782fb606388d14c65" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699" is_pre_election: true
I20260709 13:17:30.888101 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0ca61a18c447d782fb606388d14c65" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f" is_pre_election: true
I20260709 13:17:30.888509 17039 raft_consensus.cc:2468] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 0.
I20260709 13:17:30.888711 17112 raft_consensus.cc:2468] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 0.
I20260709 13:17:30.889431 16931 leader_election.cc:304] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:30.890174 17218 raft_consensus.cc:2804] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.890476 17218 raft_consensus.cc:493] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.890762 17218 raft_consensus.cc:3060] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.895427 17218 raft_consensus.cc:515] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.896898 17218 leader_election.cc:290] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:30.897517 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0ca61a18c447d782fb606388d14c65" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:30.897832 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0ca61a18c447d782fb606388d14c65" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:30.897971 17039 raft_consensus.cc:3060] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.898399 17112 raft_consensus.cc:3060] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.904541 17039 raft_consensus.cc:2468] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 1.
I20260709 13:17:30.904544 17112 raft_consensus.cc:2468] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 1.
I20260709 13:17:30.905682 16931 leader_election.cc:304] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:30.906426 17218 raft_consensus.cc:2804] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.906808 17218 raft_consensus.cc:697] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:30.907513 17218 consensus_queue.cc:237] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:30.914392 16861 catalog_manager.cc:5697] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 1 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.965929 17202 consensus_queue.cc:1048] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:30.976838 17161 consensus_queue.cc:1048] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:30.998463 17161 consensus_queue.cc:1048] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.013010 17161 consensus_queue.cc:1048] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.065099 17161 consensus_queue.cc:1048] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.074918 17200 consensus_queue.cc:1048] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.128400 17218 consensus_queue.cc:1048] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.131680 17114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "883019cb720f42ff97fee10ee735c4db"
dest_uuid: "e467738a24f84b7bb0d451dda890555f"
mode: GRACEFUL
new_leader_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:43506
I20260709 13:17:31.132203 17114 raft_consensus.cc:606] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Received request to transfer leadership to TS 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:31.139117 17218 consensus_queue.cc:1048] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.140010 17114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8bc1265ff53457ebe0bc964db347748"
dest_uuid: "e467738a24f84b7bb0d451dda890555f"
mode: GRACEFUL
new_leader_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:43506
I20260709 13:17:31.140594 17114 raft_consensus.cc:606] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Received request to transfer leadership to TS 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:31.159039 17039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25"
dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
mode: GRACEFUL
new_leader_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:56322
I20260709 13:17:31.159536 17039 raft_consensus.cc:606] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Received request to transfer leadership to TS 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:31.164716 17039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72"
dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
mode: GRACEFUL
new_leader_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:56322
I20260709 13:17:31.165285 17039 raft_consensus.cc:606] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Received request to transfer leadership to TS 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:31.169901 17114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f"
dest_uuid: "e467738a24f84b7bb0d451dda890555f"
mode: GRACEFUL
new_leader_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:43506
I20260709 13:17:31.170408 17114 raft_consensus.cc:606] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Received request to transfer leadership to TS 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:31.185303 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de6a767f69af4afc897f144343ff0545"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
mode: GRACEFUL
new_leader_uuid: "ca1c4bfd5a414128951fb23cb402b699"
 from {username='slave'} at 127.0.0.1:35716
I20260709 13:17:31.185796 16964 raft_consensus.cc:606] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Received request to transfer leadership to TS ca1c4bfd5a414128951fb23cb402b699
I20260709 13:17:31.190562 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
mode: GRACEFUL
new_leader_uuid: "ca1c4bfd5a414128951fb23cb402b699"
 from {username='slave'} at 127.0.0.1:35716
I20260709 13:17:31.191071 16964 raft_consensus.cc:606] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Received request to transfer leadership to TS ca1c4bfd5a414128951fb23cb402b699
I20260709 13:17:31.197733 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d19d8de82e4e3d8ef07688f87dfbc4"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
mode: GRACEFUL
new_leader_uuid: "ca1c4bfd5a414128951fb23cb402b699"
 from {username='slave'} at 127.0.0.1:35716
I20260709 13:17:31.198344 16964 raft_consensus.cc:606] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Received request to transfer leadership to TS ca1c4bfd5a414128951fb23cb402b699
I20260709 13:17:31.201684 17218 consensus_queue.cc:1048] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.204474 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e0ca61a18c447d782fb606388d14c65"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
mode: GRACEFUL
new_leader_uuid: "e467738a24f84b7bb0d451dda890555f"
 from {username='slave'} at 127.0.0.1:35716
I20260709 13:17:31.205077 16964 raft_consensus.cc:606] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Received request to transfer leadership to TS e467738a24f84b7bb0d451dda890555f
I20260709 13:17:31.212464 17176 consensus_queue.cc:1048] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.221793 17162 raft_consensus.cc:993] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a: : Instructing follower ca1c4bfd5a414128951fb23cb402b699 to start an election
I20260709 13:17:31.222302 17176 raft_consensus.cc:1081] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Signalling peer ca1c4bfd5a414128951fb23cb402b699 to start an election
I20260709 13:17:31.223827 17039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de6a767f69af4afc897f144343ff0545"
dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
 from {username='slave'} at 127.0.0.1:56316
I20260709 13:17:31.224388 17039 raft_consensus.cc:493] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.224767 17039 raft_consensus.cc:3060] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.230486 17039 raft_consensus.cc:515] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.232514 17039 leader_election.cc:290] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 2 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:31.232828 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a767f69af4afc897f144343ff0545" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:31.233170 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a767f69af4afc897f144343ff0545" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:31.233448 16964 raft_consensus.cc:3055] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.233841 16964 raft_consensus.cc:740] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:31.233906 17114 raft_consensus.cc:3060] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.234663 16964 consensus_queue.cc:260] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.235509 16964 raft_consensus.cc:3060] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.238942 17114 raft_consensus.cc:2468] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 2.
I20260709 13:17:31.239971 17006 leader_election.cc:304] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:31.240412 16964 raft_consensus.cc:2468] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 2.
I20260709 13:17:31.240625 17188 raft_consensus.cc:2804] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.241117 17188 raft_consensus.cc:697] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 2 LEADER]: Becoming Leader. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:31.241892 17188 consensus_queue.cc:237] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.247608 16861 catalog_manager.cc:5697] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 reported cstate change: term changed from 1 to 2, leader changed from 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65) to ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ca1c4bfd5a414128951fb23cb402b699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.272416 17176 consensus_queue.cc:1048] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.285104 17162 consensus_queue.cc:1048] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.291934 17218 raft_consensus.cc:993] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a: : Instructing follower ca1c4bfd5a414128951fb23cb402b699 to start an election
I20260709 13:17:31.292369 17162 raft_consensus.cc:1081] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Signalling peer ca1c4bfd5a414128951fb23cb402b699 to start an election
I20260709 13:17:31.293812 17039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5d19d8de82e4e3d8ef07688f87dfbc4"
dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
 from {username='slave'} at 127.0.0.1:56316
I20260709 13:17:31.294334 17039 raft_consensus.cc:493] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.294621 17039 raft_consensus.cc:3060] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.299659 17039 raft_consensus.cc:515] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.301522 17039 leader_election.cc:290] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 2 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:31.302239 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d19d8de82e4e3d8ef07688f87dfbc4" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:31.302858 16964 raft_consensus.cc:3055] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.302863 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d19d8de82e4e3d8ef07688f87dfbc4" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:31.303408 16964 raft_consensus.cc:740] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:31.303561 17114 raft_consensus.cc:3060] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.304188 16964 consensus_queue.cc:260] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.305074 16964 raft_consensus.cc:3060] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.308877 17114 raft_consensus.cc:2468] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 2.
I20260709 13:17:31.309693 16964 raft_consensus.cc:2468] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 2.
I20260709 13:17:31.309773 17006 leader_election.cc:304] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:31.310611 17188 raft_consensus.cc:2804] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.310997 17188 raft_consensus.cc:697] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 2 LEADER]: Becoming Leader. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:31.311595 17188 consensus_queue.cc:237] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.316862 16861 catalog_manager.cc:5697] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 reported cstate change: term changed from 1 to 2, leader changed from 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65) to ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ca1c4bfd5a414128951fb23cb402b699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.366981 17211 raft_consensus.cc:993] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699: : Instructing follower 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:31.367491 17188 raft_consensus.cc:1081] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Signalling peer 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:31.368921 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:35696
I20260709 13:17:31.369374 16964 raft_consensus.cc:493] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.369706 16964 raft_consensus.cc:3060] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.374624 16964 raft_consensus.cc:515] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.376080 16964 leader_election.cc:290] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:31.376967 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:31.377154 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:31.377460 17039 raft_consensus.cc:3055] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.377732 17114 raft_consensus.cc:3060] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.377784 17039 raft_consensus.cc:740] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:31.378660 17039 consensus_queue.cc:260] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.379549 17039 raft_consensus.cc:3060] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.382447 17114 raft_consensus.cc:2468] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 2.
I20260709 13:17:31.383451 16931 leader_election.cc:304] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:31.384178 17162 raft_consensus.cc:2804] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.384255 17039 raft_consensus.cc:2468] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 2.
I20260709 13:17:31.384735 17162 raft_consensus.cc:697] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:31.385519 17162 consensus_queue.cc:237] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.391660 16861 catalog_manager.cc:5697] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 1 to 2, leader changed from ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66) to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 2 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.395731 17162 consensus_queue.cc:1048] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.402753 17218 raft_consensus.cc:993] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a: : Instructing follower e467738a24f84b7bb0d451dda890555f to start an election
I20260709 13:17:31.403200 17176 raft_consensus.cc:1081] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Signalling peer e467738a24f84b7bb0d451dda890555f to start an election
I20260709 13:17:31.404807 17112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e0ca61a18c447d782fb606388d14c65"
dest_uuid: "e467738a24f84b7bb0d451dda890555f"
 from {username='slave'} at 127.0.0.1:43494
I20260709 13:17:31.405349 17112 raft_consensus.cc:493] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.405709 17112 raft_consensus.cc:3060] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.411479 17218 consensus_queue.cc:1048] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.413566 17112 raft_consensus.cc:515] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.416083 17112 leader_election.cc:290] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 2 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:31.416997 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0ca61a18c447d782fb606388d14c65" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:31.417002 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0ca61a18c447d782fb606388d14c65" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:31.418627 16964 raft_consensus.cc:3055] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.418933 16964 raft_consensus.cc:740] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:31.419727 16964 consensus_queue.cc:260] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.420790 16964 raft_consensus.cc:3060] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.425266 16964 raft_consensus.cc:2468] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 2.
I20260709 13:17:31.426311 17079 leader_election.cc:304] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, e467738a24f84b7bb0d451dda890555f; no voters: ca1c4bfd5a414128951fb23cb402b699
I20260709 13:17:31.427000 17200 raft_consensus.cc:2804] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.427512 17200 raft_consensus.cc:697] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 2 LEADER]: Becoming Leader. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:31.428301 17200 consensus_queue.cc:237] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.434947 16861 catalog_manager.cc:5697] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f reported cstate change: term changed from 1 to 2, leader changed from 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65) to e467738a24f84b7bb0d451dda890555f (127.15.242.67). New cstate: current_term: 2 leader_uuid: "e467738a24f84b7bb0d451dda890555f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.459444 17201 raft_consensus.cc:993] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f: : Instructing follower 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:31.459900 17200 raft_consensus.cc:1081] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Signalling peer 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:31.461261 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8bc1265ff53457ebe0bc964db347748"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:35702
I20260709 13:17:31.461774 16964 raft_consensus.cc:493] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.462116 16964 raft_consensus.cc:3060] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.466502 16964 raft_consensus.cc:515] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.468170 16964 leader_election.cc:290] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:31.468920 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bc1265ff53457ebe0bc964db347748" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:31.469237 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bc1265ff53457ebe0bc964db347748" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:31.469502 17039 raft_consensus.cc:3060] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.469784 17112 raft_consensus.cc:3055] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.470127 17112 raft_consensus.cc:740] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:31.470939 17112 consensus_queue.cc:260] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.472146 17112 raft_consensus.cc:3060] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.476334 17039 raft_consensus.cc:2468] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 2.
I20260709 13:17:31.477383 16931 leader_election.cc:304] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:31.478221 17218 raft_consensus.cc:2804] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.478681 17218 raft_consensus.cc:697] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:31.479692 17201 raft_consensus.cc:993] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f: : Instructing follower 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:31.479472 17218 consensus_queue.cc:237] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.479861 17112 raft_consensus.cc:2468] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 2.
I20260709 13:17:31.480623 17201 raft_consensus.cc:1081] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Signalling peer 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:31.482317 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:35702
I20260709 13:17:31.482867 16964 raft_consensus.cc:493] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.483258 16964 raft_consensus.cc:3060] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.488046 16861 catalog_manager.cc:5697] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 1 to 2, leader changed from e467738a24f84b7bb0d451dda890555f (127.15.242.67) to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 2 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.489439 16964 raft_consensus.cc:515] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.491356 16964 leader_election.cc:290] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:31.492175 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:31.492527 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:31.492707 17039 raft_consensus.cc:3060] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.493105 17112 raft_consensus.cc:3055] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.493417 17112 raft_consensus.cc:740] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:31.494140 17112 consensus_queue.cc:260] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.495258 17112 raft_consensus.cc:3060] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.499182 17039 raft_consensus.cc:2468] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 2.
I20260709 13:17:31.500080 16931 leader_election.cc:304] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:31.500512 17112 raft_consensus.cc:2468] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 2.
I20260709 13:17:31.500725 17218 raft_consensus.cc:2804] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.501204 17218 raft_consensus.cc:697] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:31.501993 17218 consensus_queue.cc:237] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.507604 16861 catalog_manager.cc:5697] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 1 to 2, leader changed from e467738a24f84b7bb0d451dda890555f (127.15.242.67) to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 2 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.575255 17201 raft_consensus.cc:993] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f: : Instructing follower 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:31.575714 17201 raft_consensus.cc:1081] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Signalling peer 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:31.577095 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "883019cb720f42ff97fee10ee735c4db"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:35702
I20260709 13:17:31.577598 16964 raft_consensus.cc:493] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.577909 16964 raft_consensus.cc:3060] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.582391 16964 raft_consensus.cc:515] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:31.584060 16964 leader_election.cc:290] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 election: Requested vote from peers e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:31.584890 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883019cb720f42ff97fee10ee735c4db" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:31.585172 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883019cb720f42ff97fee10ee735c4db" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:31.585431 17112 raft_consensus.cc:3055] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.585705 17039 raft_consensus.cc:3060] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.585772 17112 raft_consensus.cc:740] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:31.586634 17112 consensus_queue.cc:260] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:31.587524 17112 raft_consensus.cc:3060] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.591428 17039 raft_consensus.cc:2468] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 2.
I20260709 13:17:31.592293 16931 leader_election.cc:304] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:31.592948 17218 raft_consensus.cc:2804] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.593071 17112 raft_consensus.cc:2468] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 2.
I20260709 13:17:31.593345 17218 raft_consensus.cc:697] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:31.594108 17218 consensus_queue.cc:237] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } }
I20260709 13:17:31.598872 17211 raft_consensus.cc:993] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699: : Instructing follower 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:31.599272 17188 raft_consensus.cc:1081] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Signalling peer 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:31.600618 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:35696
I20260709 13:17:31.600476 16861 catalog_manager.cc:5697] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 1 to 2, leader changed from e467738a24f84b7bb0d451dda890555f (127.15.242.67) to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 2 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.601078 16964 raft_consensus.cc:493] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.601452 16964 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.607404 16964 raft_consensus.cc:515] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.609030 16964 leader_election.cc:290] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:31.610078 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:31.610174 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:31.610743 17039 raft_consensus.cc:3055] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.610764 17112 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.611222 17039 raft_consensus.cc:740] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:31.612042 17039 consensus_queue.cc:260] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.613169 17039 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.617494 17112 raft_consensus.cc:2468] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 2.
I20260709 13:17:31.618630 16931 leader_election.cc:304] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:31.619383 17218 raft_consensus.cc:2804] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.619746 17039 raft_consensus.cc:2468] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 2.
I20260709 13:17:31.619801 17218 raft_consensus.cc:697] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:31.620759 17218 consensus_queue.cc:237] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.627326 16861 catalog_manager.cc:5697] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 1 to 2, leader changed from ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66) to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 2 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.661238 17112 raft_consensus.cc:1275] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Refusing update from remote peer ca1c4bfd5a414128951fb23cb402b699: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.662447 17188 consensus_queue.cc:1048] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.669386 16964 raft_consensus.cc:1275] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Refusing update from remote peer ca1c4bfd5a414128951fb23cb402b699: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.671042 17188 consensus_queue.cc:1048] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.681047 17162 raft_consensus.cc:993] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a: : Instructing follower ca1c4bfd5a414128951fb23cb402b699 to start an election
I20260709 13:17:31.681499 17218 raft_consensus.cc:1081] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Signalling peer ca1c4bfd5a414128951fb23cb402b699 to start an election
I20260709 13:17:31.682912 17039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72"
dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
 from {username='slave'} at 127.0.0.1:56316
I20260709 13:17:31.683358 17039 raft_consensus.cc:493] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.683643 17039 raft_consensus.cc:3060] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.688432 17039 raft_consensus.cc:515] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.690130 17039 leader_election.cc:290] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 2 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:31.690758 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:31.691130 17112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:31.691272 16964 raft_consensus.cc:3055] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.691642 17112 raft_consensus.cc:3060] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.691656 16964 raft_consensus.cc:740] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:31.692572 16964 consensus_queue.cc:260] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.693454 16964 raft_consensus.cc:3060] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.696401 17112 raft_consensus.cc:2468] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 2.
I20260709 13:17:31.697371 17006 leader_election.cc:304] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:31.698096 17188 raft_consensus.cc:2804] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.698300 16964 raft_consensus.cc:2468] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 2.
I20260709 13:17:31.698491 17188 raft_consensus.cc:697] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 2 LEADER]: Becoming Leader. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:31.699295 17188 consensus_queue.cc:237] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:31.704746 16862 catalog_manager.cc:5697] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 reported cstate change: term changed from 1 to 2, leader changed from 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65) to ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ca1c4bfd5a414128951fb23cb402b699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.747112 16964 raft_consensus.cc:1275] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Refusing update from remote peer ca1c4bfd5a414128951fb23cb402b699: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.748200 17188 consensus_queue.cc:1048] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.755776 17112 raft_consensus.cc:1275] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Refusing update from remote peer ca1c4bfd5a414128951fb23cb402b699: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.757725 17188 consensus_queue.cc:1048] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.789320 17039 raft_consensus.cc:1275] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.790498 17218 consensus_queue.cc:1048] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.797511 17112 raft_consensus.cc:1275] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.799060 17176 consensus_queue.cc:1048] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.813998 17039 raft_consensus.cc:3060] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.818117 17039 raft_consensus.cc:1275] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Refusing update from remote peer e467738a24f84b7bb0d451dda890555f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.819183 17201 consensus_queue.cc:1048] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.825773 16964 raft_consensus.cc:1275] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Refusing update from remote peer e467738a24f84b7bb0d451dda890555f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.827050 17200 consensus_queue.cc:1048] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.906910 17039 raft_consensus.cc:1275] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.908083 17176 consensus_queue.cc:1048] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.909973 17039 raft_consensus.cc:1275] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.911120 17176 consensus_queue.cc:1048] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.916307 17112 raft_consensus.cc:1275] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.919086 17176 consensus_queue.cc:1048] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.918830 17112 raft_consensus.cc:1275] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.924826 17218 consensus_queue.cc:1048] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.980955 17114 raft_consensus.cc:1275] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.982182 17248 consensus_queue.cc:1048] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.990422 17040 raft_consensus.cc:1275] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.991968 17248 consensus_queue.cc:1048] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.089476 17040 raft_consensus.cc:1275] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.090544 17248 consensus_queue.cc:1048] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.098819 17114 raft_consensus.cc:1275] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.100541 17248 consensus_queue.cc:1048] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.156610 16964 raft_consensus.cc:1275] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Refusing update from remote peer ca1c4bfd5a414128951fb23cb402b699: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.157701 17160 consensus_queue.cc:1048] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.165485 17114 raft_consensus.cc:1275] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Refusing update from remote peer ca1c4bfd5a414128951fb23cb402b699: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.167565 17211 consensus_queue.cc:1048] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.235994 16329 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:17:34.236728 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:34.258102 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
mode: GRACEFUL
new_leader_uuid: "e467738a24f84b7bb0d451dda890555f"
 from {username='slave'} at 127.0.0.1:48224
I20260709 13:17:34.258594 16964 raft_consensus.cc:606] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Received request to transfer leadership to TS e467738a24f84b7bb0d451dda890555f
I20260709 13:17:34.260823 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
mode: GRACEFUL
new_leader_uuid: "e467738a24f84b7bb0d451dda890555f"
 from {username='slave'} at 127.0.0.1:48224
I20260709 13:17:34.261233 16964 raft_consensus.cc:606] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Received request to transfer leadership to TS e467738a24f84b7bb0d451dda890555f
I20260709 13:17:34.262159 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:34.262591 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:34.470705 17176 raft_consensus.cc:993] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a: : Instructing follower e467738a24f84b7bb0d451dda890555f to start an election
I20260709 13:17:34.471180 17256 raft_consensus.cc:1081] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Signalling peer e467738a24f84b7bb0d451dda890555f to start an election
I20260709 13:17:34.472564 17112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f"
dest_uuid: "e467738a24f84b7bb0d451dda890555f"
 from {username='slave'} at 127.0.0.1:43494
I20260709 13:17:34.473009 17112 raft_consensus.cc:493] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:34.473300 17112 raft_consensus.cc:3060] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.478132 17112 raft_consensus.cc:515] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:34.479646 17112 leader_election.cc:290] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 3 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:34.480412 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:34.480729 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:34.480988 16964 raft_consensus.cc:3055] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:34.481278 17040 raft_consensus.cc:3060] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.481313 16964 raft_consensus.cc:740] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:34.482146 16964 consensus_queue.cc:260] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:34.483016 16964 raft_consensus.cc:3060] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.486136 17040 raft_consensus.cc:2468] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 3.
I20260709 13:17:34.487327 16964 raft_consensus.cc:2468] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 3.
I20260709 13:17:34.487247 17080 leader_election.cc:304] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:34.488366 17255 raft_consensus.cc:2804] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:34.489327 17255 raft_consensus.cc:697] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 3 LEADER]: Becoming Leader. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:34.490077 17255 consensus_queue.cc:237] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:34.496925 16860 catalog_manager.cc:5697] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f reported cstate change: term changed from 2 to 3, leader changed from 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65) to e467738a24f84b7bb0d451dda890555f (127.15.242.67). New cstate: current_term: 3 leader_uuid: "e467738a24f84b7bb0d451dda890555f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.569535 17176 raft_consensus.cc:993] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a: : Instructing follower e467738a24f84b7bb0d451dda890555f to start an election
I20260709 13:17:34.570015 17176 raft_consensus.cc:1081] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Signalling peer e467738a24f84b7bb0d451dda890555f to start an election
I20260709 13:17:34.571600 17112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72"
dest_uuid: "e467738a24f84b7bb0d451dda890555f"
 from {username='slave'} at 127.0.0.1:43494
I20260709 13:17:34.572053 17112 raft_consensus.cc:493] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:34.572412 17112 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.576496 17112 raft_consensus.cc:515] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:34.577828 17112 leader_election.cc:290] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 3 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:34.578665 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:34.578841 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:34.579211 16964 raft_consensus.cc:3055] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:34.579339 17040 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.579545 16964 raft_consensus.cc:740] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:34.580264 16964 consensus_queue.cc:260] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:34.581331 16964 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.585597 17040 raft_consensus.cc:2468] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 3.
I20260709 13:17:34.586668 17080 leader_election.cc:304] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:34.587044 16964 raft_consensus.cc:2468] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 3.
I20260709 13:17:34.587339 17255 raft_consensus.cc:2804] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:34.587812 17255 raft_consensus.cc:697] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 3 LEADER]: Becoming Leader. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:34.588554 17255 consensus_queue.cc:237] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:34.597615 16860 catalog_manager.cc:5697] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f reported cstate change: term changed from 2 to 3, leader changed from 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65) to e467738a24f84b7bb0d451dda890555f (127.15.242.67). New cstate: current_term: 3 leader_uuid: "e467738a24f84b7bb0d451dda890555f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.930555 16964 raft_consensus.cc:1275] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Refusing update from remote peer e467738a24f84b7bb0d451dda890555f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:34.931779 17255 consensus_queue.cc:1048] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:34.940713 17040 raft_consensus.cc:1275] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Refusing update from remote peer e467738a24f84b7bb0d451dda890555f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:34.942675 17261 consensus_queue.cc:1048] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:35.096083 17040 raft_consensus.cc:1275] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Refusing update from remote peer e467738a24f84b7bb0d451dda890555f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:35.097345 17261 consensus_queue.cc:1048] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:35.106935 16964 raft_consensus.cc:1275] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Refusing update from remote peer e467738a24f84b7bb0d451dda890555f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:35.108217 17270 consensus_queue.cc:1048] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:35.263304 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:35.281142 17114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72"
dest_uuid: "e467738a24f84b7bb0d451dda890555f"
mode: GRACEFUL
new_leader_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:43506
I20260709 13:17:35.281725 17114 raft_consensus.cc:606] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 3 LEADER]: Received request to transfer leadership to TS 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:35.286128 17114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f"
dest_uuid: "e467738a24f84b7bb0d451dda890555f"
mode: GRACEFUL
new_leader_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:43506
I20260709 13:17:35.286664 17114 raft_consensus.cc:606] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 3 LEADER]: Received request to transfer leadership to TS 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:35.290886 17040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee3dbba336de444b8b7d99cc9412da65"
dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
mode: GRACEFUL
new_leader_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:56322
I20260709 13:17:35.291359 17040 raft_consensus.cc:606] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Received request to transfer leadership to TS 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:35.295892 17040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de6a767f69af4afc897f144343ff0545"
dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
mode: GRACEFUL
new_leader_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:56322
I20260709 13:17:35.296415 17040 raft_consensus.cc:606] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 2 LEADER]: Received request to transfer leadership to TS 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:35.300657 17040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72"
dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
mode: GRACEFUL
new_leader_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:56322
I20260709 13:17:35.301126 17040 raft_consensus.cc:606] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 2 LEADER]: Received request to transfer leadership to TS 292edd1aea2f4e048e5e49a200779e4a
I20260709 13:17:35.462988 17270 raft_consensus.cc:993] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f: : Instructing follower 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:35.463438 17261 raft_consensus.cc:1081] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 3 LEADER]: Signalling peer 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:35.464847 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:35702
I20260709 13:17:35.465372 16964 raft_consensus.cc:493] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.465721 16964 raft_consensus.cc:3060] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.469980 16964 raft_consensus.cc:515] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.471478 16964 leader_election.cc:290] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 4 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:35.472226 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:35.472515 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40dbf105b3ff4886bf930dc6d3c0f59f" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:35.472805 17040 raft_consensus.cc:3060] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.473030 17114 raft_consensus.cc:3055] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:35.473349 17114 raft_consensus.cc:740] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:35.474234 17114 consensus_queue.cc:260] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.475411 17114 raft_consensus.cc:3060] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.479362 17040 raft_consensus.cc:2468] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 4.
I20260709 13:17:35.480466 16931 leader_election.cc:304] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:35.481209 17276 raft_consensus.cc:2804] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:35.481632 17276 raft_consensus.cc:697] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 4 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:35.481953 17114 raft_consensus.cc:2468] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 4.
I20260709 13:17:35.482457 17276 consensus_queue.cc:237] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.488049 16861 catalog_manager.cc:5697] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 3 to 4, leader changed from e467738a24f84b7bb0d451dda890555f (127.15.242.67) to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 4 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.713761 17270 raft_consensus.cc:993] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f: : Instructing follower 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:35.714241 17261 raft_consensus.cc:1081] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 3 LEADER]: Signalling peer 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:35.715607 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:35702
I20260709 13:17:35.716132 16964 raft_consensus.cc:493] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.716416 16964 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.720335 16964 raft_consensus.cc:515] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.721614 16964 leader_election.cc:290] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 4 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:35.722808 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:35.722806 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:35.723292 17114 raft_consensus.cc:3055] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:35.723558 17040 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.723661 17114 raft_consensus.cc:740] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:35.724527 17114 consensus_queue.cc:260] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.725739 17114 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.729806 17040 raft_consensus.cc:2468] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 4.
I20260709 13:17:35.730779 17114 raft_consensus.cc:2468] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 4.
I20260709 13:17:35.731415 16931 leader_election.cc:304] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, ca1c4bfd5a414128951fb23cb402b699; no voters: 
I20260709 13:17:35.732189 17276 raft_consensus.cc:2804] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:35.732585 17276 raft_consensus.cc:697] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 4 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:35.733314 17276 consensus_queue.cc:237] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.739825 16861 catalog_manager.cc:5697] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 3 to 4, leader changed from e467738a24f84b7bb0d451dda890555f (127.15.242.67) to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 4 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.748399 17260 raft_consensus.cc:993] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699: : Instructing follower 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:35.748762 17281 raft_consensus.cc:1081] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 2 LEADER]: Signalling peer 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:35.750099 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de6a767f69af4afc897f144343ff0545"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:35696
I20260709 13:17:35.750485 16964 raft_consensus.cc:493] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.750734 16964 raft_consensus.cc:3060] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.754474 16964 raft_consensus.cc:515] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.755681 16964 leader_election.cc:290] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 3 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:35.756503 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a767f69af4afc897f144343ff0545" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:35.756846 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a767f69af4afc897f144343ff0545" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:35.757061 17040 raft_consensus.cc:3055] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:35.757329 17114 raft_consensus.cc:3060] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.757421 17040 raft_consensus.cc:740] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:35.758245 17040 consensus_queue.cc:260] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.759364 17040 raft_consensus.cc:3060] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.763284 17114 raft_consensus.cc:2468] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 3.
I20260709 13:17:35.764281 16931 leader_election.cc:304] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:35.764918 17176 raft_consensus.cc:2804] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.765167 17040 raft_consensus.cc:2468] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 3.
I20260709 13:17:35.765405 17176 raft_consensus.cc:697] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 3 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:35.766184 17176 consensus_queue.cc:237] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.772694 16861 catalog_manager.cc:5697] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 2 to 3, leader changed from ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66) to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 3 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.788987 17283 raft_consensus.cc:993] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699: : Instructing follower 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:35.789446 17281 raft_consensus.cc:1081] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 2 LEADER]: Signalling peer 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:35.790844 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:35696
I20260709 13:17:35.791273 16964 raft_consensus.cc:493] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.791567 16964 raft_consensus.cc:3060] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.795608 16964 raft_consensus.cc:515] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.797061 16964 leader_election.cc:290] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 3 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:35.797785 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:35.798159 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:35.798372 17040 raft_consensus.cc:3055] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:35.798647 17114 raft_consensus.cc:3060] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.798650 17040 raft_consensus.cc:740] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:35.799494 17040 consensus_queue.cc:260] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.800544 17040 raft_consensus.cc:3060] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.804616 17114 raft_consensus.cc:2468] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 3.
I20260709 13:17:35.805686 16931 leader_election.cc:304] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:35.806339 17040 raft_consensus.cc:2468] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 3.
I20260709 13:17:35.806461 17176 raft_consensus.cc:2804] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.807080 17176 raft_consensus.cc:697] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 3 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:35.807801 17176 consensus_queue.cc:237] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.814278 16861 catalog_manager.cc:5697] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 2 to 3, leader changed from ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66) to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 3 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.836596 17260 raft_consensus.cc:993] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699: : Instructing follower 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:35.837049 17281 raft_consensus.cc:1081] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Signalling peer 292edd1aea2f4e048e5e49a200779e4a to start an election
I20260709 13:17:35.838383 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee3dbba336de444b8b7d99cc9412da65"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
 from {username='slave'} at 127.0.0.1:35696
I20260709 13:17:35.838829 16964 raft_consensus.cc:493] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.839123 16964 raft_consensus.cc:3060] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.842892 16964 raft_consensus.cc:515] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.844352 16964 leader_election.cc:290] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 election: Requested vote from peers ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:35.845010 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3dbba336de444b8b7d99cc9412da65" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:35.845433 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3dbba336de444b8b7d99cc9412da65" candidate_uuid: "292edd1aea2f4e048e5e49a200779e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:35.845561 17040 raft_consensus.cc:3055] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.845943 17114 raft_consensus.cc:3060] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.845928 17040 raft_consensus.cc:740] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:35.846836 17040 consensus_queue.cc:260] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.847895 17040 raft_consensus.cc:3060] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.851759 17114 raft_consensus.cc:2468] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 2.
I20260709 13:17:35.852707 16931 leader_election.cc:304] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292edd1aea2f4e048e5e49a200779e4a, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:35.853448 17176 raft_consensus.cc:2804] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:35.853643 17040 raft_consensus.cc:2468] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292edd1aea2f4e048e5e49a200779e4a in term 2.
I20260709 13:17:35.853906 17176 raft_consensus.cc:697] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Becoming Leader. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:35.854728 17176 consensus_queue.cc:237] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:35.890054 16861 catalog_manager.cc:5697] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a reported cstate change: term changed from 1 to 2, leader changed from ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66) to 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65). New cstate: current_term: 2 leader_uuid: "292edd1aea2f4e048e5e49a200779e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.895893 17040 raft_consensus.cc:1275] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:35.897840 17276 consensus_queue.cc:1048] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:35.901003 17114 raft_consensus.cc:1275] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:35.904320 17276 consensus_queue.cc:1048] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.129557 17040 raft_consensus.cc:1275] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:36.130787 17176 consensus_queue.cc:1048] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.140343 17114 raft_consensus.cc:1275] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:36.142586 17280 consensus_queue.cc:1048] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:36.226775 17114 raft_consensus.cc:1275] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:36.227928 17280 consensus_queue.cc:1048] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.237601 17040 raft_consensus.cc:1275] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:36.239151 17280 consensus_queue.cc:1048] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.296692 17114 raft_consensus.cc:1275] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.297930 17280 consensus_queue.cc:1048] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.307089 17040 raft_consensus.cc:1275] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.308346 17280 consensus_queue.cc:1048] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.319335 17114 raft_consensus.cc:1275] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:36.320413 17280 consensus_queue.cc:1048] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.329563 17040 raft_consensus.cc:1275] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Refusing update from remote peer 292edd1aea2f4e048e5e49a200779e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:36.331432 17276 consensus_queue.cc:1048] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:38.308949 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:38.316390 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
mode: GRACEFUL
new_leader_uuid: "e467738a24f84b7bb0d451dda890555f"
 from {username='slave'} at 127.0.0.1:48224
I20260709 13:17:38.316975 16964 raft_consensus.cc:606] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Received request to transfer leadership to TS e467738a24f84b7bb0d451dda890555f
I20260709 13:17:38.319434 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
mode: GRACEFUL
new_leader_uuid: "e467738a24f84b7bb0d451dda890555f"
 from {username='slave'} at 127.0.0.1:48224
I20260709 13:17:38.319844 16964 raft_consensus.cc:606] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 4 LEADER]: Received request to transfer leadership to TS e467738a24f84b7bb0d451dda890555f
I20260709 13:17:38.321856 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de6a767f69af4afc897f144343ff0545"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
mode: GRACEFUL
new_leader_uuid: "ca1c4bfd5a414128951fb23cb402b699"
 from {username='slave'} at 127.0.0.1:48224
I20260709 13:17:38.322291 16964 raft_consensus.cc:606] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 3 LEADER]: Received request to transfer leadership to TS ca1c4bfd5a414128951fb23cb402b699
I20260709 13:17:38.324259 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72"
dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
mode: GRACEFUL
new_leader_uuid: "ca1c4bfd5a414128951fb23cb402b699"
 from {username='slave'} at 127.0.0.1:48224
I20260709 13:17:38.324764 16964 raft_consensus.cc:606] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 3 LEADER]: Received request to transfer leadership to TS ca1c4bfd5a414128951fb23cb402b699
I20260709 13:17:38.325663 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:38.326076 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:38.387941 17280 raft_consensus.cc:993] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a: : Instructing follower ca1c4bfd5a414128951fb23cb402b699 to start an election
I20260709 13:17:38.388976 17299 raft_consensus.cc:1081] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 3 LEADER]: Signalling peer ca1c4bfd5a414128951fb23cb402b699 to start an election
I20260709 13:17:38.390551 17040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72"
dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
 from {username='slave'} at 127.0.0.1:56316
I20260709 13:17:38.391063 17040 raft_consensus.cc:493] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.391343 17040 raft_consensus.cc:3060] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.396200 17040 raft_consensus.cc:515] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:38.397608 17040 leader_election.cc:290] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 4 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:38.398514 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:38.398717 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f544d85f55a24b28a284b58b48127c72" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:38.399102 16964 raft_consensus.cc:3055] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:38.399266 17114 raft_consensus.cc:3060] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.399437 16964 raft_consensus.cc:740] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:38.400256 16964 consensus_queue.cc:260] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:38.401355 16964 raft_consensus.cc:3060] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.404480 17114 raft_consensus.cc:2468] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 4.
I20260709 13:17:38.405550 17006 leader_election.cc:304] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:38.406304 16964 raft_consensus.cc:2468] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 4.
I20260709 13:17:38.406374 17281 raft_consensus.cc:2804] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:38.407667 17281 raft_consensus.cc:697] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 4 LEADER]: Becoming Leader. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:38.408465 17281 consensus_queue.cc:237] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:38.414407 16861 catalog_manager.cc:5697] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 reported cstate change: term changed from 3 to 4, leader changed from 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65) to ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66). New cstate: current_term: 4 leader_uuid: "ca1c4bfd5a414128951fb23cb402b699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.529222 17300 raft_consensus.cc:993] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a: : Instructing follower e467738a24f84b7bb0d451dda890555f to start an election
I20260709 13:17:38.529721 17299 raft_consensus.cc:1081] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 4 LEADER]: Signalling peer e467738a24f84b7bb0d451dda890555f to start an election
I20260709 13:17:38.531313 17114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72"
dest_uuid: "e467738a24f84b7bb0d451dda890555f"
 from {username='slave'} at 127.0.0.1:43494
I20260709 13:17:38.531760 17114 raft_consensus.cc:493] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.532032 17114 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:38.536132 17114 raft_consensus.cc:515] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:38.537652 17114 leader_election.cc:290] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 5 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:38.538583 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:38.538671 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e0696aadae411fab2f7aa16109cd72" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:38.539201 16964 raft_consensus.cc:3055] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:38.539269 17040 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:38.539479 16964 raft_consensus.cc:740] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:38.540241 16964 consensus_queue.cc:260] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:38.541018 16964 raft_consensus.cc:3060] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:38.543401 17040 raft_consensus.cc:2468] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 5.
I20260709 13:17:38.544493 17080 leader_election.cc:304] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:38.545009 16964 raft_consensus.cc:2468] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 5.
I20260709 13:17:38.545270 17261 raft_consensus.cc:2804] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:38.546489 17261 raft_consensus.cc:697] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 5 LEADER]: Becoming Leader. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:38.547267 17261 consensus_queue.cc:237] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:38.553561 16861 catalog_manager.cc:5697] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f reported cstate change: term changed from 4 to 5, leader changed from 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65) to e467738a24f84b7bb0d451dda890555f (127.15.242.67). New cstate: current_term: 5 leader_uuid: "e467738a24f84b7bb0d451dda890555f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:38.619557 17300 raft_consensus.cc:993] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a: : Instructing follower e467738a24f84b7bb0d451dda890555f to start an election
I20260709 13:17:38.619997 17299 raft_consensus.cc:1081] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Signalling peer e467738a24f84b7bb0d451dda890555f to start an election
I20260709 13:17:38.621263 17114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25"
dest_uuid: "e467738a24f84b7bb0d451dda890555f"
 from {username='slave'} at 127.0.0.1:43494
I20260709 13:17:38.621685 17114 raft_consensus.cc:493] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.622011 17114 raft_consensus.cc:3060] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.625944 17114 raft_consensus.cc:515] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:38.627327 17114 leader_election.cc:290] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 3 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66:44429)
I20260709 13:17:38.628022 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:38.628364 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a48a385ed8b4d7aa4359dcb2f2dbb25" candidate_uuid: "e467738a24f84b7bb0d451dda890555f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
I20260709 13:17:38.628515 16964 raft_consensus.cc:3055] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:38.628823 16964 raft_consensus.cc:740] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:38.628854 17040 raft_consensus.cc:3060] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.629508 16964 consensus_queue.cc:260] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:38.630398 16964 raft_consensus.cc:3060] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.632962 17040 raft_consensus.cc:2468] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 3.
I20260709 13:17:38.633847 17080 leader_election.cc:304] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:38.634397 16964 raft_consensus.cc:2468] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e467738a24f84b7bb0d451dda890555f in term 3.
I20260709 13:17:38.634696 17261 raft_consensus.cc:2804] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:38.635218 17261 raft_consensus.cc:697] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 3 LEADER]: Becoming Leader. State: Replica: e467738a24f84b7bb0d451dda890555f, State: Running, Role: LEADER
I20260709 13:17:38.635998 17261 consensus_queue.cc:237] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:38.643033 16861 catalog_manager.cc:5697] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f reported cstate change: term changed from 2 to 3, leader changed from 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65) to e467738a24f84b7bb0d451dda890555f (127.15.242.67). New cstate: current_term: 3 leader_uuid: "e467738a24f84b7bb0d451dda890555f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:38.703915 17300 raft_consensus.cc:993] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a: : Instructing follower ca1c4bfd5a414128951fb23cb402b699 to start an election
I20260709 13:17:38.704308 17299 raft_consensus.cc:1081] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 3 LEADER]: Signalling peer ca1c4bfd5a414128951fb23cb402b699 to start an election
I20260709 13:17:38.705593 17040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de6a767f69af4afc897f144343ff0545"
dest_uuid: "ca1c4bfd5a414128951fb23cb402b699"
 from {username='slave'} at 127.0.0.1:56316
I20260709 13:17:38.705981 17040 raft_consensus.cc:493] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.706229 17040 raft_consensus.cc:3060] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.710486 17040 raft_consensus.cc:515] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:38.711930 17040 leader_election.cc:290] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 4 election: Requested vote from peers 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881), e467738a24f84b7bb0d451dda890555f (127.15.242.67:40605)
I20260709 13:17:38.712636 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a767f69af4afc897f144343ff0545" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "292edd1aea2f4e048e5e49a200779e4a"
I20260709 13:17:38.712885 17114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a767f69af4afc897f144343ff0545" candidate_uuid: "ca1c4bfd5a414128951fb23cb402b699" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e467738a24f84b7bb0d451dda890555f"
I20260709 13:17:38.713119 16964 raft_consensus.cc:3055] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:38.713390 17114 raft_consensus.cc:3060] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.713390 16964 raft_consensus.cc:740] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 292edd1aea2f4e048e5e49a200779e4a, State: Running, Role: LEADER
I20260709 13:17:38.714325 16964 consensus_queue.cc:260] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:38.715149 16964 raft_consensus.cc:3060] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.717490 17114 raft_consensus.cc:2468] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 4.
I20260709 13:17:38.718369 17006 leader_election.cc:304] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca1c4bfd5a414128951fb23cb402b699, e467738a24f84b7bb0d451dda890555f; no voters: 
I20260709 13:17:38.719077 17281 raft_consensus.cc:2804] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:38.719475 16964 raft_consensus.cc:2468] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c4bfd5a414128951fb23cb402b699 in term 4.
I20260709 13:17:38.719492 17281 raft_consensus.cc:697] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 4 LEADER]: Becoming Leader. State: Replica: ca1c4bfd5a414128951fb23cb402b699, State: Running, Role: LEADER
I20260709 13:17:38.720474 17281 consensus_queue.cc:237] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } }
I20260709 13:17:38.727231 16861 catalog_manager.cc:5697] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 reported cstate change: term changed from 3 to 4, leader changed from 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65) to ca1c4bfd5a414128951fb23cb402b699 (127.15.242.66). New cstate: current_term: 4 leader_uuid: "ca1c4bfd5a414128951fb23cb402b699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.802289 17114 raft_consensus.cc:1275] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Refusing update from remote peer ca1c4bfd5a414128951fb23cb402b699: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:38.803550 17281 consensus_queue.cc:1048] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:38.803748 16964 raft_consensus.cc:1275] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Refusing update from remote peer ca1c4bfd5a414128951fb23cb402b699: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:38.804953 17281 consensus_queue.cc:1048] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:38.942098 17040 raft_consensus.cc:1275] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 5 FOLLOWER]: Refusing update from remote peer e467738a24f84b7bb0d451dda890555f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:38.943310 17261 consensus_queue.cc:1048] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:38.951771 16964 raft_consensus.cc:1275] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 5 FOLLOWER]: Refusing update from remote peer e467738a24f84b7bb0d451dda890555f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:38.954188 17307 consensus_queue.cc:1048] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:39.063297 17040 raft_consensus.cc:1275] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Refusing update from remote peer e467738a24f84b7bb0d451dda890555f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:39.064399 17307 consensus_queue.cc:1048] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c4bfd5a414128951fb23cb402b699" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:39.074286 16964 raft_consensus.cc:1275] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Refusing update from remote peer e467738a24f84b7bb0d451dda890555f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:39.075654 17318 consensus_queue.cc:1048] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:39.208439 17114 raft_consensus.cc:1275] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Refusing update from remote peer ca1c4bfd5a414128951fb23cb402b699: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:39.209583 17314 consensus_queue.cc:1048] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e467738a24f84b7bb0d451dda890555f" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:39.218113 16964 raft_consensus.cc:1275] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Refusing update from remote peer ca1c4bfd5a414128951fb23cb402b699: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:39.219543 17301 consensus_queue.cc:1048] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "292edd1aea2f4e048e5e49a200779e4a" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:39.326889 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:39.335500 16329 tablet_server.cc:179] TabletServer@127.15.242.65:0 shutting down...
I20260709 13:17:39.361284 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:39.361887 16329 tablet_replica.cc:333] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a: stopping tablet replica
I20260709 13:17:39.362824 16329 raft_consensus.cc:2243] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.363260 16329 raft_consensus.cc:2272] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P 292edd1aea2f4e048e5e49a200779e4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.365485 16329 tablet_replica.cc:333] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a: stopping tablet replica
I20260709 13:17:39.365947 16329 raft_consensus.cc:2243] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.366395 16329 raft_consensus.cc:2272] T f5d19d8de82e4e3d8ef07688f87dfbc4 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.367993 16329 tablet_replica.cc:333] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a: stopping tablet replica
I20260709 13:17:39.368431 16329 raft_consensus.cc:2243] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.368809 16329 raft_consensus.cc:2272] T f544d85f55a24b28a284b58b48127c72 P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.370865 16329 tablet_replica.cc:333] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a: stopping tablet replica
I20260709 13:17:39.371363 16329 raft_consensus.cc:2243] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:39.372040 16329 raft_consensus.cc:2272] T e8bc1265ff53457ebe0bc964db347748 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.373560 16329 tablet_replica.cc:333] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a: stopping tablet replica
I20260709 13:17:39.374164 16329 raft_consensus.cc:2243] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:39.374830 16329 raft_consensus.cc:2272] T ee3dbba336de444b8b7d99cc9412da65 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.376345 16329 tablet_replica.cc:333] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a: stopping tablet replica
I20260709 13:17:39.376783 16329 raft_consensus.cc:2243] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:39.377369 16329 raft_consensus.cc:2272] T 40dbf105b3ff4886bf930dc6d3c0f59f P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.378856 16329 tablet_replica.cc:333] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a: stopping tablet replica
I20260709 13:17:39.379276 16329 raft_consensus.cc:2243] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.379635 16329 raft_consensus.cc:2272] T 5e0ca61a18c447d782fb606388d14c65 P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.381201 16329 tablet_replica.cc:333] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a: stopping tablet replica
I20260709 13:17:39.381590 16329 raft_consensus.cc:2243] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.381908 16329 raft_consensus.cc:2272] T 64e0696aadae411fab2f7aa16109cd72 P 292edd1aea2f4e048e5e49a200779e4a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.383796 16329 tablet_replica.cc:333] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a: stopping tablet replica
I20260709 13:17:39.384207 16329 raft_consensus.cc:2243] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.384655 16329 raft_consensus.cc:2272] T de6a767f69af4afc897f144343ff0545 P 292edd1aea2f4e048e5e49a200779e4a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.387458 16329 tablet_replica.cc:333] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a: stopping tablet replica
I20260709 13:17:39.387962 16329 raft_consensus.cc:2243] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:39.388756 16329 raft_consensus.cc:2272] T 883019cb720f42ff97fee10ee735c4db P 292edd1aea2f4e048e5e49a200779e4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.410593 16329 tablet_server.cc:196] TabletServer@127.15.242.65:0 shutdown complete.
I20260709 13:17:39.430841 16329 tablet_server.cc:179] TabletServer@127.15.242.66:0 shutting down...
W20260709 13:17:39.451627 17079 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.65:43881: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260709 13:17:39.456460 17079 consensus_peers.cc:597] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f -> Peer 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881): Couldn't send request to peer 292edd1aea2f4e048e5e49a200779e4a. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:43881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:39.458454 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:39.459067 16329 tablet_replica.cc:333] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699: stopping tablet replica
I20260709 13:17:39.459594 16329 raft_consensus.cc:2243] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:39.460285 16329 raft_consensus.cc:2272] T f544d85f55a24b28a284b58b48127c72 P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.462242 16329 tablet_replica.cc:333] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699: stopping tablet replica
I20260709 13:17:39.462764 16329 raft_consensus.cc:2243] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:39.463465 16329 raft_consensus.cc:2272] T de6a767f69af4afc897f144343ff0545 P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.465293 16329 tablet_replica.cc:333] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699: stopping tablet replica
I20260709 13:17:39.465782 16329 raft_consensus.cc:2243] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.466214 16329 raft_consensus.cc:2272] T 40dbf105b3ff4886bf930dc6d3c0f59f P ca1c4bfd5a414128951fb23cb402b699 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.467785 16329 tablet_replica.cc:333] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699: stopping tablet replica
I20260709 13:17:39.468281 16329 raft_consensus.cc:2243] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.468667 16329 raft_consensus.cc:2272] T ee3dbba336de444b8b7d99cc9412da65 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.470245 16329 tablet_replica.cc:333] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699: stopping tablet replica
I20260709 13:17:39.470711 16329 raft_consensus.cc:2243] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.471112 16329 raft_consensus.cc:2272] T 883019cb720f42ff97fee10ee735c4db P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.472586 16329 tablet_replica.cc:333] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699: stopping tablet replica
I20260709 13:17:39.473037 16329 raft_consensus.cc:2243] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:39.473778 16329 raft_consensus.cc:2272] T f5d19d8de82e4e3d8ef07688f87dfbc4 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.475502 16329 tablet_replica.cc:333] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699: stopping tablet replica
I20260709 13:17:39.476032 16329 raft_consensus.cc:2243] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.476421 16329 raft_consensus.cc:2272] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P ca1c4bfd5a414128951fb23cb402b699 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.478194 16329 tablet_replica.cc:333] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699: stopping tablet replica
I20260709 13:17:39.478677 16329 raft_consensus.cc:2243] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.479070 16329 raft_consensus.cc:2272] T e8bc1265ff53457ebe0bc964db347748 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.480594 16329 tablet_replica.cc:333] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699: stopping tablet replica
I20260709 13:17:39.481010 16329 raft_consensus.cc:2243] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.481371 16329 raft_consensus.cc:2272] T 5e0ca61a18c447d782fb606388d14c65 P ca1c4bfd5a414128951fb23cb402b699 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.482851 16329 tablet_replica.cc:333] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699: stopping tablet replica
I20260709 13:17:39.483260 16329 raft_consensus.cc:2243] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.483688 16329 raft_consensus.cc:2272] T 64e0696aadae411fab2f7aa16109cd72 P ca1c4bfd5a414128951fb23cb402b699 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:39.493927 17079 consensus_peers.cc:597] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f -> Peer 292edd1aea2f4e048e5e49a200779e4a (127.15.242.65:43881): Couldn't send request to peer 292edd1aea2f4e048e5e49a200779e4a. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:43881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:39.513700 16329 tablet_server.cc:196] TabletServer@127.15.242.66:0 shutdown complete.
I20260709 13:17:39.530882 16329 tablet_server.cc:179] TabletServer@127.15.242.67:0 shutting down...
I20260709 13:17:39.553391 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:39.554003 16329 tablet_replica.cc:333] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f: stopping tablet replica
I20260709 13:17:39.554661 16329 raft_consensus.cc:2243] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.555157 16329 raft_consensus.cc:2272] T f544d85f55a24b28a284b58b48127c72 P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.557435 16329 tablet_replica.cc:333] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f: stopping tablet replica
I20260709 13:17:39.557943 16329 raft_consensus.cc:2243] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.558434 16329 raft_consensus.cc:2272] T de6a767f69af4afc897f144343ff0545 P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.560369 16329 tablet_replica.cc:333] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f: stopping tablet replica
I20260709 13:17:39.560884 16329 raft_consensus.cc:2243] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:39.561576 16329 raft_consensus.cc:2272] T 5e0ca61a18c447d782fb606388d14c65 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.563556 16329 tablet_replica.cc:333] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f: stopping tablet replica
I20260709 13:17:39.564181 16329 raft_consensus.cc:2243] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:17:39.564810 16329 raft_consensus.cc:2272] T 64e0696aadae411fab2f7aa16109cd72 P e467738a24f84b7bb0d451dda890555f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.566442 16329 tablet_replica.cc:333] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f: stopping tablet replica
I20260709 13:17:39.566885 16329 raft_consensus.cc:2243] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.567235 16329 raft_consensus.cc:2272] T ee3dbba336de444b8b7d99cc9412da65 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.568622 16329 tablet_replica.cc:333] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f: stopping tablet replica
I20260709 13:17:39.569031 16329 raft_consensus.cc:2243] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.569379 16329 raft_consensus.cc:2272] T e8bc1265ff53457ebe0bc964db347748 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.570818 16329 tablet_replica.cc:333] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f: stopping tablet replica
I20260709 13:17:39.571218 16329 raft_consensus.cc:2243] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.571543 16329 raft_consensus.cc:2272] T 40dbf105b3ff4886bf930dc6d3c0f59f P e467738a24f84b7bb0d451dda890555f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.572999 16329 tablet_replica.cc:333] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f: stopping tablet replica
I20260709 13:17:39.573398 16329 raft_consensus.cc:2243] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.573797 16329 raft_consensus.cc:2272] T 883019cb720f42ff97fee10ee735c4db P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.575434 16329 tablet_replica.cc:333] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f: stopping tablet replica
I20260709 13:17:39.575873 16329 raft_consensus.cc:2243] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.576263 16329 raft_consensus.cc:2272] T f5d19d8de82e4e3d8ef07688f87dfbc4 P e467738a24f84b7bb0d451dda890555f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.577771 16329 tablet_replica.cc:333] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f: stopping tablet replica
I20260709 13:17:39.578253 16329 raft_consensus.cc:2243] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:39.578941 16329 raft_consensus.cc:2272] T 0a48a385ed8b4d7aa4359dcb2f2dbb25 P e467738a24f84b7bb0d451dda890555f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.605800 16329 tablet_server.cc:196] TabletServer@127.15.242.67:0 shutdown complete.
I20260709 13:17:39.623361 16329 master.cc:562] Master@127.15.242.126:34059 shutting down...
I20260709 13:17:39.642352 16329 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:39.642889 16329 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.643260 16329 tablet_replica.cc:333] T 00000000000000000000000000000000 P d92c2dfb79eb485c8b034baa3b86b114: stopping tablet replica
I20260709 13:17:39.663455 16329 master.cc:584] Master@127.15.242.126:34059 shutdown complete.
292edd1aea2f4e048e5e49a200779e4a  5
ca1c4bfd5a414128951fb23cb402b699  4
e467738a24f84b7bb0d451dda890555f  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10753 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:17:39.701790 16329 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.242.126:39589
I20260709 13:17:39.703008 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:39.708539 17328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:39.708559 17327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:39.716077 16329 server_base.cc:1061] running on GCE node
W20260709 13:17:39.716099 17330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:39.717175 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:39.717355 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:39.717556 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603059717523 us; error 0 us; skew 500 ppm
I20260709 13:17:39.718153 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:39.720450 16329 webserver.cc:533] Webserver started at http://127.15.242.126:41547/ using document root <none> and password file <none>
I20260709 13:17:39.720927 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:39.721112 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:39.721406 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:39.722625 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/master-0-root/instance:
uuid: "c6b0d42b8daf43a291946b809079b0d7"
format_stamp: "Formatted at 2026-07-09 13:17:39 on dist-test-slave-fh5z"
I20260709 13:17:39.726899 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:17:39.729984 17335 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.730671 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:17:39.730959 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/master-0-root
uuid: "c6b0d42b8daf43a291946b809079b0d7"
format_stamp: "Formatted at 2026-07-09 13:17:39 on dist-test-slave-fh5z"
I20260709 13:17:39.731220 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:39.750662 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:39.751886 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:39.789600 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.126:39589
I20260709 13:17:39.789697 17386 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.126:39589 every 8 connection(s)
I20260709 13:17:39.793589 17387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.803535 17387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Bootstrap starting.
I20260709 13:17:39.808120 17387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:39.812144 17387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: No bootstrap required, opened a new log
I20260709 13:17:39.814193 17387 raft_consensus.cc:359] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6b0d42b8daf43a291946b809079b0d7" member_type: VOTER }
I20260709 13:17:39.814579 17387 raft_consensus.cc:385] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:39.814754 17387 raft_consensus.cc:740] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6b0d42b8daf43a291946b809079b0d7, State: Initialized, Role: FOLLOWER
I20260709 13:17:39.815331 17387 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6b0d42b8daf43a291946b809079b0d7" member_type: VOTER }
I20260709 13:17:39.815735 17387 raft_consensus.cc:399] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:39.815924 17387 raft_consensus.cc:493] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:39.816121 17387 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:39.820132 17387 raft_consensus.cc:515] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6b0d42b8daf43a291946b809079b0d7" member_type: VOTER }
I20260709 13:17:39.820583 17387 leader_election.cc:304] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6b0d42b8daf43a291946b809079b0d7; no voters: 
I20260709 13:17:39.821691 17387 leader_election.cc:290] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:39.822160 17390 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:39.823503 17390 raft_consensus.cc:697] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [term 1 LEADER]: Becoming Leader. State: Replica: c6b0d42b8daf43a291946b809079b0d7, State: Running, Role: LEADER
I20260709 13:17:39.824177 17390 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6b0d42b8daf43a291946b809079b0d7" member_type: VOTER }
I20260709 13:17:39.824762 17387 sys_catalog.cc:565] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:39.829541 17391 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6b0d42b8daf43a291946b809079b0d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6b0d42b8daf43a291946b809079b0d7" member_type: VOTER } }
I20260709 13:17:39.829464 17392 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6b0d42b8daf43a291946b809079b0d7. Latest consensus state: current_term: 1 leader_uuid: "c6b0d42b8daf43a291946b809079b0d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6b0d42b8daf43a291946b809079b0d7" member_type: VOTER } }
I20260709 13:17:39.830216 17391 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:39.830240 17392 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:39.834928 17398 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:39.840770 17398 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:39.841795 16329 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:39.850086 17398 catalog_manager.cc:1383] Generated new cluster ID: 8c08dcedc8264e4b8c6f759094c12de5
I20260709 13:17:39.850404 17398 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:39.877468 17398 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:39.878851 17398 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:39.906679 17398 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Generated new TSK 0
I20260709 13:17:39.907392 17398 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:39.972677 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:39.978672 17408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:39.979921 17409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:39.981534 17411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:39.982246 16329 server_base.cc:1061] running on GCE node
I20260709 13:17:39.983441 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:39.983616 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:39.983734 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603059983723 us; error 0 us; skew 500 ppm
I20260709 13:17:39.984200 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:39.986424 16329 webserver.cc:533] Webserver started at http://127.15.242.65:35897/ using document root <none> and password file <none>
I20260709 13:17:39.986871 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:39.987022 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:39.987246 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:39.988287 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/instance:
uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
format_stamp: "Formatted at 2026-07-09 13:17:39 on dist-test-slave-fh5z"
I20260709 13:17:39.992763 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:17:39.995945 17416 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.996686 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:17:39.996996 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root
uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
format_stamp: "Formatted at 2026-07-09 13:17:39 on dist-test-slave-fh5z"
I20260709 13:17:39.997282 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:40.015189 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:40.016417 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:40.017825 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:40.020063 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:40.020282 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:40.020553 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:40.020750 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:40.061345 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.65:36303
I20260709 13:17:40.061470 17478 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.65:36303 every 8 connection(s)
I20260709 13:17:40.066541 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:40.074451 17483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:40.074409 17484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:40.076086 17486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:40.077046 16329 server_base.cc:1061] running on GCE node
I20260709 13:17:40.078219 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:40.078472 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:40.078670 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603060078652 us; error 0 us; skew 500 ppm
I20260709 13:17:40.079391 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:40.080734 17479 heartbeater.cc:344] Connected to a master server at 127.15.242.126:39589
I20260709 13:17:40.081149 17479 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:40.081941 17479 heartbeater.cc:507] Master 127.15.242.126:39589 requested a full tablet report, sending...
I20260709 13:17:40.082197 16329 webserver.cc:533] Webserver started at http://127.15.242.66:36543/ using document root <none> and password file <none>
I20260709 13:17:40.082751 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:40.082996 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:40.083320 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:40.084399 17352 ts_manager.cc:194] Registered new tserver with Master: 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
I20260709 13:17:40.084794 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/instance:
uuid: "ddfe9cca0741489b994f8b0178c54fe7"
format_stamp: "Formatted at 2026-07-09 13:17:40 on dist-test-slave-fh5z"
I20260709 13:17:40.086859 17352 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40488
I20260709 13:17:40.090201 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:17:40.093348 17491 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:40.094148 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:40.094400 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root
uuid: "ddfe9cca0741489b994f8b0178c54fe7"
format_stamp: "Formatted at 2026-07-09 13:17:40 on dist-test-slave-fh5z"
I20260709 13:17:40.094633 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:40.105242 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:40.106419 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:40.107746 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:40.109879 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:40.110144 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:40.110407 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:40.110565 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:40.149585 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.66:40943
I20260709 13:17:40.149682 17553 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.66:40943 every 8 connection(s)
I20260709 13:17:40.154294 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:40.161149 17557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:40.162456 17558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:40.165182 16329 server_base.cc:1061] running on GCE node
I20260709 13:17:40.166186 17554 heartbeater.cc:344] Connected to a master server at 127.15.242.126:39589
W20260709 13:17:40.166272 17560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:40.166610 17554 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:40.167268 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:40.167382 17554 heartbeater.cc:507] Master 127.15.242.126:39589 requested a full tablet report, sending...
W20260709 13:17:40.167528 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:40.167773 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603060167748 us; error 0 us; skew 500 ppm
I20260709 13:17:40.168325 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:40.169600 17352 ts_manager.cc:194] Registered new tserver with Master: ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:40.170982 17352 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40498
I20260709 13:17:40.171025 16329 webserver.cc:533] Webserver started at http://127.15.242.67:38863/ using document root <none> and password file <none>
I20260709 13:17:40.171576 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:40.171792 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:40.172086 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:40.173575 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/instance:
uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
format_stamp: "Formatted at 2026-07-09 13:17:40 on dist-test-slave-fh5z"
I20260709 13:17:40.177826 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:17:40.180943 17565 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:40.181655 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:40.181900 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root
uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
format_stamp: "Formatted at 2026-07-09 13:17:40 on dist-test-slave-fh5z"
I20260709 13:17:40.182214 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:40.204236 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:40.205461 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:40.206828 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:40.209065 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:40.209249 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:40.209564 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:40.209724 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:40.248813 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.67:36581
I20260709 13:17:40.248914 17627 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.67:36581 every 8 connection(s)
I20260709 13:17:40.262472 17628 heartbeater.cc:344] Connected to a master server at 127.15.242.126:39589
I20260709 13:17:40.262796 17628 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:40.263428 17628 heartbeater.cc:507] Master 127.15.242.126:39589 requested a full tablet report, sending...
I20260709 13:17:40.265271 17352 ts_manager.cc:194] Registered new tserver with Master: abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:40.265424 16329 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013413246s
I20260709 13:17:40.266634 17352 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40508
I20260709 13:17:40.290182 17352 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40520:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:40.296345 17352 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:40.490731 17444 tablet_service.cc:1511] Processing CreateTablet for tablet 0c6864e5b711423291c531e98224c311 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:40.490986 17443 tablet_service.cc:1511] Processing CreateTablet for tablet 7002e0c7a3624420a1737b1fb29d8142 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:40.492185 17444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c6864e5b711423291c531e98224c311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.493373 17593 tablet_service.cc:1511] Processing CreateTablet for tablet 0c6864e5b711423291c531e98224c311 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:40.494678 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c6864e5b711423291c531e98224c311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.500741 17592 tablet_service.cc:1511] Processing CreateTablet for tablet 7002e0c7a3624420a1737b1fb29d8142 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:40.502161 17592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7002e0c7a3624420a1737b1fb29d8142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.501981 17591 tablet_service.cc:1511] Processing CreateTablet for tablet 262981f7c32f49709e3a56b85e75ffcf (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:40.504510 17591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262981f7c32f49709e3a56b85e75ffcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.507912 17590 tablet_service.cc:1511] Processing CreateTablet for tablet 3dfacd1c614b49b290b54a86d3270339 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:40.509231 17590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dfacd1c614b49b290b54a86d3270339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.512192 17441 tablet_service.cc:1511] Processing CreateTablet for tablet 3dfacd1c614b49b290b54a86d3270339 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:40.512575 17440 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2d603d87b8422dad32dfbb77b7e95c (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:40.513648 17441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dfacd1c614b49b290b54a86d3270339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.513290 17442 tablet_service.cc:1511] Processing CreateTablet for tablet 262981f7c32f49709e3a56b85e75ffcf (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:40.514727 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262981f7c32f49709e3a56b85e75ffcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.514783 17439 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3434da716f41f0bc0eb393a53152ed (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:40.515218 17589 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2d603d87b8422dad32dfbb77b7e95c (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:40.516244 17439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3434da716f41f0bc0eb393a53152ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.516551 17589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2d603d87b8422dad32dfbb77b7e95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.518493 17443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7002e0c7a3624420a1737b1fb29d8142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.519152 17438 tablet_service.cc:1511] Processing CreateTablet for tablet 545b345ea8d04e8daea29d4a4f6477a9 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:40.520490 17438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 545b345ea8d04e8daea29d4a4f6477a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.520340 17588 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3434da716f41f0bc0eb393a53152ed (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:40.521698 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3434da716f41f0bc0eb393a53152ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.521663 17440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2d603d87b8422dad32dfbb77b7e95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.527540 17518 tablet_service.cc:1511] Processing CreateTablet for tablet 7002e0c7a3624420a1737b1fb29d8142 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:40.529273 17518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7002e0c7a3624420a1737b1fb29d8142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.525380 17519 tablet_service.cc:1511] Processing CreateTablet for tablet 0c6864e5b711423291c531e98224c311 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:40.534451 17519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c6864e5b711423291c531e98224c311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.550172 17587 tablet_service.cc:1511] Processing CreateTablet for tablet 545b345ea8d04e8daea29d4a4f6477a9 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:40.552896 17587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 545b345ea8d04e8daea29d4a4f6477a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.553056 17437 tablet_service.cc:1511] Processing CreateTablet for tablet 2773182c45284396b8fd0513eb349cc4 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:40.554983 17437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2773182c45284396b8fd0513eb349cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.559652 17517 tablet_service.cc:1511] Processing CreateTablet for tablet 262981f7c32f49709e3a56b85e75ffcf (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:40.561026 17517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262981f7c32f49709e3a56b85e75ffcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.563808 17516 tablet_service.cc:1511] Processing CreateTablet for tablet 3dfacd1c614b49b290b54a86d3270339 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:40.565224 17516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dfacd1c614b49b290b54a86d3270339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.571159 17515 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2d603d87b8422dad32dfbb77b7e95c (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:40.572589 17515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2d603d87b8422dad32dfbb77b7e95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.580256 17513 tablet_service.cc:1511] Processing CreateTablet for tablet 545b345ea8d04e8daea29d4a4f6477a9 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:40.580497 17512 tablet_service.cc:1511] Processing CreateTablet for tablet 2773182c45284396b8fd0513eb349cc4 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:40.580389 17514 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3434da716f41f0bc0eb393a53152ed (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:40.581825 17513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 545b345ea8d04e8daea29d4a4f6477a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.586347 17512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2773182c45284396b8fd0513eb349cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.590934 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3434da716f41f0bc0eb393a53152ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.590633 17441 tablet_service.cc:1511] Processing CreateTablet for tablet 810ba5585281416bb8f23e88267d049b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:40.591907 17441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 810ba5585281416bb8f23e88267d049b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.591670 17586 tablet_service.cc:1511] Processing CreateTablet for tablet 2773182c45284396b8fd0513eb349cc4 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:40.599785 17586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2773182c45284396b8fd0513eb349cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.597744 17511 tablet_service.cc:1511] Processing CreateTablet for tablet 810ba5585281416bb8f23e88267d049b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:40.619887 17511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 810ba5585281416bb8f23e88267d049b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.643194 17585 tablet_service.cc:1511] Processing CreateTablet for tablet 810ba5585281416bb8f23e88267d049b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:40.647130 17645 tablet_bootstrap.cc:492] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:40.648392 17437 tablet_service.cc:1511] Processing CreateTablet for tablet 0c221353c2c64e8b96d73953eebea083 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:40.649760 17437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c221353c2c64e8b96d73953eebea083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.650626 17516 tablet_service.cc:1511] Processing CreateTablet for tablet 0c221353c2c64e8b96d73953eebea083 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:40.651932 17516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c221353c2c64e8b96d73953eebea083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.658591 17585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 810ba5585281416bb8f23e88267d049b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.686983 17645 tablet_bootstrap.cc:654] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.697693 17584 tablet_service.cc:1511] Processing CreateTablet for tablet 0c221353c2c64e8b96d73953eebea083 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:40.699107 17584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c221353c2c64e8b96d73953eebea083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.720160 17515 tablet_service.cc:1511] Processing CreateTablet for tablet d0843b162ea34017b0c1243e97245db9 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:40.722218 17515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0843b162ea34017b0c1243e97245db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.722797 17644 tablet_bootstrap.cc:492] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:40.738711 17591 tablet_service.cc:1511] Processing CreateTablet for tablet d0843b162ea34017b0c1243e97245db9 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:40.740038 17591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0843b162ea34017b0c1243e97245db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.740075 17442 tablet_service.cc:1511] Processing CreateTablet for tablet 4022f7d9b64e45d18be29fda16f3ecde (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:40.741407 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4022f7d9b64e45d18be29fda16f3ecde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.743448 17593 tablet_service.cc:1511] Processing CreateTablet for tablet 4022f7d9b64e45d18be29fda16f3ecde (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:40.744868 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4022f7d9b64e45d18be29fda16f3ecde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.748966 17644 tablet_bootstrap.cc:654] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.751144 17517 tablet_service.cc:1511] Processing CreateTablet for tablet 4022f7d9b64e45d18be29fda16f3ecde (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:40.754954 17437 tablet_service.cc:1511] Processing CreateTablet for tablet e57fe371976a485bbdedfdaa4659dec3 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:40.756513 17513 tablet_service.cc:1511] Processing CreateTablet for tablet e57fe371976a485bbdedfdaa4659dec3 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:40.772611 17440 tablet_service.cc:1511] Processing CreateTablet for tablet 0c198fb42e5b400c91f60d6969641780 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:40.773481 17645 tablet_bootstrap.cc:492] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:40.773998 17645 ts_tablet_manager.cc:1403] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.127s	user 0.021s	sys 0.018s
I20260709 13:17:40.774765 17643 tablet_bootstrap.cc:492] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:40.774333 17591 tablet_service.cc:1511] Processing CreateTablet for tablet e57fe371976a485bbdedfdaa4659dec3 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:40.776552 17591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57fe371976a485bbdedfdaa4659dec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.777280 17645 raft_consensus.cc:359] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:40.778921 17517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4022f7d9b64e45d18be29fda16f3ecde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.801366 17643 tablet_bootstrap.cc:654] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.802196 17514 tablet_service.cc:1511] Processing CreateTablet for tablet 0c198fb42e5b400c91f60d6969641780 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:40.803629 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c198fb42e5b400c91f60d6969641780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.779515 17444 tablet_service.cc:1511] Processing CreateTablet for tablet d0843b162ea34017b0c1243e97245db9 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:40.804574 17513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57fe371976a485bbdedfdaa4659dec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.815492 17444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0843b162ea34017b0c1243e97245db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.815819 17442 tablet_service.cc:1511] Processing CreateTablet for tablet dd986037a248442489c77e1aed466117 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:40.817253 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd986037a248442489c77e1aed466117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.818413 17645 raft_consensus.cc:385] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.818851 17645 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.820003 17645 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:40.822600 17554 heartbeater.cc:499] Master 127.15.242.126:39589 was elected leader, sending a full tablet report...
I20260709 13:17:40.823494 17593 tablet_service.cc:1511] Processing CreateTablet for tablet 0c198fb42e5b400c91f60d6969641780 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:40.824898 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c198fb42e5b400c91f60d6969641780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.825881 17644 tablet_bootstrap.cc:492] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:40.826344 17437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57fe371976a485bbdedfdaa4659dec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.826432 17644 ts_tablet_manager.cc:1403] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.004s
I20260709 13:17:40.829622 17644 raft_consensus.cc:359] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:40.830454 17644 raft_consensus.cc:385] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.830783 17644 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
W20260709 13:17:40.835669 17400 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:40.837992 17511 tablet_service.cc:1511] Processing CreateTablet for tablet dd986037a248442489c77e1aed466117 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:40.839459 17511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd986037a248442489c77e1aed466117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.840157 17644 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:40.844269 17645 ts_tablet_manager.cc:1434] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.002s
I20260709 13:17:40.845304 17645 tablet_bootstrap.cc:492] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:40.848227 17440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c198fb42e5b400c91f60d6969641780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.849406 17588 tablet_service.cc:1511] Processing CreateTablet for tablet dd986037a248442489c77e1aed466117 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:40.852344 17644 ts_tablet_manager.cc:1434] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:17:40.852547 17443 tablet_service.cc:1511] Processing CreateTablet for tablet 6b44f8d5d5454fb7af9630783cd02def (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:40.856770 17517 tablet_service.cc:1511] Processing CreateTablet for tablet 6b44f8d5d5454fb7af9630783cd02def (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:40.857404 17628 heartbeater.cc:499] Master 127.15.242.126:39589 was elected leader, sending a full tablet report...
I20260709 13:17:40.863317 17443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b44f8d5d5454fb7af9630783cd02def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.865643 17517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b44f8d5d5454fb7af9630783cd02def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.869454 17643 tablet_bootstrap.cc:492] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:40.858064 17585 tablet_service.cc:1511] Processing CreateTablet for tablet 6b44f8d5d5454fb7af9630783cd02def (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:40.870223 17643 ts_tablet_manager.cc:1403] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.096s	user 0.018s	sys 0.018s
I20260709 13:17:40.874914 17643 raft_consensus.cc:359] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:17:40.875695 17643 raft_consensus.cc:385] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.876048 17643 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.876950 17643 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:17:40.878494 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd986037a248442489c77e1aed466117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.879004 17644 tablet_bootstrap.cc:492] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:40.882670 17585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b44f8d5d5454fb7af9630783cd02def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.884488 17645 tablet_bootstrap.cc:654] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.892572 17644 tablet_bootstrap.cc:654] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.896437 17442 tablet_service.cc:1511] Processing CreateTablet for tablet 253dd23b514c487eaca1aecfa9b6e629 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:40.898092 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253dd23b514c487eaca1aecfa9b6e629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.916213 17513 tablet_service.cc:1511] Processing CreateTablet for tablet 253dd23b514c487eaca1aecfa9b6e629 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:40.917558 17513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253dd23b514c487eaca1aecfa9b6e629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.926718 17588 tablet_service.cc:1511] Processing CreateTablet for tablet 253dd23b514c487eaca1aecfa9b6e629 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:40.926913 17437 tablet_service.cc:1511] Processing CreateTablet for tablet 14b4916b36c24c9bb0562a70795b8ed1 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:40.928066 17437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b4916b36c24c9bb0562a70795b8ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.931954 17643 ts_tablet_manager.cc:1434] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.061s	user 0.018s	sys 0.002s
I20260709 13:17:40.933005 17479 heartbeater.cc:499] Master 127.15.242.126:39589 was elected leader, sending a full tablet report...
I20260709 13:17:40.933792 17643 tablet_bootstrap.cc:492] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:40.934877 17511 tablet_service.cc:1511] Processing CreateTablet for tablet 14b4916b36c24c9bb0562a70795b8ed1 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:40.936170 17511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b4916b36c24c9bb0562a70795b8ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.940891 17643 tablet_bootstrap.cc:654] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.928066 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253dd23b514c487eaca1aecfa9b6e629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.971829 17593 tablet_service.cc:1511] Processing CreateTablet for tablet 14b4916b36c24c9bb0562a70795b8ed1 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:40.973168 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b4916b36c24c9bb0562a70795b8ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.975356 17644 tablet_bootstrap.cc:492] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:40.975878 17644 ts_tablet_manager.cc:1403] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.097s	user 0.019s	sys 0.008s
I20260709 13:17:40.978894 17440 tablet_service.cc:1511] Processing CreateTablet for tablet d4f2604c78c341a88d17d653b9abcbda (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:40.979260 17649 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.979766 17649 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:40.980259 17440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f2604c78c341a88d17d653b9abcbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.982369 17649 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:40.984287 17588 tablet_service.cc:1511] Processing CreateTablet for tablet d4f2604c78c341a88d17d653b9abcbda (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:40.985495 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f2604c78c341a88d17d653b9abcbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.985615 17645 tablet_bootstrap.cc:492] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:40.986186 17645 ts_tablet_manager.cc:1403] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.141s	user 0.018s	sys 0.012s
I20260709 13:17:40.992949 17644 raft_consensus.cc:359] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:40.993703 17644 raft_consensus.cc:385] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.994002 17644 raft_consensus.cc:740] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.994850 17644 consensus_queue.cc:260] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:40.996140 17517 tablet_service.cc:1511] Processing CreateTablet for tablet 8999fe04fedd4bcc9305446ba6f99d23 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:40.997219 17644 ts_tablet_manager.cc:1434] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:17:40.997426 17517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8999fe04fedd4bcc9305446ba6f99d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.013933 17644 tablet_bootstrap.cc:492] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:41.018209 17585 tablet_service.cc:1511] Processing CreateTablet for tablet 8999fe04fedd4bcc9305446ba6f99d23 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:41.019505 17585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8999fe04fedd4bcc9305446ba6f99d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.020937 17511 tablet_service.cc:1511] Processing CreateTablet for tablet d4f2604c78c341a88d17d653b9abcbda (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:41.022295 17511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f2604c78c341a88d17d653b9abcbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.022861 17442 tablet_service.cc:1511] Processing CreateTablet for tablet f83c31b52fc7479896f1f02ab870dc3b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:41.024597 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83c31b52fc7479896f1f02ab870dc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.028700 17643 tablet_bootstrap.cc:492] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:41.029202 17643 ts_tablet_manager.cc:1403] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.008s
I20260709 13:17:41.032334 17643 raft_consensus.cc:359] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.033183 17643 raft_consensus.cc:385] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.996510 17437 tablet_service.cc:1511] Processing CreateTablet for tablet 8999fe04fedd4bcc9305446ba6f99d23 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:41.039038 17437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8999fe04fedd4bcc9305446ba6f99d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.039924 17645 raft_consensus.cc:359] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:17:41.040673 17645 raft_consensus.cc:385] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.040966 17645 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.033939 17643 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.037173 17514 tablet_service.cc:1511] Processing CreateTablet for tablet f83c31b52fc7479896f1f02ab870dc3b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:41.041723 17645 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:17:41.042867 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83c31b52fc7479896f1f02ab870dc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.042716 17643 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.043911 17645 ts_tablet_manager.cc:1434] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:17:41.044884 17645 tablet_bootstrap.cc:492] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:41.047466 17643 ts_tablet_manager.cc:1434] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:17:41.048425 17643 tablet_bootstrap.cc:492] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:41.068476 17645 tablet_bootstrap.cc:654] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.071414 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:41.072180 17454 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:41.072008 17593 tablet_service.cc:1511] Processing CreateTablet for tablet f83c31b52fc7479896f1f02ab870dc3b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:41.073292 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83c31b52fc7479896f1f02ab870dc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.073400 17514 tablet_service.cc:1511] Processing CreateTablet for tablet 347905859bee416fb447f19528527f52 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:41.073926 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:41.074935 17649 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:41.075320 17649 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.075660 17649 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.076207 17444 tablet_service.cc:1511] Processing CreateTablet for tablet 347905859bee416fb447f19528527f52 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:41.077443 17444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347905859bee416fb447f19528527f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.083026 17584 tablet_service.cc:1511] Processing CreateTablet for tablet 347905859bee416fb447f19528527f52 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:41.083582 17443 tablet_service.cc:1511] Processing CreateTablet for tablet 92cfff7457484bd5b062ad3bc520549e (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:41.084357 17584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347905859bee416fb447f19528527f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.084820 17443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cfff7457484bd5b062ad3bc520549e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.091480 17441 tablet_service.cc:1511] Processing CreateTablet for tablet be6cfcb1338b4398b769f6956792bdd7 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:41.092775 17441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6cfcb1338b4398b769f6956792bdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.074723 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347905859bee416fb447f19528527f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.107059 17517 tablet_service.cc:1511] Processing CreateTablet for tablet be6cfcb1338b4398b769f6956792bdd7 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:41.110363 17644 tablet_bootstrap.cc:654] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.111099 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:41.111212 17649 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.116433 17649 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:41.112133 17511 tablet_service.cc:1511] Processing CreateTablet for tablet 92cfff7457484bd5b062ad3bc520549e (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:41.113376 17593 tablet_service.cc:1511] Processing CreateTablet for tablet be6cfcb1338b4398b769f6956792bdd7 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:41.117756 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6cfcb1338b4398b769f6956792bdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.118183 17643 tablet_bootstrap.cc:654] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.118324 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:17:41.118536 17495 leader_election.cc:343] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.118475 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:41.118932 17454 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:41.120023 17495 leader_election.cc:343] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.124552 17588 tablet_service.cc:1511] Processing CreateTablet for tablet 92cfff7457484bd5b062ad3bc520549e (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:41.126643 17511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cfff7457484bd5b062ad3bc520549e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.127588 17454 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:41.138392 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cfff7457484bd5b062ad3bc520549e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.147055 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:41.148380 17584 tablet_service.cc:1511] Processing CreateTablet for tablet cf597fe63db446f38a58bcbc792dd49b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:41.149874 17584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf597fe63db446f38a58bcbc792dd49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.150242 17649 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:41.139025 17517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6cfcb1338b4398b769f6956792bdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.153600 17645 tablet_bootstrap.cc:492] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:41.158340 17645 ts_tablet_manager.cc:1403] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.008s
I20260709 13:17:41.153770 17514 tablet_service.cc:1511] Processing CreateTablet for tablet cf597fe63db446f38a58bcbc792dd49b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:41.159704 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf597fe63db446f38a58bcbc792dd49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.145278 17442 tablet_service.cc:1511] Processing CreateTablet for tablet cf597fe63db446f38a58bcbc792dd49b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:41.162818 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf597fe63db446f38a58bcbc792dd49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.162729 17443 tablet_service.cc:1511] Processing CreateTablet for tablet cb985f82c610405fb3774fe99cf142e7 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:41.164196 17443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb985f82c610405fb3774fe99cf142e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.171267 17585 tablet_service.cc:1511] Processing CreateTablet for tablet cb985f82c610405fb3774fe99cf142e7 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:41.172765 17585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb985f82c610405fb3774fe99cf142e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.173413 17513 tablet_service.cc:1511] Processing CreateTablet for tablet cb985f82c610405fb3774fe99cf142e7 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:41.174975 17513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb985f82c610405fb3774fe99cf142e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.171828 17645 raft_consensus.cc:359] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.179298 17645 raft_consensus.cc:385] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.183585 17645 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.186223 17644 tablet_bootstrap.cc:492] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:41.186759 17644 ts_tablet_manager.cc:1403] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.188s	user 0.009s	sys 0.008s
I20260709 13:17:41.189762 17644 raft_consensus.cc:359] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.194813 17644 raft_consensus.cc:385] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.193774 17518 tablet_service.cc:1511] Processing CreateTablet for tablet f1c40484b7a540a9b32947573409178a (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:41.196367 17644 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.197072 17518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c40484b7a540a9b32947573409178a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.197407 17644 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.194546 17593 tablet_service.cc:1511] Processing CreateTablet for tablet f1c40484b7a540a9b32947573409178a (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:41.203903 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c40484b7a540a9b32947573409178a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.206418 17644 ts_tablet_manager.cc:1434] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:17:41.207533 17644 tablet_bootstrap.cc:492] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:41.199730 17643 tablet_bootstrap.cc:492] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:41.212153 17643 ts_tablet_manager.cc:1403] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.164s	user 0.021s	sys 0.000s
I20260709 13:17:41.200517 17441 tablet_service.cc:1511] Processing CreateTablet for tablet 2edee9f2356c4e878f2e11af63e46ab9 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:41.216487 17441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2edee9f2356c4e878f2e11af63e46ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.193852 17645 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.207134 17584 tablet_service.cc:1511] Processing CreateTablet for tablet 2edee9f2356c4e878f2e11af63e46ab9 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:41.182706 17444 tablet_service.cc:1511] Processing CreateTablet for tablet f1c40484b7a540a9b32947573409178a (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:41.221159 17514 tablet_service.cc:1511] Processing CreateTablet for tablet 2edee9f2356c4e878f2e11af63e46ab9 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:41.222458 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2edee9f2356c4e878f2e11af63e46ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.222714 17437 tablet_service.cc:1511] Processing CreateTablet for tablet a372191e02cc468bbc747310e2818f07 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:41.223481 17444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c40484b7a540a9b32947573409178a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.227072 17437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a372191e02cc468bbc747310e2818f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.228581 17650 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.229061 17650 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.244534 17662 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.245082 17662 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.246446 17585 tablet_service.cc:1511] Processing CreateTablet for tablet a372191e02cc468bbc747310e2818f07 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:41.247685 17662 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:41.248654 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:41.249009 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:41.249599 17603 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:41.250487 17652 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:41.250360 17495 leader_election.cc:343] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.251113 17652 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:17:41.253625 17652 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:41.255213 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:41.257895 17442 tablet_service.cc:1511] Processing CreateTablet for tablet 42a91336a4f94e5db0ce4fa334e9bd37 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:41.275101 17584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2edee9f2356c4e878f2e11af63e46ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.237876 17643 raft_consensus.cc:359] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.274466 17662 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:41.282119 17643 raft_consensus.cc:385] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.292121 17643 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.292934 17643 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.295315 17643 ts_tablet_manager.cc:1434] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:17:41.295859 17663 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.296351 17663 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:17:41.289086 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a91336a4f94e5db0ce4fa334e9bd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.284480 17662 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.281860 17649 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:41.286757 17650 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:41.317041 17585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a372191e02cc468bbc747310e2818f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.330447 17643 tablet_bootstrap.cc:492] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:41.316107 17662 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.341111 17645 ts_tablet_manager.cc:1434] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.182s	user 0.017s	sys 0.004s
I20260709 13:17:41.342368 17645 tablet_bootstrap.cc:492] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:41.346195 17663 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:41.347282 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:17:41.348829 17495 leader_election.cc:343] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.358609 17443 tablet_service.cc:1511] Processing CreateTablet for tablet 858a1d920b5540b3b9107201e3b32d46 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:41.359469 17441 tablet_service.cc:1511] Processing CreateTablet for tablet cb3ad3ce4b124497a737d40423bea33d (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:41.360348 17440 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6cb82d38034da9b7efa624d5ed7744 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:41.365469 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:41.366230 17454 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:41.370128 17443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 858a1d920b5540b3b9107201e3b32d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.370709 17518 tablet_service.cc:1511] Processing CreateTablet for tablet a372191e02cc468bbc747310e2818f07 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:41.371989 17518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a372191e02cc468bbc747310e2818f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.368362 17649 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.375502 17517 tablet_service.cc:1511] Processing CreateTablet for tablet 42a91336a4f94e5db0ce4fa334e9bd37 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:41.376960 17517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a91336a4f94e5db0ce4fa334e9bd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.381546 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:41.381814 17441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3ad3ce4b124497a737d40423bea33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.398307 17440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6cb82d38034da9b7efa624d5ed7744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.396637 17513 tablet_service.cc:1511] Processing CreateTablet for tablet 858a1d920b5540b3b9107201e3b32d46 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:41.398916 17511 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6cb82d38034da9b7efa624d5ed7744 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:41.399399 17513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 858a1d920b5540b3b9107201e3b32d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.401978 17650 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:41.402334 17339 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 49891.9us
I20260709 13:17:41.402484 17650 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.403501 17644 tablet_bootstrap.cc:654] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.404470 17650 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:41.402000 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:41.406618 17511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6cb82d38034da9b7efa624d5ed7744. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:41.384735 17569 leader_election.cc:343] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.406931 17668 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:41.407413 17668 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.407766 17668 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.415162 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:41.415560 17668 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:17:41.416633 17643 tablet_bootstrap.cc:654] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:41.416689 17569 leader_election.cc:343] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.420022 17588 tablet_service.cc:1511] Processing CreateTablet for tablet 858a1d920b5540b3b9107201e3b32d46 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:41.420143 17593 tablet_service.cc:1511] Processing CreateTablet for tablet cb3ad3ce4b124497a737d40423bea33d (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:41.421373 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 858a1d920b5540b3b9107201e3b32d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.421975 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3ad3ce4b124497a737d40423bea33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.423084 17591 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6cb82d38034da9b7efa624d5ed7744 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:41.424319 17591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6cb82d38034da9b7efa624d5ed7744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.391520 17514 tablet_service.cc:1511] Processing CreateTablet for tablet cb3ad3ce4b124497a737d40423bea33d (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:41.431250 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3ad3ce4b124497a737d40423bea33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.435129 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:17:41.436674 17495 leader_election.cc:343] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.437301 17668 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:41.383257 17662 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.446700 17662 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:41.435508 17584 tablet_service.cc:1511] Processing CreateTablet for tablet 42a91336a4f94e5db0ce4fa334e9bd37 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:41.448832 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:41.453702 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:41.454396 17603 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.449834 17589 tablet_service.cc:1511] Processing CreateTablet for tablet 8e901a2e51634e18807d1c4292e3f285 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:41.453574 17645 tablet_bootstrap.cc:654] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:41.456439 17568 leader_election.cc:343] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.456650 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:41.462188 17568 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:17:41.471230 17568 leader_election.cc:343] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.471662 17568 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:41.472654 17650 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:41.473323 17650 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:41.472736 17603 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:41.475401 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:41.476249 17662 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:41.476796 17662 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:41.477711 17662 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.478850 17593 tablet_service.cc:1511] Processing CreateTablet for tablet dcd29f6044f6485580736010a0122d2b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:41.482481 17515 tablet_service.cc:1511] Processing CreateTablet for tablet 8e901a2e51634e18807d1c4292e3f285 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:41.483945 17515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e901a2e51634e18807d1c4292e3f285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.489240 17584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a91336a4f94e5db0ce4fa334e9bd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.490690 17644 tablet_bootstrap.cc:492] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:41.497392 17644 ts_tablet_manager.cc:1403] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.290s	user 0.018s	sys 0.014s
I20260709 13:17:41.499154 17516 tablet_service.cc:1511] Processing CreateTablet for tablet e072fa9bcaa24490bd884d56ff245e5f (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:41.499325 17512 tablet_service.cc:1511] Processing CreateTablet for tablet 916155438d0e450f9fdbbb449eee2721 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:41.500567 17516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e072fa9bcaa24490bd884d56ff245e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.503819 17644 raft_consensus.cc:359] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.504014 17510 tablet_service.cc:1511] Processing CreateTablet for tablet 1b89997d0ecd4f03a927078433a85a66 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:41.504616 17644 raft_consensus.cc:385] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.505818 17510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b89997d0ecd4f03a927078433a85a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.506691 17519 tablet_service.cc:1511] Processing CreateTablet for tablet 37ab58b1d58a45d9ba339018260d1ee4 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:41.508298 17519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37ab58b1d58a45d9ba339018260d1ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.504927 17644 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.515208 17644 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.521034 17644 ts_tablet_manager.cc:1434] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:17:41.526015 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:41.527170 17529 raft_consensus.cc:2393] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:17:41.526875 17517 tablet_service.cc:1511] Processing CreateTablet for tablet dcd29f6044f6485580736010a0122d2b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:41.528658 17517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd29f6044f6485580736010a0122d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.530411 17644 tablet_bootstrap.cc:492] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:41.533869 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:41.534569 17454 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.534443 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:41.537672 17443 tablet_service.cc:1511] Processing CreateTablet for tablet 916155438d0e450f9fdbbb449eee2721 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:41.538151 17441 tablet_service.cc:1511] Processing CreateTablet for tablet 8e901a2e51634e18807d1c4292e3f285 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:41.539044 17443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916155438d0e450f9fdbbb449eee2721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.539109 17442 tablet_service.cc:1511] Processing CreateTablet for tablet dcd29f6044f6485580736010a0122d2b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:41.540341 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd29f6044f6485580736010a0122d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.543251 17514 tablet_service.cc:1511] Processing CreateTablet for tablet bea493621f1e42c2b8689859233cc798 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:41.547382 17589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e901a2e51634e18807d1c4292e3f285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.563239 17441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e901a2e51634e18807d1c4292e3f285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.563074 17512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916155438d0e450f9fdbbb449eee2721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.570981 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd29f6044f6485580736010a0122d2b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:41.564373 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 93173.6us
I20260709 13:17:41.592001 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea493621f1e42c2b8689859233cc798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.602722 17444 tablet_service.cc:1511] Processing CreateTablet for tablet 1b89997d0ecd4f03a927078433a85a66 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:41.604100 17444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b89997d0ecd4f03a927078433a85a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.604627 17440 tablet_service.cc:1511] Processing CreateTablet for tablet 37ab58b1d58a45d9ba339018260d1ee4 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:41.605971 17440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37ab58b1d58a45d9ba339018260d1ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.607720 17645 tablet_bootstrap.cc:492] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:41.614357 17645 ts_tablet_manager.cc:1403] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.272s	user 0.022s	sys 0.010s
I20260709 13:17:41.617434 17645 raft_consensus.cc:359] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.618290 17645 raft_consensus.cc:385] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.618656 17645 raft_consensus.cc:740] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.620304 17518 tablet_service.cc:1511] Processing CreateTablet for tablet 12ca126b355348958188e14e8b1c7470 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:41.620776 17519 tablet_service.cc:1511] Processing CreateTablet for tablet 8fad2b3d8f774d4ca47be967955fb28b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:41.621404 17643 tablet_bootstrap.cc:492] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:41.626780 17643 ts_tablet_manager.cc:1403] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.297s	user 0.014s	sys 0.018s
I20260709 13:17:41.628075 17645 consensus_queue.cc:260] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.622258 17437 tablet_service.cc:1511] Processing CreateTablet for tablet e072fa9bcaa24490bd884d56ff245e5f (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:41.622304 17515 tablet_service.cc:1511] Processing CreateTablet for tablet da520cc299d940b68e5655cd8094d48e (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:41.629321 17442 tablet_service.cc:1511] Processing CreateTablet for tablet da520cc299d940b68e5655cd8094d48e (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:41.628856 17443 tablet_service.cc:1511] Processing CreateTablet for tablet bea493621f1e42c2b8689859233cc798 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:17:41.629966 17495 leader_election.cc:343] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.630565 17437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e072fa9bcaa24490bd884d56ff245e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.633210 17443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea493621f1e42c2b8689859233cc798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.632386 17643 raft_consensus.cc:359] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.634158 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da520cc299d940b68e5655cd8094d48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.637976 17350 catalog_manager.cc:5697] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:41.642810 17674 log.cc:927] Time spent T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:41.634075 17643 raft_consensus.cc:385] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.646476 17643 raft_consensus.cc:740] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.649677 17644 tablet_bootstrap.cc:654] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.656476 17645 ts_tablet_manager.cc:1434] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 13:17:41.660175 17519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fad2b3d8f774d4ca47be967955fb28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.661417 17518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ca126b355348958188e14e8b1c7470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.647354 17643 consensus_queue.cc:260] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.653271 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:41.674603 17454 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:41.678438 17585 tablet_service.cc:1511] Processing CreateTablet for tablet 916155438d0e450f9fdbbb449eee2721 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:41.679867 17585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916155438d0e450f9fdbbb449eee2721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.685717 17593 tablet_service.cc:1511] Processing CreateTablet for tablet 37ab58b1d58a45d9ba339018260d1ee4 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:41.687590 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37ab58b1d58a45d9ba339018260d1ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.703832 17515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da520cc299d940b68e5655cd8094d48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.711267 17513 tablet_service.cc:1511] Processing CreateTablet for tablet abb20677645b433e839a2f21c9cc2ef3 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:41.712931 17518 tablet_service.cc:1511] Processing CreateTablet for tablet a851f7fe7702439a9a695c117b09f6ae (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:41.714668 17652 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.715183 17652 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.717165 17652 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:41.714697 17645 tablet_bootstrap.cc:492] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:41.721654 17591 tablet_service.cc:1511] Processing CreateTablet for tablet da520cc299d940b68e5655cd8094d48e (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:41.723204 17593 tablet_service.cc:1511] Processing CreateTablet for tablet bea493621f1e42c2b8689859233cc798 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:41.724377 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:41.724987 17511 tablet_service.cc:1511] Processing CreateTablet for tablet ea190a19aed74ffea2c29fa8c13edeac (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:17:41.725956 17419 leader_election.cc:343] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.727545 17444 tablet_service.cc:1511] Processing CreateTablet for tablet 12ca126b355348958188e14e8b1c7470 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:41.728809 17444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ca126b355348958188e14e8b1c7470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.729106 17439 tablet_service.cc:1511] Processing CreateTablet for tablet ea190a19aed74ffea2c29fa8c13edeac (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:41.729472 17436 tablet_service.cc:1511] Processing CreateTablet for tablet abb20677645b433e839a2f21c9cc2ef3 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:41.730329 17439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea190a19aed74ffea2c29fa8c13edeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.731921 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:41.732509 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:41.732928 17438 tablet_service.cc:1511] Processing CreateTablet for tablet a851f7fe7702439a9a695c117b09f6ae (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:41.733763 17513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb20677645b433e839a2f21c9cc2ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.734134 17649 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:41.733945 17442 tablet_service.cc:1511] Processing CreateTablet for tablet 1cf63370ef7f41519349f91e85c42d19 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:41.734633 17649 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:41.734835 17511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea190a19aed74ffea2c29fa8c13edeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.734557 17588 tablet_service.cc:1511] Processing CreateTablet for tablet 1b89997d0ecd4f03a927078433a85a66 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:41.704486 17673 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.735579 17649 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:17:41.735865 17673 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.736905 17603 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:41.738173 17590 tablet_service.cc:1511] Processing CreateTablet for tablet 12ca126b355348958188e14e8b1c7470 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:41.740898 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:41.741547 17454 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:41.742316 17518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a851f7fe7702439a9a695c117b09f6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.733309 17436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb20677645b433e839a2f21c9cc2ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.742878 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:41.743770 17650 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:41.744119 17650 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.744462 17650 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.746405 17438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a851f7fe7702439a9a695c117b09f6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.747095 17441 tablet_service.cc:1511] Processing CreateTablet for tablet 8fad2b3d8f774d4ca47be967955fb28b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:41.748329 17441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fad2b3d8f774d4ca47be967955fb28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.750309 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf63370ef7f41519349f91e85c42d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.759598 17650 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.762187 17673 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:41.762573 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:41.762930 17591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da520cc299d940b68e5655cd8094d48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.763173 17454 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.763557 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b89997d0ecd4f03a927078433a85a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.763289 17586 tablet_service.cc:1511] Processing CreateTablet for tablet 8fad2b3d8f774d4ca47be967955fb28b (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:41.764544 17586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fad2b3d8f774d4ca47be967955fb28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.707805 17643 ts_tablet_manager.cc:1434] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.002s
I20260709 13:17:41.768268 17587 tablet_service.cc:1511] Processing CreateTablet for tablet a851f7fe7702439a9a695c117b09f6ae (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:41.768771 17590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ca126b355348958188e14e8b1c7470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.768953 17592 tablet_service.cc:1511] Processing CreateTablet for tablet 1cf63370ef7f41519349f91e85c42d19 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:41.769620 17587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a851f7fe7702439a9a695c117b09f6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.768275 17643 tablet_bootstrap.cc:492] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:41.770670 17592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf63370ef7f41519349f91e85c42d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.778584 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea493621f1e42c2b8689859233cc798. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:41.729737 17420 leader_election.cc:343] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.781657 17650 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:41.786147 17420 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:41.787039 17652 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:41.778501 17510 tablet_service.cc:1511] Processing CreateTablet for tablet 1cf63370ef7f41519349f91e85c42d19 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:41.790702 17510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf63370ef7f41519349f91e85c42d19. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:41.802431 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 72836.9us
I20260709 13:17:41.803702 17643 tablet_bootstrap.cc:654] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.808396 17645 tablet_bootstrap.cc:654] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.809640 17644 tablet_bootstrap.cc:492] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:41.810181 17644 ts_tablet_manager.cc:1403] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.280s	user 0.014s	sys 0.016s
I20260709 13:17:41.812449 17420 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:41.818586 17584 tablet_service.cc:1511] Processing CreateTablet for tablet e072fa9bcaa24490bd884d56ff245e5f (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:41.819896 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:41.820111 17584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e072fa9bcaa24490bd884d56ff245e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.821275 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:41.822259 17519 tablet_service.cc:1511] Processing CreateTablet for tablet 45a13c485c0a480f8ce9eb1282cb6d01 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:41.823537 17519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a13c485c0a480f8ce9eb1282cb6d01. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:41.826670 17568 leader_election.cc:343] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:41.827828 17568 leader_election.cc:343] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.825838 17442 tablet_service.cc:1511] Processing CreateTablet for tablet 45a13c485c0a480f8ce9eb1282cb6d01 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:41.830243 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a13c485c0a480f8ce9eb1282cb6d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.856011 17644 raft_consensus.cc:359] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:17:41.856880 17644 raft_consensus.cc:385] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.857223 17644 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.858876 17588 tablet_service.cc:1511] Processing CreateTablet for tablet ea190a19aed74ffea2c29fa8c13edeac (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:41.864256 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea190a19aed74ffea2c29fa8c13edeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.862800 17589 tablet_service.cc:1511] Processing CreateTablet for tablet abb20677645b433e839a2f21c9cc2ef3 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:41.865768 17590 tablet_service.cc:1511] Processing CreateTablet for tablet 45a13c485c0a480f8ce9eb1282cb6d01 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:41.878123 17589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb20677645b433e839a2f21c9cc2ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.897084 17590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a13c485c0a480f8ce9eb1282cb6d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.902640 17645 tablet_bootstrap.cc:492] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:41.903298 17645 ts_tablet_manager.cc:1403] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.197s	user 0.012s	sys 0.007s
I20260709 13:17:41.869532 17644 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:17:41.920709 17510 tablet_service.cc:1511] Processing CreateTablet for tablet 777822978f904e159194479932f1936f (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:41.921972 17442 tablet_service.cc:1511] Processing CreateTablet for tablet 777822978f904e159194479932f1936f (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:41.923184 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777822978f904e159194479932f1936f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.926330 17644 ts_tablet_manager.cc:1434] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.001s
W20260709 13:17:41.927541 17400 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:41.929893 17644 tablet_bootstrap.cc:492] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:41.933531 17643 tablet_bootstrap.cc:492] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:41.934037 17643 ts_tablet_manager.cc:1403] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.166s	user 0.016s	sys 0.000s
I20260709 13:17:41.936849 17643 raft_consensus.cc:359] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.931001 17645 raft_consensus.cc:359] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.937558 17643 raft_consensus.cc:385] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.881923 17454 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:41.932775 17510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777822978f904e159194479932f1936f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.937765 17645 raft_consensus.cc:385] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.941761 17652 raft_consensus.cc:2764] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:17:41.943173 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:41.944912 17650 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:41.945416 17650 raft_consensus.cc:697] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:41.941697 17649 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:41.942320 17643 raft_consensus.cc:740] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.947504 17645 raft_consensus.cc:740] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.960690 17662 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:41.963351 17515 tablet_service.cc:1511] Processing CreateTablet for tablet 306df9e1a44b411595f67a918d6a7a14 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:41.964126 17442 tablet_service.cc:1511] Processing CreateTablet for tablet 306df9e1a44b411595f67a918d6a7a14 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:41.964232 17585 tablet_service.cc:1511] Processing CreateTablet for tablet 306df9e1a44b411595f67a918d6a7a14 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:41.964773 17515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306df9e1a44b411595f67a918d6a7a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.965258 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306df9e1a44b411595f67a918d6a7a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.958755 17650 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.965526 17585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306df9e1a44b411595f67a918d6a7a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.970708 17440 tablet_service.cc:1511] Processing CreateTablet for tablet 4efb13f5c64447d2bbcbef8bc568f882 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:41.972018 17440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4efb13f5c64447d2bbcbef8bc568f882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.975298 17513 tablet_service.cc:1511] Processing CreateTablet for tablet 4efb13f5c64447d2bbcbef8bc568f882 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:41.976944 17513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4efb13f5c64447d2bbcbef8bc568f882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.959489 17643 consensus_queue.cc:260] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.983738 17588 tablet_service.cc:1511] Processing CreateTablet for tablet 777822978f904e159194479932f1936f (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:41.984818 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777822978f904e159194479932f1936f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.985672 17643 ts_tablet_manager.cc:1434] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:17:41.986720 17643 tablet_bootstrap.cc:492] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:41.989028 17645 consensus_queue.cc:260] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:41.994148 17645 ts_tablet_manager.cc:1434] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.003s
I20260709 13:17:42.002159 17652 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.003051 17644 tablet_bootstrap.cc:654] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.002765 17652 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:42.007319 17495 consensus_peers.cc:597] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:42.007983 17592 tablet_service.cc:1511] Processing CreateTablet for tablet 4efb13f5c64447d2bbcbef8bc568f882 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:42.009374 17592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4efb13f5c64447d2bbcbef8bc568f882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.012706 17643 tablet_bootstrap.cc:654] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.013571 17652 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:42.014321 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:42.014783 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:17:42.015676 17419 leader_election.cc:343] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:42.017421 17420 leader_election.cc:343] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.017851 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:42.018920 17652 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:42.025211 17645 tablet_bootstrap.cc:492] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:42.040380 17645 tablet_bootstrap.cc:654] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.048311 17515 tablet_service.cc:1511] Processing CreateTablet for tablet c159f64326b74a248a65dc1dae5c79a0 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:42.053435 17515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c159f64326b74a248a65dc1dae5c79a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.055204 17442 tablet_service.cc:1511] Processing CreateTablet for tablet c159f64326b74a248a65dc1dae5c79a0 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:42.056339 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c159f64326b74a248a65dc1dae5c79a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.056815 17514 tablet_service.cc:1511] Processing CreateTablet for tablet 68e8e6dd889d4bcfabf84cedd079e2f2 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:42.058106 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e8e6dd889d4bcfabf84cedd079e2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.060134 17588 tablet_service.cc:1511] Processing CreateTablet for tablet 68e8e6dd889d4bcfabf84cedd079e2f2 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:42.061239 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e8e6dd889d4bcfabf84cedd079e2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.063022 17436 tablet_service.cc:1511] Processing CreateTablet for tablet 68e8e6dd889d4bcfabf84cedd079e2f2 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:42.064417 17436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e8e6dd889d4bcfabf84cedd079e2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.064564 17439 tablet_service.cc:1511] Processing CreateTablet for tablet f16762b5a82d4310ad01b31fd99d5921 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:42.062505 17351 catalog_manager.cc:5697] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.081133 17439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16762b5a82d4310ad01b31fd99d5921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.087796 17590 tablet_service.cc:1511] Processing CreateTablet for tablet f16762b5a82d4310ad01b31fd99d5921 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:42.089846 17514 tablet_service.cc:1511] Processing CreateTablet for tablet f16762b5a82d4310ad01b31fd99d5921 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:42.093439 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16762b5a82d4310ad01b31fd99d5921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.095896 17442 tablet_service.cc:1511] Processing CreateTablet for tablet 36043ed9ab7c47e9882fa33c5c135545 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:42.107376 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36043ed9ab7c47e9882fa33c5c135545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.127897 17591 tablet_service.cc:1511] Processing CreateTablet for tablet c159f64326b74a248a65dc1dae5c79a0 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:42.129280 17591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c159f64326b74a248a65dc1dae5c79a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.120654 17644 tablet_bootstrap.cc:492] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:42.147953 17590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16762b5a82d4310ad01b31fd99d5921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.149258 17644 ts_tablet_manager.cc:1403] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.220s	user 0.024s	sys 0.019s
I20260709 13:17:42.149528 17514 tablet_service.cc:1511] Processing CreateTablet for tablet 36043ed9ab7c47e9882fa33c5c135545 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:42.150692 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36043ed9ab7c47e9882fa33c5c135545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.152305 17691 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.152207 17644 raft_consensus.cc:359] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.153028 17644 raft_consensus.cc:385] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.152874 17691 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.153354 17644 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.156843 17588 tablet_service.cc:1511] Processing CreateTablet for tablet 36043ed9ab7c47e9882fa33c5c135545 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:42.158114 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36043ed9ab7c47e9882fa33c5c135545. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:42.166539 17495 consensus_peers.cc:597] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:42.175365 17691 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:42.176445 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:42.178547 17603 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.177765 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:42.180437 17495 leader_election.cc:343] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:42.181439 17495 leader_election.cc:343] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.181850 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:42.182966 17442 tablet_service.cc:1511] Processing CreateTablet for tablet ec32c18bcdaa4eca99f08bba98bb1e0e (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:42.184304 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec32c18bcdaa4eca99f08bba98bb1e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.185694 17645 tablet_bootstrap.cc:492] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:42.186236 17645 ts_tablet_manager.cc:1403] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.161s	user 0.020s	sys 0.014s
I20260709 13:17:42.187148 17691 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:42.154214 17644 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.189230 17645 raft_consensus.cc:359] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.190452 17644 ts_tablet_manager.cc:1434] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:17:42.191478 17644 tablet_bootstrap.cc:492] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:42.189980 17645 raft_consensus.cc:385] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.193233 17645 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.194074 17645 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.196553 17645 ts_tablet_manager.cc:1434] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:42.196794 17352 catalog_manager.cc:5697] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.200665 17440 tablet_service.cc:1511] Processing CreateTablet for tablet 7398c91e7a884284a8b806d47551eaf7 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:42.218014 17442 tablet_service.cc:1511] Processing CreateTablet for tablet 43e1920c304743e78e8b777b3b7ea7f3 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:42.218914 17645 tablet_bootstrap.cc:492] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:42.219203 17440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7398c91e7a884284a8b806d47551eaf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.219300 17510 tablet_service.cc:1511] Processing CreateTablet for tablet 43e1920c304743e78e8b777b3b7ea7f3 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:42.204663 17585 tablet_service.cc:1511] Processing CreateTablet for tablet 7398c91e7a884284a8b806d47551eaf7 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:42.220196 17442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e1920c304743e78e8b777b3b7ea7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.220597 17510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e1920c304743e78e8b777b3b7ea7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.206004 17662 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:42.225663 17645 tablet_bootstrap.cc:654] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.220906 17585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7398c91e7a884284a8b806d47551eaf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.230513 17588 tablet_service.cc:1511] Processing CreateTablet for tablet 43e1920c304743e78e8b777b3b7ea7f3 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:42.233800 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e1920c304743e78e8b777b3b7ea7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.208464 17644 tablet_bootstrap.cc:654] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.209596 17592 tablet_service.cc:1511] Processing CreateTablet for tablet ec32c18bcdaa4eca99f08bba98bb1e0e (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:42.239662 17662 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:42.211388 17514 tablet_service.cc:1511] Processing CreateTablet for tablet ec32c18bcdaa4eca99f08bba98bb1e0e (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:42.212574 17643 tablet_bootstrap.cc:492] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:42.234690 17513 tablet_service.cc:1511] Processing CreateTablet for tablet dac17c6792414180963986e500f47356 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:42.243122 17513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac17c6792414180963986e500f47356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.241789 17643 ts_tablet_manager.cc:1403] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.255s	user 0.009s	sys 0.013s
I20260709 13:17:42.248093 17592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec32c18bcdaa4eca99f08bba98bb1e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.251010 17436 tablet_service.cc:1511] Processing CreateTablet for tablet dac17c6792414180963986e500f47356 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:42.252310 17436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac17c6792414180963986e500f47356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.254354 17652 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.254799 17652 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.256850 17652 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:42.257347 17643 raft_consensus.cc:359] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.258416 17643 raft_consensus.cc:385] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.258764 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:42.258872 17643 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.259428 17602 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:42.260782 17420 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:42.262013 17652 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.262310 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:42.263164 17528 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:42.252341 17352 catalog_manager.cc:5697] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.262522 17652 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.267273 17652 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.235549 17591 tablet_service.cc:1511] Processing CreateTablet for tablet dac17c6792414180963986e500f47356 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:42.260259 17643 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.206310 17515 tablet_service.cc:1511] Processing CreateTablet for tablet 7398c91e7a884284a8b806d47551eaf7 (DEFAULT_TABLE table=test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:42.271200 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec32c18bcdaa4eca99f08bba98bb1e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.277683 17591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac17c6792414180963986e500f47356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.288707 17652 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.290424 17643 ts_tablet_manager.cc:1434] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.005s
I20260709 13:17:42.291448 17643 tablet_bootstrap.cc:492] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:42.298404 17643 tablet_bootstrap.cc:654] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.307731 17652 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:42.309295 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:42.309926 17528 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.310988 17645 tablet_bootstrap.cc:492] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:42.311540 17645 ts_tablet_manager.cc:1403] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.093s	user 0.029s	sys 0.027s
I20260709 13:17:42.314791 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:42.315403 17603 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.315254 17645 raft_consensus.cc:359] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.319916 17645 raft_consensus.cc:385] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.320205 17645 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.320919 17645 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.323362 17645 ts_tablet_manager.cc:1434] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:17:42.324680 17645 tablet_bootstrap.cc:492] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:42.324862 17528 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:42.326215 17419 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:42.327098 17652 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.327623 17652 raft_consensus.cc:697] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:42.328462 17652 consensus_queue.cc:237] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.315711 17515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7398c91e7a884284a8b806d47551eaf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.347456 17644 tablet_bootstrap.cc:492] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:42.347958 17644 ts_tablet_manager.cc:1403] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.157s	user 0.020s	sys 0.005s
I20260709 13:17:42.349225 17603 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:42.356338 17644 raft_consensus.cc:359] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.356933 17644 raft_consensus.cc:385] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.357208 17644 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.358261 17644 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.360487 17644 ts_tablet_manager.cc:1434] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:17:42.364344 17644 tablet_bootstrap.cc:492] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:42.366074 17643 tablet_bootstrap.cc:492] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:42.366634 17643 ts_tablet_manager.cc:1403] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.010s
I20260709 13:17:42.369689 17643 raft_consensus.cc:359] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.370515 17643 raft_consensus.cc:385] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.370811 17643 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.371690 17643 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.372810 17350 catalog_manager.cc:5697] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.375324 17643 ts_tablet_manager.cc:1434] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:42.377287 17643 tablet_bootstrap.cc:492] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:42.378785 17644 tablet_bootstrap.cc:654] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.380137 17645 tablet_bootstrap.cc:654] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.384116 17643 tablet_bootstrap.cc:654] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.388024 17645 tablet_bootstrap.cc:492] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:42.388535 17645 ts_tablet_manager.cc:1403] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.001s
I20260709 13:17:42.391270 17645 raft_consensus.cc:359] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.391999 17645 raft_consensus.cc:385] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.392304 17645 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.392946 17645 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.400283 17645 ts_tablet_manager.cc:1434] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:17:42.402630 17644 tablet_bootstrap.cc:492] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:42.403362 17644 ts_tablet_manager.cc:1403] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.011s
I20260709 13:17:42.405098 17645 tablet_bootstrap.cc:492] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:42.405969 17644 raft_consensus.cc:359] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.406723 17643 tablet_bootstrap.cc:492] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:42.406683 17644 raft_consensus.cc:385] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.407235 17644 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.407321 17643 ts_tablet_manager.cc:1403] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.008s
I20260709 13:17:42.408136 17644 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.410693 17645 tablet_bootstrap.cc:654] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.410882 17644 ts_tablet_manager.cc:1434] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:42.411788 17644 tablet_bootstrap.cc:492] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:42.415643 17650 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:42.418314 17644 tablet_bootstrap.cc:654] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.421555 17645 tablet_bootstrap.cc:492] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:42.421996 17645 ts_tablet_manager.cc:1403] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 13:17:42.424512 17645 raft_consensus.cc:359] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.425169 17645 raft_consensus.cc:385] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.425436 17645 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.426898 17643 raft_consensus.cc:359] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.427670 17643 raft_consensus.cc:385] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.427971 17643 raft_consensus.cc:740] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.428768 17643 consensus_queue.cc:260] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.428864 17645 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.430737 17645 ts_tablet_manager.cc:1434] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 13:17:42.430751 17643 ts_tablet_manager.cc:1434] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:17:42.432024 17645 tablet_bootstrap.cc:492] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:42.433203 17643 tablet_bootstrap.cc:492] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:42.433502 17644 tablet_bootstrap.cc:492] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:42.434007 17644 ts_tablet_manager.cc:1403] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 13:17:42.436755 17644 raft_consensus.cc:359] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.437435 17644 raft_consensus.cc:385] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.437692 17644 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.438488 17645 tablet_bootstrap.cc:654] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.438369 17644 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.439131 17643 tablet_bootstrap.cc:654] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.440392 17644 ts_tablet_manager.cc:1434] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:42.442171 17644 tablet_bootstrap.cc:492] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:42.448518 17644 tablet_bootstrap.cc:654] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.452208 17645 tablet_bootstrap.cc:492] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:42.452885 17645 ts_tablet_manager.cc:1403] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:17:42.456323 17645 raft_consensus.cc:359] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.457422 17645 raft_consensus.cc:385] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.457815 17645 raft_consensus.cc:740] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.458874 17645 consensus_queue.cc:260] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.462162 17645 ts_tablet_manager.cc:1434] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:17:42.463449 17645 tablet_bootstrap.cc:492] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:42.467816 17644 tablet_bootstrap.cc:492] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:42.468333 17644 ts_tablet_manager.cc:1403] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.008s
I20260709 13:17:42.472379 17644 raft_consensus.cc:359] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.473040 17644 raft_consensus.cc:385] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.473295 17644 raft_consensus.cc:740] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.473800 17645 tablet_bootstrap.cc:654] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.474081 17644 consensus_queue.cc:260] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.479972 17644 ts_tablet_manager.cc:1434] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:42.481169 17644 tablet_bootstrap.cc:492] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:42.485061 17645 tablet_bootstrap.cc:492] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:42.485577 17645 ts_tablet_manager.cc:1403] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.009s
I20260709 13:17:42.487174 17644 tablet_bootstrap.cc:654] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.488270 17645 raft_consensus.cc:359] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.489104 17645 raft_consensus.cc:385] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.489410 17645 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.490391 17645 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.493162 17645 ts_tablet_manager.cc:1434] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:42.494417 17645 tablet_bootstrap.cc:492] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:42.502252 17645 tablet_bootstrap.cc:654] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.505005 17644 tablet_bootstrap.cc:492] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:42.505460 17644 ts_tablet_manager.cc:1403] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.014s
I20260709 13:17:42.508054 17644 raft_consensus.cc:359] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.508708 17644 raft_consensus.cc:385] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.508975 17644 raft_consensus.cc:740] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.509583 17644 consensus_queue.cc:260] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.513741 17645 tablet_bootstrap.cc:492] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:42.514451 17645 ts_tablet_manager.cc:1403] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.008s
I20260709 13:17:42.515762 17722 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.516247 17722 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.517316 17645 raft_consensus.cc:359] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.518047 17645 raft_consensus.cc:385] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.518332 17645 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.519075 17645 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.519830 17528 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.519974 17644 ts_tablet_manager.cc:1434] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:17:42.520087 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:42.520769 17529 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:42.521373 17645 ts_tablet_manager.cc:1434] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:17:42.522336 17645 tablet_bootstrap.cc:492] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:42.522127 17568 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:42.523653 17644 tablet_bootstrap.cc:492] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:42.518362 17722 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:42.527704 17722 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.528081 17722 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.528411 17722 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.529399 17645 tablet_bootstrap.cc:654] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.532591 17650 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:42.537438 17644 tablet_bootstrap.cc:654] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.541981 17603 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.543705 17645 tablet_bootstrap.cc:492] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:42.544198 17645 ts_tablet_manager.cc:1403] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 13:17:42.545980 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:42.548180 17569 leader_election.cc:343] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.551966 17717 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.552351 17722 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.547736 17645 raft_consensus.cc:359] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.553493 17645 raft_consensus.cc:385] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.553915 17645 raft_consensus.cc:740] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.555418 17645 consensus_queue.cc:260] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.557802 17645 ts_tablet_manager.cc:1434] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:17:42.558650 17645 tablet_bootstrap.cc:492] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:42.558586 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:17:42.559969 17569 leader_election.cc:343] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.560863 17722 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:42.552634 17717 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.563266 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:42.564203 17529 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.564788 17644 tablet_bootstrap.cc:492] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:42.565289 17644 ts_tablet_manager.cc:1403] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.002s
I20260709 13:17:42.567353 17691 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.568038 17645 tablet_bootstrap.cc:654] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.567844 17691 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.570601 17691 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:42.572033 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:42.572340 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:42.572803 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:42.573490 17495 leader_election.cc:343] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.573628 17454 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
W20260709 13:17:42.574195 17495 leader_election.cc:343] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.574608 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:42.574542 17644 raft_consensus.cc:359] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.575256 17644 raft_consensus.cc:385] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.575538 17644 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.575790 17691 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:42.575449 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:42.576493 17644 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.578459 17644 ts_tablet_manager.cc:1434] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:17:42.579371 17644 tablet_bootstrap.cc:492] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:42.582324 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:42.583904 17717 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:42.584308 17527 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:42.584403 17529 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:42.593051 17652 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.593883 17643 tablet_bootstrap.cc:492] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:42.594331 17568 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:42.595112 17692 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.594355 17643 ts_tablet_manager.cc:1403] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.161s	user 0.026s	sys 0.051s
I20260709 13:17:42.595554 17692 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.597846 17692 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:42.598560 17643 raft_consensus.cc:359] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.599409 17643 raft_consensus.cc:385] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.599675 17643 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.599370 17650 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.600529 17643 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.602206 17717 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.600260 17650 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.602697 17717 raft_consensus.cc:697] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:42.603547 17717 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.604168 17650 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:42.593586 17652 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.605641 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:42.606338 17454 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:42.606549 17652 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:42.607546 17569 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:42.608551 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:42.608742 17644 tablet_bootstrap.cc:654] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.609139 17528 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:42.609354 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:42.609566 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:42.609596 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:42.610175 17602 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:42.610364 17454 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:42.605675 17643 ts_tablet_manager.cc:1434] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:42.611982 17643 tablet_bootstrap.cc:492] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:42.612102 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:42.610188 17529 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:42.613673 17419 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:42.614405 17696 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.614434 17652 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.614916 17696 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.615021 17652 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.615298 17696 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.615417 17652 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.615813 17645 tablet_bootstrap.cc:492] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:42.616264 17645 ts_tablet_manager.cc:1403] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.010s
I20260709 13:17:42.611433 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:42.614472 17725 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.613310 17650 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.617234 17725 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.617421 17650 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.617647 17725 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.617828 17650 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.620566 17645 raft_consensus.cc:359] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.621459 17645 raft_consensus.cc:385] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.621778 17645 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
W20260709 13:17:42.622958 17420 leader_election.cc:343] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.627157 17650 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.630307 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:42.630893 17454 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.630631 17696 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.631593 17725 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.633612 17722 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.634166 17645 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.634934 17723 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.635185 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:42.635402 17723 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.634933 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:42.634087 17722 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.636992 17603 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.638284 17723 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:42.638480 17645 ts_tablet_manager.cc:1434] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.003s
I20260709 13:17:42.639509 17645 tablet_bootstrap.cc:492] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:42.638299 17722 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:42.633175 17696 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:42.641322 17650 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:42.641139 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:42.635818 17453 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.647089 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:42.654419 17569 leader_election.cc:343] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:42.655922 17569 leader_election.cc:343] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.655830 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:42.639931 17454 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:42.644078 17652 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.656805 17529 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:42.658102 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:42.658620 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:42.659536 17569 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:42.665513 17528 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:42.666560 17568 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:42.672811 17722 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.673369 17722 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.673825 17722 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.677758 17453 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:42.678737 17568 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:42.679100 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:42.679659 17723 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.670373 17650 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.679893 17696 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.667920 17527 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.684369 17725 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:42.687301 17722 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.689868 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:42.667317 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:42.680518 17696 raft_consensus.cc:697] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:42.680518 17650 raft_consensus.cc:697] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:42.680114 17723 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.692664 17650 consensus_queue.cc:237] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.693781 17696 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.694566 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:42.694286 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:42.699131 17529 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:42.702560 17420 leader_election.cc:343] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.695817 17723 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.704165 17722 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:42.704294 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:42.704975 17526 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.691540 17528 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.694988 17454 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.711897 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:17:42.714118 17569 leader_election.cc:343] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.720968 17526 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:42.722448 17568 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:42.723969 17722 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.724577 17722 raft_consensus.cc:697] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:42.725651 17722 consensus_queue.cc:237] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.728830 17643 tablet_bootstrap.cc:654] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.738932 17527 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:42.742730 17529 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:42.743366 17352 catalog_manager.cc:5697] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.744077 17419 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:42.741042 17528 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:42.712029 17652 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:42.745718 17705 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.746374 17705 raft_consensus.cc:697] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:42.747464 17705 consensus_queue.cc:237] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.750170 17723 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.758965 17644 tablet_bootstrap.cc:492] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:42.758828 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:42.759400 17644 ts_tablet_manager.cc:1403] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.180s	user 0.033s	sys 0.029s
I20260709 13:17:42.761580 17723 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:42.764111 17644 raft_consensus.cc:359] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.765035 17644 raft_consensus.cc:385] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.765369 17644 raft_consensus.cc:740] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
W20260709 13:17:42.767109 17569 leader_election.cc:343] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.741911 17603 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:42.770961 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:42.778577 17529 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.782892 17568 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:42.777045 17352 catalog_manager.cc:5697] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.786633 17723 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.787253 17723 raft_consensus.cc:697] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:42.788131 17723 consensus_queue.cc:237] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.774403 17644 consensus_queue.cc:260] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.793124 17454 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:42.793143 17529 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:42.793692 17644 ts_tablet_manager.cc:1434] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.010s
I20260709 13:17:42.794824 17644 tablet_bootstrap.cc:492] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:42.794974 17645 tablet_bootstrap.cc:654] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.794837 17568 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:42.797191 17650 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.801345 17650 raft_consensus.cc:697] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:42.802292 17650 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.805033 17652 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:42.816473 17643 tablet_bootstrap.cc:492] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:42.817055 17643 ts_tablet_manager.cc:1403] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.205s	user 0.022s	sys 0.018s
I20260709 13:17:42.825580 17643 raft_consensus.cc:359] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.826134 17643 raft_consensus.cc:385] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.826442 17643 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.827453 17643 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.831660 17643 ts_tablet_manager.cc:1434] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:17:42.832558 17643 tablet_bootstrap.cc:492] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:42.829682 17644 tablet_bootstrap.cc:654] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.838258 17643 tablet_bootstrap.cc:654] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.838297 17696 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.838570 17704 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:42.839017 17696 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.834908 17352 catalog_manager.cc:5697] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.842459 17645 tablet_bootstrap.cc:492] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:42.842172 17352 catalog_manager.cc:5697] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.842995 17645 ts_tablet_manager.cc:1403] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.204s	user 0.008s	sys 0.014s
I20260709 13:17:42.843268 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:42.843899 17602 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:42.843976 17352 catalog_manager.cc:5697] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.844888 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:42.846637 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:42.846771 17645 raft_consensus.cc:359] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.847441 17645 raft_consensus.cc:385] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.847517 17692 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.847749 17645 raft_consensus.cc:740] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.847869 17692 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.848212 17692 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.848459 17645 consensus_queue.cc:260] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.850708 17704 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.850845 17645 ts_tablet_manager.cc:1434] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
W20260709 13:17:42.851059 17495 leader_election.cc:343] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.851176 17704 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.851838 17645 tablet_bootstrap.cc:492] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:42.853868 17704 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:42.855453 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:42.856153 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:42.856905 17528 raft_consensus.cc:2393] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:17:42.857409 17692 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.857985 17645 tablet_bootstrap.cc:654] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.858317 17696 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:42.858354 17419 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:42.860908 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:42.861268 17350 catalog_manager.cc:5697] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:42.863829 17495 leader_election.cc:343] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.864679 17704 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.872493 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:42.873307 17603 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.890671 17603 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:42.897167 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:42.891315 17692 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:42.899348 17696 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.900080 17696 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:42.901484 17696 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.912237 17644 tablet_bootstrap.cc:492] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:42.912971 17644 ts_tablet_manager.cc:1403] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.003s
I20260709 13:17:42.916293 17643 tablet_bootstrap.cc:492] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:42.916831 17643 ts_tablet_manager.cc:1403] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.036s
I20260709 13:17:42.917865 17704 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:42.921178 17645 tablet_bootstrap.cc:492] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:42.921674 17645 ts_tablet_manager.cc:1403] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.070s	user 0.031s	sys 0.037s
I20260709 13:17:42.919220 17644 raft_consensus.cc:359] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.923997 17644 raft_consensus.cc:385] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.924559 17643 raft_consensus.cc:359] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.924939 17644 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.925226 17643 raft_consensus.cc:385] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.925567 17643 raft_consensus.cc:740] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.925393 17645 raft_consensus.cc:359] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.925805 17644 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.926597 17645 raft_consensus.cc:385] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.926477 17643 consensus_queue.cc:260] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.926994 17645 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.926291 17352 catalog_manager.cc:5697] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.927802 17645 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.928539 17643 ts_tablet_manager.cc:1434] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:42.929047 17644 ts_tablet_manager.cc:1434] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:17:42.929382 17643 tablet_bootstrap.cc:492] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:42.929814 17645 ts_tablet_manager.cc:1434] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:17:42.930531 17644 tablet_bootstrap.cc:492] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:42.930672 17645 tablet_bootstrap.cc:492] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:42.936128 17643 tablet_bootstrap.cc:654] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.937268 17351 catalog_manager.cc:5697] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.938375 17644 tablet_bootstrap.cc:654] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.941143 17643 tablet_bootstrap.cc:492] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:42.941613 17643 ts_tablet_manager.cc:1403] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:17:42.938622 17454 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.944185 17643 raft_consensus.cc:359] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.944859 17643 raft_consensus.cc:385] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.945120 17643 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.945842 17643 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.947642 17643 ts_tablet_manager.cc:1434] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:42.948511 17643 tablet_bootstrap.cc:492] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:42.948973 17645 tablet_bootstrap.cc:654] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.954348 17643 tablet_bootstrap.cc:654] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.965906 17643 tablet_bootstrap.cc:492] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:42.966405 17643 ts_tablet_manager.cc:1403] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
W20260709 13:17:42.969245 17400 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:42.969683 17643 raft_consensus.cc:359] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.970368 17643 raft_consensus.cc:385] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.970680 17643 raft_consensus.cc:740] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.971377 17643 consensus_queue.cc:260] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.973328 17643 ts_tablet_manager.cc:1434] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:42.974232 17643 tablet_bootstrap.cc:492] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:42.981688 17643 tablet_bootstrap.cc:654] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.992960 17645 tablet_bootstrap.cc:492] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:42.992960 17644 tablet_bootstrap.cc:492] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:42.993551 17645 ts_tablet_manager.cc:1403] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.063s	user 0.031s	sys 0.009s
I20260709 13:17:42.993551 17644 ts_tablet_manager.cc:1403] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.008s
I20260709 13:17:42.996595 17644 raft_consensus.cc:359] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.996778 17645 raft_consensus.cc:359] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.997262 17644 raft_consensus.cc:385] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.997355 17645 raft_consensus.cc:385] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.997572 17644 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.997643 17645 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.998287 17644 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:42.998468 17645 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.000289 17645 ts_tablet_manager.cc:1434] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:43.001295 17645 tablet_bootstrap.cc:492] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:43.007972 17644 ts_tablet_manager.cc:1434] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.003s
I20260709 13:17:43.009917 17645 tablet_bootstrap.cc:654] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.011209 17644 tablet_bootstrap.cc:492] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:43.018359 17644 tablet_bootstrap.cc:654] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.023520 17650 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.024034 17650 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.024902 17643 tablet_bootstrap.cc:492] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:43.025435 17643 ts_tablet_manager.cc:1403] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.024s
I20260709 13:17:43.026141 17650 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:43.027135 17644 tablet_bootstrap.cc:492] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:43.027619 17644 ts_tablet_manager.cc:1403] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:17:43.027745 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:43.028411 17529 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:43.028276 17643 raft_consensus.cc:359] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.028980 17643 raft_consensus.cc:385] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.029251 17643 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.029889 17643 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.030501 17568 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:43.030498 17644 raft_consensus.cc:359] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.031386 17644 raft_consensus.cc:385] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.031672 17644 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.031922 17643 ts_tablet_manager.cc:1434] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:17:43.032135 17723 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:43.032853 17643 tablet_bootstrap.cc:492] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:43.032509 17644 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.032517 17723 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.033587 17723 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.031599 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:43.034948 17644 ts_tablet_manager.cc:1434] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:43.035197 17454 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:43.035995 17644 tablet_bootstrap.cc:492] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:43.039235 17645 tablet_bootstrap.cc:492] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:43.039443 17643 tablet_bootstrap.cc:654] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.039675 17645 ts_tablet_manager.cc:1403] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.005s
I20260709 13:17:43.042510 17704 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.043071 17644 tablet_bootstrap.cc:654] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.043001 17704 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.045097 17704 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.046226 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:43.047009 17529 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:17:43.048653 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:43.048941 17650 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:43.050843 17419 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:43.051247 17643 tablet_bootstrap.cc:492] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:43.051862 17643 ts_tablet_manager.cc:1403] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:17:43.051973 17704 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.055380 17644 tablet_bootstrap.cc:492] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:43.055827 17644 ts_tablet_manager.cc:1403] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.002s
I20260709 13:17:43.056362 17643 raft_consensus.cc:359] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.057077 17643 raft_consensus.cc:385] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.057368 17643 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.056602 17645 raft_consensus.cc:359] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.058177 17643 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.058452 17644 raft_consensus.cc:359] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.061537 17645 raft_consensus.cc:385] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.061896 17644 raft_consensus.cc:385] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.062251 17644 raft_consensus.cc:740] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.062669 17645 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.062863 17644 consensus_queue.cc:260] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.064635 17644 ts_tablet_manager.cc:1434] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:43.065505 17644 tablet_bootstrap.cc:492] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:43.065557 17645 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.067272 17643 ts_tablet_manager.cc:1434] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:17:43.068811 17643 tablet_bootstrap.cc:492] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:43.069993 17723 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.073534 17644 tablet_bootstrap.cc:654] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.071599 17645 ts_tablet_manager.cc:1434] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:17:43.075109 17643 tablet_bootstrap.cc:654] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.075065 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:43.076207 17645 tablet_bootstrap.cc:492] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:43.078492 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:43.079108 17529 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.076272 17454 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.086427 17723 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:43.085969 17650 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:43.110122 17691 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.110642 17691 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.114434 17691 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.116048 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:43.117244 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:43.117867 17603 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:43.118464 17454 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:43.059934 17704 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:43.120139 17495 leader_election.cc:343] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:43.120348 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:43.120836 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:43.121177 17723 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:43.122093 17692 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:43.122462 17692 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.122802 17692 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.125898 17529 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:43.131227 17692 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.134125 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:17:43.135483 17495 leader_election.cc:343] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:43.136848 17692 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.137401 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:43.137969 17603 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.142306 17645 tablet_bootstrap.cc:654] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.145313 17603 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:43.146727 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:43.152711 17692 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:43.153934 17692 raft_consensus.cc:697] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:43.155215 17692 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.137969 17723 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:43.157635 17723 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.167336 17644 tablet_bootstrap.cc:492] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:43.167800 17644 ts_tablet_manager.cc:1403] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.103s	user 0.035s	sys 0.063s
I20260709 13:17:43.168094 17691 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:43.171128 17644 raft_consensus.cc:359] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.172072 17644 raft_consensus.cc:385] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.172372 17644 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.173154 17644 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.174817 17644 ts_tablet_manager.cc:1434] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:43.175798 17644 tablet_bootstrap.cc:492] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:43.179553 17643 tablet_bootstrap.cc:492] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:43.180125 17643 ts_tablet_manager.cc:1403] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.112s	user 0.049s	sys 0.055s
I20260709 13:17:43.183496 17643 raft_consensus.cc:359] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.184201 17643 raft_consensus.cc:385] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.184340 17644 tablet_bootstrap.cc:654] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.184491 17643 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.185379 17643 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.186667 17704 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.187121 17704 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.189241 17704 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.190320 17725 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.190809 17725 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.191712 17643 ts_tablet_manager.cc:1434] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:43.191944 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:43.192616 17725 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:43.192790 17529 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:43.193789 17643 tablet_bootstrap.cc:492] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:43.199573 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:43.200460 17603 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:43.201531 17643 tablet_bootstrap.cc:654] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.203158 17454 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.206552 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:43.188668 17351 catalog_manager.cc:5697] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.208235 17352 catalog_manager.cc:5697] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.195803 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:43.210397 17528 raft_consensus.cc:2393] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 1: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:17:43.213032 17645 tablet_bootstrap.cc:492] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:43.213640 17645 ts_tablet_manager.cc:1403] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.138s	user 0.010s	sys 0.001s
I20260709 13:17:43.214542 17419 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:43.215726 17704 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:43.216179 17704 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.216645 17704 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.217259 17645 raft_consensus.cc:359] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.218212 17645 raft_consensus.cc:385] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.218567 17645 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.219367 17645 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.224972 17717 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:43.226511 17569 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:43.227576 17691 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:43.229310 17723 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.243716 17645 ts_tablet_manager.cc:1434] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:17:43.247259 17725 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:43.252336 17723 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:43.248868 17692 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.251695 17722 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:43.259276 17645 tablet_bootstrap.cc:492] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:43.261639 17692 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.275820 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:43.276278 17692 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.276510 17453 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:43.276031 17722 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:17:43.283875 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:43.284987 17691 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:43.285521 17691 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.285946 17691 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.287164 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:43.288059 17603 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:43.294265 17705 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:43.364404 17722 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:43.371433 17722 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:43.369524 17652 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.386554 17454 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.390050 17652 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.388698 17704 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.392030 17725 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:43.392369 17692 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:43.405793 17725 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:43.377949 17691 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.427137 17644 tablet_bootstrap.cc:492] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:43.427793 17644 ts_tablet_manager.cc:1403] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.252s	user 0.034s	sys 0.119s
I20260709 13:17:43.431459 17643 tablet_bootstrap.cc:492] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:43.431924 17643 ts_tablet_manager.cc:1403] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.238s	user 0.071s	sys 0.085s
I20260709 13:17:43.422736 17692 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.450815 17645 tablet_bootstrap.cc:654] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.438526 17767 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:17:43.435488 17692 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.462749 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:43.463390 17451 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.463825 17692 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.472939 17644 raft_consensus.cc:359] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.473536 17644 raft_consensus.cc:385] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.473762 17644 raft_consensus.cc:740] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.474375 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:43.474596 17644 consensus_queue.cc:260] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.475010 17601 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.474601 17643 raft_consensus.cc:359] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.475606 17643 raft_consensus.cc:385] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.475939 17643 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.459631 17704 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.465106 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:43.479935 17643 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.486234 17644 ts_tablet_manager.cc:1434] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.001s
I20260709 13:17:43.492259 17652 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.494737 17643 ts_tablet_manager.cc:1434] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.002s
I20260709 13:17:43.495874 17643 tablet_bootstrap.cc:492] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:43.483863 17529 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.493202 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:43.506340 17777 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.510380 17603 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.525332 17644 tablet_bootstrap.cc:492] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:43.527112 17652 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:43.540788 17768 log.cc:927] Time spent T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:17:43.540903 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:17:43.543874 17772 log.cc:927] Time spent T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:17:43.565621 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:43.567543 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:43.568446 17600 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
W20260709 13:17:43.571009 17773 log.cc:927] Time spent T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:43.557448 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:43.532353 17777 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.541401 17652 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.583280 17420 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:43.585889 17704 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:43.588873 17769 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.172s	user 0.000s	sys 0.006s
I20260709 13:17:43.589488 17529 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:43.581130 17725 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:43.594925 17778 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:43.590219 17691 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.594585 17725 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.604857 17725 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:43.605588 17603 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:43.606828 17420 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:43.608459 17451 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:43.608999 17704 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:43.609949 17776 log.cc:927] Time spent T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:17:43.610152 17704 raft_consensus.cc:697] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:43.611068 17704 consensus_queue.cc:237] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.612130 17644 tablet_bootstrap.cc:654] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.617012 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:43.616657 17781 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:17:43.619761 17652 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.620748 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:43.629469 17601 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:43.649449 17645 tablet_bootstrap.cc:492] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:43.654595 17645 ts_tablet_manager.cc:1403] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.397s	user 0.013s	sys 0.008s
I20260709 13:17:43.627350 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:17:43.679852 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 52294.3us
I20260709 13:17:43.711958 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:43.713021 17777 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.720853 17645 raft_consensus.cc:359] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.721834 17645 raft_consensus.cc:385] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.722204 17645 raft_consensus.cc:740] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.727737 17645 consensus_queue.cc:260] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.732841 17643 tablet_bootstrap.cc:654] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.730471 17645 ts_tablet_manager.cc:1434] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.076s	user 0.012s	sys 0.001s
I20260709 13:17:43.736083 17645 tablet_bootstrap.cc:492] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:43.714632 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:17:43.739046 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 49262.7us
I20260709 13:17:43.739127 17777 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:43.739615 17777 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.739975 17777 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.739817 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:43.744791 17780 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:43.745306 17780 raft_consensus.cc:697] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:43.746188 17780 consensus_queue.cc:237] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:43.755401 17569 leader_election.cc:343] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:43.756989 17495 leader_election.cc:343] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:43.760219 17644 tablet_bootstrap.cc:492] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:43.760855 17644 ts_tablet_manager.cc:1403] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.236s	user 0.041s	sys 0.043s
I20260709 13:17:43.759763 17723 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:17:43.774770 17527 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:43.775882 17420 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:43.776993 17705 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:43.782675 17568 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:43.783972 17717 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:43.785174 17723 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:43.785609 17723 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.786826 17723 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.789258 17645 tablet_bootstrap.cc:654] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:43.802080 17643 tablet_bootstrap.cc:492] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:43.802593 17643 ts_tablet_manager.cc:1403] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.307s	user 0.013s	sys 0.013s
I20260709 13:17:43.821811 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:43.822852 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:43.835654 17643 raft_consensus.cc:359] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.836413 17643 raft_consensus.cc:385] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.840410 17643 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.841311 17643 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.856621 17450 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.881844 17780 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:43.884747 17495 leader_election.cc:343] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:43.896528 17643 ts_tablet_manager.cc:1434] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.094s	user 0.005s	sys 0.003s
I20260709 13:17:43.899730 17352 catalog_manager.cc:5697] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.909922 17777 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.915606 17644 raft_consensus.cc:359] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.919410 17351 catalog_manager.cc:5697] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.922930 17644 raft_consensus.cc:385] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:43.926234 17644 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:43.927675 17643 tablet_bootstrap.cc:492] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:43.931080 17644 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.934393 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:43.935041 17453 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.939580 17644 ts_tablet_manager.cc:1434] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.177s	user 0.006s	sys 0.002s
I20260709 13:17:43.922573 17723 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.932929 17602 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:43.948729 17767 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.949249 17767 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.950912 17453 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:43.953701 17723 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:43.954375 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:43.954454 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:43.955075 17527 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.955818 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:43.958449 17780 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:43.959473 17782 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:43.959654 17780 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.960041 17782 raft_consensus.cc:697] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:43.961113 17782 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.962100 17644 tablet_bootstrap.cc:492] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:43.960068 17780 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:43.965296 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:17:43.966722 17569 leader_election.cc:343] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:43.968149 17781 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:43.973874 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:43.977523 17780 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.981876 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:43.984450 17780 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.985430 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:43.986320 17705 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:43.981298 17767 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.990411 17777 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:43.992650 17527 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:43.993813 17568 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:43.995113 17725 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:43.995596 17725 raft_consensus.cc:697] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:43.996660 17725 consensus_queue.cc:237] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:43.997560 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:44.001493 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:44.002324 17598 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.008683 17645 tablet_bootstrap.cc:492] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:44.009163 17645 ts_tablet_manager.cc:1403] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.273s	user 0.020s	sys 0.007s
I20260709 13:17:44.014628 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:44.017257 17602 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:44.040850 17495 leader_election.cc:343] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.048465 17602 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:44.051604 17643 tablet_bootstrap.cc:654] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.052507 17645 raft_consensus.cc:359] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.053241 17645 raft_consensus.cc:385] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.053392 17644 tablet_bootstrap.cc:654] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.053573 17645 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.055016 17598 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:44.054854 17645 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.057746 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:44.058574 17645 ts_tablet_manager.cc:1434] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:17:44.059582 17645 tablet_bootstrap.cc:492] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:44.060686 17782 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.066218 17782 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:17:44.076224 17400 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:44.067044 17782 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.079167 17352 catalog_manager.cc:5697] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.095008 17645 tablet_bootstrap.cc:654] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.102473 17351 catalog_manager.cc:5697] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.105067 17780 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.107043 17767 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.105577 17780 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.118820 17780 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:44.121296 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:17:44.123471 17495 leader_election.cc:343] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.125070 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:44.127182 17495 leader_election.cc:343] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.127722 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:44.129106 17691 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.141693 17643 tablet_bootstrap.cc:492] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:44.142266 17643 ts_tablet_manager.cc:1403] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.244s	user 0.017s	sys 0.007s
I20260709 13:17:44.149513 17643 raft_consensus.cc:359] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.150178 17643 raft_consensus.cc:385] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.151743 17644 tablet_bootstrap.cc:492] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:44.152212 17644 ts_tablet_manager.cc:1403] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.190s	user 0.017s	sys 0.033s
I20260709 13:17:44.156513 17644 raft_consensus.cc:359] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.157192 17644 raft_consensus.cc:385] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.157454 17644 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.157965 17645 tablet_bootstrap.cc:492] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:44.158447 17645 ts_tablet_manager.cc:1403] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.099s	user 0.028s	sys 0.018s
I20260709 13:17:44.159714 17350 catalog_manager.cc:5697] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.161094 17645 raft_consensus.cc:359] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.150455 17643 raft_consensus.cc:740] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.161773 17645 raft_consensus.cc:385] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.162107 17645 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.158209 17644 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.162487 17643 consensus_queue.cc:260] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.162724 17645 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.164669 17644 ts_tablet_manager.cc:1434] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:17:44.165001 17643 ts_tablet_manager.cc:1434] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:17:44.166407 17643 tablet_bootstrap.cc:492] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:44.167858 17645 ts_tablet_manager.cc:1434] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:44.168768 17645 tablet_bootstrap.cc:492] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:44.175034 17645 tablet_bootstrap.cc:654] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.175392 17652 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.165588 17644 tablet_bootstrap.cc:492] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:44.184010 17723 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.184494 17723 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.185741 17644 tablet_bootstrap.cc:654] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.186534 17723 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:44.188161 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:44.188927 17526 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:44.191330 17568 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:44.192646 17725 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.193167 17725 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.193594 17725 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.197657 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:44.202306 17569 leader_election.cc:343] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.214840 17691 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.236009 17643 tablet_bootstrap.cc:654] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.244650 17725 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.247376 17645 tablet_bootstrap.cc:492] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:44.247985 17645 ts_tablet_manager.cc:1403] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.079s	user 0.022s	sys 0.053s
I20260709 13:17:44.249835 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:44.251626 17645 raft_consensus.cc:359] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:44.252405 17569 leader_election.cc:343] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.252559 17645 raft_consensus.cc:385] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.252978 17645 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.256707 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:44.257341 17526 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.257984 17643 tablet_bootstrap.cc:492] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:44.258626 17643 ts_tablet_manager.cc:1403] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.000s
I20260709 13:17:44.261924 17643 raft_consensus.cc:359] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.262823 17643 raft_consensus.cc:385] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.263101 17643 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.264194 17645 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.266564 17691 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.267313 17645 ts_tablet_manager.cc:1434] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:17:44.268554 17645 tablet_bootstrap.cc:492] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:44.269938 17643 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.272742 17643 ts_tablet_manager.cc:1434] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:17:44.273896 17643 tablet_bootstrap.cc:492] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:44.283566 17645 tablet_bootstrap.cc:654] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.275676 17725 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:44.298789 17526 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:44.300595 17568 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:44.302119 17725 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.302611 17725 raft_consensus.cc:697] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:44.305652 17725 consensus_queue.cc:237] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.308377 17644 tablet_bootstrap.cc:492] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:44.308845 17644 ts_tablet_manager.cc:1403] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.143s	user 0.050s	sys 0.063s
I20260709 13:17:44.317142 17644 raft_consensus.cc:359] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.320514 17644 raft_consensus.cc:385] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.320952 17644 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.322618 17644 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.324837 17644 ts_tablet_manager.cc:1434] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:17:44.325799 17644 tablet_bootstrap.cc:492] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:44.325867 17643 tablet_bootstrap.cc:654] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.328071 17645 tablet_bootstrap.cc:492] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:44.328497 17645 ts_tablet_manager.cc:1403] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.013s
I20260709 13:17:44.331243 17644 tablet_bootstrap.cc:654] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.330958 17645 raft_consensus.cc:359] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.331621 17645 raft_consensus.cc:385] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.331552 17652 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.331990 17645 raft_consensus.cc:740] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.332118 17652 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.332638 17645 consensus_queue.cc:260] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.336581 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:44.337376 17598 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:17:44.338471 17645 ts_tablet_manager.cc:1434] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:17:44.335191 17652 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:44.339442 17645 tablet_bootstrap.cc:492] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:44.339576 17350 catalog_manager.cc:5697] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.339576 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:44.344540 17419 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:44.345954 17652 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.363242 17645 tablet_bootstrap.cc:654] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.365103 17652 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.374639 17643 tablet_bootstrap.cc:492] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:44.375792 17643 ts_tablet_manager.cc:1403] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.102s	user 0.030s	sys 0.002s
I20260709 13:17:44.378646 17645 tablet_bootstrap.cc:492] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:44.378616 17643 raft_consensus.cc:359] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.379189 17645 ts_tablet_manager.cc:1403] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.002s
I20260709 13:17:44.379294 17643 raft_consensus.cc:385] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.379585 17643 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.380368 17643 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.382002 17645 raft_consensus.cc:359] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.382414 17643 ts_tablet_manager.cc:1434] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:44.382738 17645 raft_consensus.cc:385] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.383009 17645 raft_consensus.cc:740] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.383671 17645 consensus_queue.cc:260] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.391757 17644 tablet_bootstrap.cc:492] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:44.392195 17644 ts_tablet_manager.cc:1403] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.038s
I20260709 13:17:44.393668 17645 ts_tablet_manager.cc:1434] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:17:44.393985 17643 tablet_bootstrap.cc:492] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:44.394553 17644 raft_consensus.cc:359] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.395226 17644 raft_consensus.cc:385] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.395473 17644 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.396231 17644 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.398355 17645 tablet_bootstrap.cc:492] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:44.398878 17644 ts_tablet_manager.cc:1434] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:17:44.399803 17644 tablet_bootstrap.cc:492] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:44.403445 17643 tablet_bootstrap.cc:654] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.405112 17644 tablet_bootstrap.cc:654] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.407022 17645 tablet_bootstrap.cc:654] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.415391 17644 tablet_bootstrap.cc:492] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:44.415894 17644 ts_tablet_manager.cc:1403] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:17:44.416193 17645 tablet_bootstrap.cc:492] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:44.416613 17645 ts_tablet_manager.cc:1403] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.001s
I20260709 13:17:44.417001 17643 tablet_bootstrap.cc:492] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:44.417428 17643 ts_tablet_manager.cc:1403] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.003s
I20260709 13:17:44.418592 17645 raft_consensus.cc:359] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.418462 17644 raft_consensus.cc:359] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.419184 17645 raft_consensus.cc:385] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.419312 17644 raft_consensus.cc:385] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.419519 17645 raft_consensus.cc:740] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.419636 17644 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.419907 17643 raft_consensus.cc:359] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.420569 17643 raft_consensus.cc:385] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.420194 17645 consensus_queue.cc:260] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.420847 17643 raft_consensus.cc:740] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.420904 17644 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.421564 17643 consensus_queue.cc:260] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.423013 17644 ts_tablet_manager.cc:1434] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:17:44.424021 17644 tablet_bootstrap.cc:492] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:44.423758 17777 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.424496 17645 ts_tablet_manager.cc:1434] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:17:44.425347 17645 tablet_bootstrap.cc:492] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:44.431034 17645 tablet_bootstrap.cc:654] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.423754 17643 ts_tablet_manager.cc:1434] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:44.436969 17643 tablet_bootstrap.cc:492] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:44.440054 17691 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.444303 17691 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.444808 17691 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.444898 17652 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.446206 17652 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.447435 17691 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:44.448345 17652 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:44.447674 17643 tablet_bootstrap.cc:654] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.449883 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:44.450749 17601 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:44.450831 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:44.452246 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:44.452435 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:44.453510 17691 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.454062 17691 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.454402 17691 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.454526 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:44.455296 17526 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:17:44.456442 17419 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:44.457523 17652 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:44.456533 17495 leader_election.cc:343] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.459270 17644 tablet_bootstrap.cc:654] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.462954 17643 tablet_bootstrap.cc:492] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:44.463471 17643 ts_tablet_manager.cc:1403] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.001s
I20260709 13:17:44.468364 17691 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.469146 17652 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.472949 17643 raft_consensus.cc:359] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.473307 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:44.473598 17643 raft_consensus.cc:385] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.473856 17643 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.474521 17643 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.479569 17643 ts_tablet_manager.cc:1434] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:17:44.480311 17643 tablet_bootstrap.cc:492] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
W20260709 13:17:44.478938 17495 leader_election.cc:343] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.553236 17645 tablet_bootstrap.cc:492] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:44.553709 17645 ts_tablet_manager.cc:1403] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.129s	user 0.023s	sys 0.032s
I20260709 13:17:44.544684 17780 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.554520 17780 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.557729 17780 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:44.481770 17691 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:44.557780 17645 raft_consensus.cc:359] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.562987 17645 raft_consensus.cc:385] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.563241 17645 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.563975 17645 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:44.556537 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 77772.6us
I20260709 13:17:44.567124 17645 ts_tablet_manager.cc:1434] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:17:44.567256 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:44.568531 17645 tablet_bootstrap.cc:492] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:44.567858 17598 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.568944 17652 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.571894 17652 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.576751 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:44.577535 17526 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:17:44.578383 17598 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:44.579008 17652 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:44.581459 17789 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.581961 17789 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.584321 17789 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:44.584810 17643 tablet_bootstrap.cc:654] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.586359 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:44.586841 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:44.586970 17526 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:44.587512 17453 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:44.588213 17568 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:44.589486 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:44.590553 17789 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.590719 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:44.589486 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:44.591009 17789 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.591548 17789 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.592070 17780 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.592531 17780 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.594357 17725 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.595412 17644 tablet_bootstrap.cc:492] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:44.595530 17723 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.595856 17644 ts_tablet_manager.cc:1403] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.172s	user 0.007s	sys 0.022s
I20260709 13:17:44.595947 17723 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.596302 17420 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:44.601524 17652 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.602876 17723 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:44.604001 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:17:44.606176 17569 leader_election.cc:343] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.606873 17691 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.605027 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:44.607506 17691 raft_consensus.cc:697] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:44.608171 17449 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:44.608789 17691 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.609860 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:44.610634 17723 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.610978 17723 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.611280 17723 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.615569 17644 raft_consensus.cc:359] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.616328 17780 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:44.616616 17644 raft_consensus.cc:385] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.617136 17644 raft_consensus.cc:740] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.618101 17644 consensus_queue.cc:260] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:44.621860 17495 leader_election.cc:343] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.623111 17645 tablet_bootstrap.cc:654] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.628901 17644 ts_tablet_manager.cc:1434] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.006s
I20260709 13:17:44.629930 17644 tablet_bootstrap.cc:492] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:44.632527 17643 tablet_bootstrap.cc:492] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:44.633028 17643 ts_tablet_manager.cc:1403] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.153s	user 0.022s	sys 0.007s
I20260709 13:17:44.636624 17652 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.638504 17644 tablet_bootstrap.cc:654] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.638638 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:44.639719 17526 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:44.656432 17725 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:44.657950 17352 catalog_manager.cc:5697] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.683585 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:44.647795 17789 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.684742 17723 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.696535 17691 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:44.696959 17691 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.697304 17691 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.698918 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:44.699529 17451 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:44.700145 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 52213.9us
I20260709 13:17:44.698726 17723 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:44.700843 17780 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.703787 17780 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.704231 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:44.712965 17691 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.718676 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:44.719336 17598 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:44.702553 17789 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:44.728763 17643 raft_consensus.cc:359] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.729718 17643 raft_consensus.cc:385] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.730077 17643 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.732885 17643 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.737928 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:44.741761 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:44.742340 17450 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.742451 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:44.746188 17691 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:44.741660 17780 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:44.748417 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:44.748855 17450 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:44.751175 17644 tablet_bootstrap.cc:492] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:44.752492 17644 ts_tablet_manager.cc:1403] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.123s	user 0.014s	sys 0.003s
I20260709 13:17:44.758755 17780 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:17:44.758833 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 103325us
I20260709 13:17:44.759307 17780 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.759709 17780 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.790454 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:44.791570 17782 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:44.775023 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 72254.3us
W20260709 13:17:44.794099 17569 leader_election.cc:343] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.798375 17451 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:44.799916 17644 raft_consensus.cc:359] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.800653 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:44.821408 17526 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.802838 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:44.822330 17527 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.803431 17645 tablet_bootstrap.cc:492] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:44.826203 17645 ts_tablet_manager.cc:1403] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.258s	user 0.018s	sys 0.007s
I20260709 13:17:44.828255 17526 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:44.828979 17644 raft_consensus.cc:385] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.829707 17644 raft_consensus.cc:740] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.830431 17644 consensus_queue.cc:260] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.830796 17568 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:44.831538 17723 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.832078 17723 raft_consensus.cc:697] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:44.832580 17644 ts_tablet_manager.cc:1434] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260709 13:17:44.832983 17723 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.806156 17832 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.809017 17691 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.812570 17643 ts_tablet_manager.cc:1434] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.179s	user 0.005s	sys 0.010s
I20260709 13:17:44.839941 17527 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:44.839960 17643 tablet_bootstrap.cc:492] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:44.832363 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:44.841718 17723 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.812917 17780 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.843899 17780 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:17:44.820785 17495 leader_election.cc:343] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.842231 17723 raft_consensus.cc:697] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:44.844952 17723 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.845798 17704 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:44.846424 17495 leader_election.cc:343] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.846303 17704 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.848089 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:44.848376 17704 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:44.849557 17691 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.856333 17691 raft_consensus.cc:697] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:44.849489 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:44.858952 17643 tablet_bootstrap.cc:654] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.857435 17691 consensus_queue.cc:237] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.850935 17789 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:44.851610 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:44.852268 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:44.865490 17526 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:17:44.852916 17644 tablet_bootstrap.cc:492] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:44.840919 17645 raft_consensus.cc:359] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.866600 17645 raft_consensus.cc:385] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.866866 17645 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.866897 17419 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:44.867703 17645 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.868372 17704 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.869798 17645 ts_tablet_manager.cc:1434] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:17:44.870864 17645 tablet_bootstrap.cc:492] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:44.872826 17644 tablet_bootstrap.cc:654] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.876722 17645 tablet_bootstrap.cc:654] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.884930 17643 tablet_bootstrap.cc:492] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:44.885389 17643 ts_tablet_manager.cc:1403] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.002s
I20260709 13:17:44.887974 17643 raft_consensus.cc:359] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.888686 17643 raft_consensus.cc:385] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.888993 17643 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.889842 17643 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.890381 17352 catalog_manager.cc:5697] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.893092 17643 ts_tablet_manager.cc:1434] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:44.894218 17643 tablet_bootstrap.cc:492] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:44.895102 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:44.897485 17704 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.898247 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:44.899667 17602 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:44.908635 17602 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:44.908104 17643 tablet_bootstrap.cc:654] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:44.911159 17495 leader_election.cc:343] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:44.912459 17495 leader_election.cc:343] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.912858 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:44.920354 17643 tablet_bootstrap.cc:492] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:44.920783 17643 ts_tablet_manager.cc:1403] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 13:17:44.923302 17643 raft_consensus.cc:359] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.923957 17643 raft_consensus.cc:385] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.924223 17643 raft_consensus.cc:740] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:44.924853 17643 consensus_queue.cc:260] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.936110 17782 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:44.936309 17781 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.936868 17781 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.939182 17781 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:44.940900 17352 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.942569 17643 ts_tablet_manager.cc:1434] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 13:17:44.942500 17352 catalog_manager.cc:5697] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.943463 17643 tablet_bootstrap.cc:492] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:44.951243 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:44.952497 17781 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:44.952956 17781 raft_consensus.cc:697] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:44.953773 17781 consensus_queue.cc:237] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.955677 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:44.957872 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:44.960451 17645 tablet_bootstrap.cc:492] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:44.960886 17645 ts_tablet_manager.cc:1403] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.016s
I20260709 13:17:44.964255 17643 tablet_bootstrap.cc:654] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:44.964409 17645 raft_consensus.cc:359] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.965083 17645 raft_consensus.cc:385] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.965425 17645 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
W20260709 13:17:44.977411 17495 leader_election.cc:343] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:44.980592 17495 leader_election.cc:343] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.983899 17645 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.992452 17644 tablet_bootstrap.cc:492] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:44.992748 17645 ts_tablet_manager.cc:1434] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:17:44.993038 17644 ts_tablet_manager.cc:1403] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.140s	user 0.016s	sys 0.008s
I20260709 13:17:44.993965 17645 tablet_bootstrap.cc:492] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:44.996358 17644 raft_consensus.cc:359] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:44.997165 17644 raft_consensus.cc:385] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:44.997757 17644 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
W20260709 13:17:44.997110 17495 leader_election.cc:343] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:44.998553 17644 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.001801 17644 ts_tablet_manager.cc:1434] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:17:45.002861 17644 tablet_bootstrap.cc:492] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:44.999064 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:45.008255 17691 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:45.009075 17643 tablet_bootstrap.cc:492] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:45.010138 17643 ts_tablet_manager.cc:1403] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.067s	user 0.022s	sys 0.013s
I20260709 13:17:45.012887 17644 tablet_bootstrap.cc:654] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.014451 17643 raft_consensus.cc:359] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.015163 17643 raft_consensus.cc:385] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.015499 17643 raft_consensus.cc:740] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.015781 17351 catalog_manager.cc:5697] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.027758 17643 consensus_queue.cc:260] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.029969 17643 ts_tablet_manager.cc:1434] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:17:45.030789 17704 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.031281 17704 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.032594 17645 tablet_bootstrap.cc:654] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.033301 17704 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.037808 17645 tablet_bootstrap.cc:492] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:45.038518 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:45.039294 17601 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:17:45.039332 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.039746 17643 tablet_bootstrap.cc:492] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:45.040657 17645 ts_tablet_manager.cc:1403] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.003s
I20260709 13:17:45.042760 17419 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:45.043495 17704 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.045465 17645 raft_consensus.cc:359] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.045948 17645 raft_consensus.cc:385] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.046214 17645 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.046980 17644 tablet_bootstrap.cc:492] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:45.046940 17645 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.047504 17644 ts_tablet_manager.cc:1403] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.045s	user 0.003s	sys 0.007s
I20260709 13:17:45.049639 17645 ts_tablet_manager.cc:1434] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:45.050891 17643 tablet_bootstrap.cc:654] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.052103 17644 raft_consensus.cc:359] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.053766 17644 raft_consensus.cc:385] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.054049 17644 raft_consensus.cc:740] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.054656 17644 consensus_queue.cc:260] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.056649 17644 ts_tablet_manager.cc:1434] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:45.053094 17645 tablet_bootstrap.cc:492] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:45.063228 17645 tablet_bootstrap.cc:654] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.065649 17644 tablet_bootstrap.cc:492] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:45.076750 17644 tablet_bootstrap.cc:654] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.086901 17644 tablet_bootstrap.cc:492] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:45.086795 17704 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:45.087559 17644 ts_tablet_manager.cc:1403] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 13:17:45.090682 17645 tablet_bootstrap.cc:492] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:45.090737 17643 tablet_bootstrap.cc:492] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:45.091217 17645 ts_tablet_manager.cc:1403] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.001s
I20260709 13:17:45.091501 17643 ts_tablet_manager.cc:1403] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.052s	user 0.027s	sys 0.020s
I20260709 13:17:45.093309 17644 raft_consensus.cc:359] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.094005 17644 raft_consensus.cc:385] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.093696 17645 raft_consensus.cc:359] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.094312 17644 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.094487 17645 raft_consensus.cc:385] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.095032 17645 raft_consensus.cc:740] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.094467 17643 raft_consensus.cc:359] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.095106 17644 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.095727 17643 raft_consensus.cc:385] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.096055 17643 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.096799 17645 consensus_queue.cc:260] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.097527 17643 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.099073 17644 ts_tablet_manager.cc:1434] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.006s
I20260709 13:17:45.100314 17644 tablet_bootstrap.cc:492] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:45.106518 17644 tablet_bootstrap.cc:654] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.113485 17643 ts_tablet_manager.cc:1434] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:17:45.114605 17643 tablet_bootstrap.cc:492] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:45.118960 17691 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.120939 17643 tablet_bootstrap.cc:654] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.128201 17645 ts_tablet_manager.cc:1434] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:17:45.135062 17645 tablet_bootstrap.cc:492] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:45.142732 17643 tablet_bootstrap.cc:492] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:45.146953 17643 ts_tablet_manager.cc:1403] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.008s
I20260709 13:17:45.150825 17643 raft_consensus.cc:359] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.151808 17643 raft_consensus.cc:385] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.152184 17643 raft_consensus.cc:740] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.171988 17644 tablet_bootstrap.cc:492] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:45.172386 17645 tablet_bootstrap.cc:654] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.172534 17644 ts_tablet_manager.cc:1403] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.027s
I20260709 13:17:45.153095 17643 consensus_queue.cc:260] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.176385 17644 raft_consensus.cc:359] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.177064 17644 raft_consensus.cc:385] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.177381 17644 raft_consensus.cc:740] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.178197 17644 consensus_queue.cc:260] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.178213 17643 ts_tablet_manager.cc:1434] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:17:45.183925 17789 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.184475 17789 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.186769 17789 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.188901 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.189302 17691 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.189635 17526 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:45.191061 17568 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:45.191866 17643 tablet_bootstrap.cc:492] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:45.193307 17789 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:45.194315 17725 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.194921 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:45.194816 17725 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:45.196393 17569 leader_election.cc:343] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.197252 17725 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.198710 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:45.198992 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.199527 17453 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:45.199687 17526 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:45.200238 17643 tablet_bootstrap.cc:654] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.202332 17725 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.201362 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:45.205745 17644 ts_tablet_manager.cc:1434] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:17:45.205475 17725 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.208627 17723 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:45.220002 17723 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.220357 17723 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.220487 17644 tablet_bootstrap.cc:492] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:45.220686 17643 tablet_bootstrap.cc:492] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:45.221109 17643 ts_tablet_manager.cc:1403] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:17:45.221367 17725 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.223803 17643 raft_consensus.cc:359] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.224589 17643 raft_consensus.cc:385] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.224879 17643 raft_consensus.cc:740] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
W20260709 13:17:45.214584 17400 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:45.193718 17789 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.219300 17705 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.226840 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:45.226511 17705 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.227664 17450 raft_consensus.cc:2393] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 1: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:17:45.225781 17723 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.229740 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.229830 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.230402 17526 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:45.230584 17723 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.231534 17419 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:45.231859 17568 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:45.232105 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:45.232334 17704 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:45.232733 17704 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.232674 17450 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.233134 17704 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.233338 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:45.233946 17527 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.236040 17705 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.240029 17450 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:45.241324 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:45.242159 17725 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.243014 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:45.243635 17601 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:45.244428 17834 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:45.244904 17834 raft_consensus.cc:697] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:45.246696 17830 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.247198 17830 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.225569 17643 consensus_queue.cc:260] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.245767 17834 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.249907 17789 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.250150 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:45.251526 17643 ts_tablet_manager.cc:1434] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:17:45.252549 17643 tablet_bootstrap.cc:492] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:45.253623 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.254249 17526 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:45.255424 17568 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:45.255714 17830 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.256595 17691 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.256966 17830 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:45.257359 17830 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.257031 17691 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.257671 17830 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.259048 17691 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.260776 17527 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:45.261265 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:45.262681 17495 leader_election.cc:343] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.263340 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:17:45.264631 17495 leader_election.cc:343] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.265045 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:45.266687 17643 tablet_bootstrap.cc:654] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.255867 17725 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:45.268996 17644 tablet_bootstrap.cc:654] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.268164 17691 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:45.273041 17725 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.278352 17645 tablet_bootstrap.cc:492] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:45.278770 17645 ts_tablet_manager.cc:1403] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.014s
I20260709 13:17:45.275586 17789 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.280175 17704 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.281387 17453 raft_consensus.cc:2393] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 1: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:17:45.281620 17645 raft_consensus.cc:359] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.282543 17645 raft_consensus.cc:385] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.282928 17645 raft_consensus.cc:740] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.283849 17645 consensus_queue.cc:260] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.285827 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:45.286232 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:45.286757 17527 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:45.287364 17569 leader_election.cc:343] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.289354 17704 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.291134 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:45.295830 17789 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.297456 17645 ts_tablet_manager.cc:1434] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:17:45.298868 17645 tablet_bootstrap.cc:492] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:45.298267 17830 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.305099 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:45.306748 17526 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.306623 17789 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.309309 17601 raft_consensus.cc:2393] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:17:45.306334 17643 tablet_bootstrap.cc:492] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:45.313458 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:45.313521 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:45.314572 17451 raft_consensus.cc:2393] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 1: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:17:45.316119 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:45.316970 17789 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:45.313958 17643 ts_tablet_manager.cc:1403] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.000s
I20260709 13:17:45.319401 17526 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:45.320431 17643 raft_consensus.cc:359] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.320609 17419 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:45.321132 17643 raft_consensus.cc:385] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.321244 17704 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.321472 17643 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.321540 17705 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:45.321858 17704 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.322254 17705 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:45.323104 17830 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.323822 17705 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.324843 17704 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.325160 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.325341 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:45.326181 17601 raft_consensus.cc:2393] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:17:45.328146 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:45.331120 17527 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:45.331799 17704 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.337432 17652 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.337924 17652 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.339912 17652 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.340659 17723 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.342186 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.342828 17524 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:45.344290 17419 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:45.345583 17568 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:45.334849 17645 tablet_bootstrap.cc:654] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.335044 17830 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.346614 17789 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:45.347147 17789 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:45.348232 17704 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:45.348083 17789 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.322180 17643 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.350069 17652 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:45.351151 17652 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.351562 17652 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.352236 17643 ts_tablet_manager.cc:1434] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:17:45.353106 17643 tablet_bootstrap.cc:492] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:45.352754 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:17:45.354393 17420 leader_election.cc:343] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.358794 17350 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.361495 17643 tablet_bootstrap.cc:654] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.364972 17644 tablet_bootstrap.cc:492] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:45.365458 17644 ts_tablet_manager.cc:1403] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.145s	user 0.011s	sys 0.001s
I20260709 13:17:45.360137 17652 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.369573 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:45.370376 17526 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.379750 17644 raft_consensus.cc:359] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.380493 17644 raft_consensus.cc:385] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.380770 17644 raft_consensus.cc:740] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.381280 17780 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.383745 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:17:45.385327 17420 leader_election.cc:343] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.386273 17351 catalog_manager.cc:5697] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.388561 17652 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.393186 17644 consensus_queue.cc:260] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.393523 17704 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.394182 17704 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.394953 17644 ts_tablet_manager.cc:1434] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 13:17:45.396068 17644 tablet_bootstrap.cc:492] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:45.407127 17526 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:45.408332 17419 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:45.409192 17704 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.411990 17645 tablet_bootstrap.cc:492] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:45.413534 17645 ts_tablet_manager.cc:1403] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.006s
I20260709 13:17:45.414331 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:45.411115 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.413204 17652 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:45.418354 17652 raft_consensus.cc:697] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:45.419162 17652 consensus_queue.cc:237] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.420099 17643 tablet_bootstrap.cc:492] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:45.420436 17643 ts_tablet_manager.cc:1403] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.001s
I20260709 13:17:45.422591 17643 raft_consensus.cc:359] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.422995 17529 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:17:45.423303 17643 raft_consensus.cc:385] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.423817 17643 raft_consensus.cc:740] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.424574 17643 consensus_queue.cc:260] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.425695 17419 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:45.427016 17643 ts_tablet_manager.cc:1434] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:17:45.428051 17643 tablet_bootstrap.cc:492] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:45.428181 17652 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.429551 17644 tablet_bootstrap.cc:654] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.437008 17704 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.437700 17704 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.437134 17652 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:45.439627 17782 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.440011 17704 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.440256 17782 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.442490 17782 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.444331 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.446332 17781 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.448724 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:45.457487 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:45.458390 17601 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:45.464363 17645 raft_consensus.cc:359] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.468595 17643 tablet_bootstrap.cc:654] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.468647 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:45.466355 17645 raft_consensus.cc:385] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.470156 17645 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
W20260709 13:17:45.470414 17495 leader_election.cc:343] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.474457 17645 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.474399 17351 catalog_manager.cc:5697] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.475984 17782 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.476805 17645 ts_tablet_manager.cc:1434] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.000s
I20260709 13:17:45.477792 17645 tablet_bootstrap.cc:492] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
W20260709 13:17:45.459720 17419 leader_election.cc:343] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.482652 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:17:45.484524 17495 leader_election.cc:343] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.484787 17704 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:45.484987 17495 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:45.485222 17704 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.485613 17704 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.486598 17781 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:45.489527 17781 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.490038 17781 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.493549 17644 tablet_bootstrap.cc:492] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:45.494261 17644 ts_tablet_manager.cc:1403] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.037s
I20260709 13:17:45.493649 17350 catalog_manager.cc:5697] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.498404 17781 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.498811 17704 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.501542 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:45.502697 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:45.503814 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:17:45.505437 17419 leader_election.cc:343] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:45.506791 17495 leader_election.cc:343] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.501577 17704 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.508558 17644 raft_consensus.cc:359] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.509866 17644 raft_consensus.cc:385] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:45.511363 17495 leader_election.cc:343] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.514133 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:45.514971 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:45.511821 17691 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.515573 17601 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.516161 17782 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:45.517184 17644 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.517896 17644 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.520288 17644 ts_tablet_manager.cc:1434] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:17:45.522939 17644 tablet_bootstrap.cc:492] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:45.513762 17645 tablet_bootstrap.cc:654] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.527729 17643 tablet_bootstrap.cc:492] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:45.528244 17643 ts_tablet_manager.cc:1403] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.000s
I20260709 13:17:45.533263 17644 tablet_bootstrap.cc:654] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.536398 17643 raft_consensus.cc:359] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.537240 17643 raft_consensus.cc:385] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.537578 17643 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.539343 17643 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.556056 17705 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.556654 17601 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:45.556612 17705 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.556663 17643 ts_tablet_manager.cc:1434] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:17:45.558405 17643 tablet_bootstrap.cc:492] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:45.558339 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:45.558982 17705 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.559338 17867 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:45.559792 17867 raft_consensus.cc:697] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:45.560654 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:45.560611 17867 consensus_queue.cc:237] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:45.562083 17420 leader_election.cc:343] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.564484 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.565104 17527 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:45.565904 17645 tablet_bootstrap.cc:492] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:45.566378 17645 ts_tablet_manager.cc:1403] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.022s
I20260709 13:17:45.566418 17419 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:45.567649 17705 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:45.568003 17705 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.568332 17705 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.569157 17645 raft_consensus.cc:359] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.569835 17645 raft_consensus.cc:385] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.572575 17645 raft_consensus.cc:740] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.564502 17643 tablet_bootstrap.cc:654] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.573457 17645 consensus_queue.cc:260] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.577958 17705 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.579296 17645 ts_tablet_manager.cc:1434] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:17:45.580668 17645 tablet_bootstrap.cc:492] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:45.580809 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:45.581359 17527 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.588153 17705 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.588665 17644 tablet_bootstrap.cc:492] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:45.589131 17644 ts_tablet_manager.cc:1403] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.010s
I20260709 13:17:45.592392 17644 raft_consensus.cc:359] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.593492 17644 raft_consensus.cc:385] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.593752 17644 raft_consensus.cc:740] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.595095 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:17:45.597393 17420 leader_election.cc:343] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.598238 17645 tablet_bootstrap.cc:654] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.598789 17527 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:45.602998 17419 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:45.604478 17867 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:45.605139 17867 raft_consensus.cc:697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:45.604669 17351 catalog_manager.cc:5697] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.606271 17867 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.613336 17705 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.613617 17644 consensus_queue.cc:260] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.613930 17705 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.616216 17705 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.618572 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:45.619256 17601 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:45.620496 17420 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:45.621369 17705 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:45.621752 17644 ts_tablet_manager.cc:1434] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:17:45.621752 17705 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.622337 17705 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.622903 17644 tablet_bootstrap.cc:492] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:45.624297 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.625907 17782 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.626432 17782 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.628603 17782 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.630771 17643 tablet_bootstrap.cc:492] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:45.631130 17644 tablet_bootstrap.cc:654] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.631220 17643 ts_tablet_manager.cc:1403] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.073s	user 0.022s	sys 0.023s
I20260709 13:17:45.633980 17643 raft_consensus.cc:359] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.634425 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:45.635613 17705 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:45.636631 17495 leader_election.cc:343] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:45.637442 17419 leader_election.cc:343] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.637574 17645 tablet_bootstrap.cc:492] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:45.637645 17705 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.634884 17643 raft_consensus.cc:385] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.638216 17645 ts_tablet_manager.cc:1403] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.000s
I20260709 13:17:45.638490 17643 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.639111 17643 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.640507 17643 ts_tablet_manager.cc:1434] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:45.641197 17645 raft_consensus.cc:359] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.641623 17643 tablet_bootstrap.cc:492] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:45.641850 17645 raft_consensus.cc:385] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.642177 17645 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.642867 17645 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.645045 17645 ts_tablet_manager.cc:1434] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:45.645881 17645 tablet_bootstrap.cc:492] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:45.641505 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:17:45.656621 17419 leader_election.cc:343] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.647718 17643 tablet_bootstrap.cc:654] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.648834 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:45.658255 17601 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.658556 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:45.659988 17495 leader_election.cc:343] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.659634 17350 catalog_manager.cc:5697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.660386 17495 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:45.652339 17644 tablet_bootstrap.cc:492] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:45.653139 17834 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.662379 17644 ts_tablet_manager.cc:1403] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:17:45.653787 17645 tablet_bootstrap.cc:654] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.662379 17834 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.665648 17644 raft_consensus.cc:359] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.666316 17644 raft_consensus.cc:385] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.666585 17644 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.667697 17782 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:45.668641 17644 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.670365 17834 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.674197 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.676566 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:45.679493 17453 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:45.681020 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:17:45.682303 17568 leader_election.cc:343] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.676882 17644 ts_tablet_manager.cc:1434] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:17:45.683727 17789 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:45.684126 17644 tablet_bootstrap.cc:492] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:45.684090 17789 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.684502 17789 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.686157 17601 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:45.688293 17420 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:45.690037 17705 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:45.690558 17705 raft_consensus.cc:697] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:45.691665 17644 tablet_bootstrap.cc:654] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.691339 17705 consensus_queue.cc:237] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.692713 17643 tablet_bootstrap.cc:492] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:45.693233 17643 ts_tablet_manager.cc:1403] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.052s	user 0.003s	sys 0.010s
I20260709 13:17:45.693506 17834 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.695864 17643 raft_consensus.cc:359] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.696758 17643 raft_consensus.cc:385] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.697194 17643 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.699060 17643 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.706080 17643 ts_tablet_manager.cc:1434] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:17:45.707685 17643 tablet_bootstrap.cc:492] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:45.708637 17789 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.711936 17644 tablet_bootstrap.cc:492] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:45.712370 17644 ts_tablet_manager.cc:1403] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.001s
I20260709 13:17:45.712447 17351 catalog_manager.cc:5697] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.713797 17643 tablet_bootstrap.cc:654] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.718698 17644 raft_consensus.cc:359] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.719413 17644 raft_consensus.cc:385] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.719719 17644 raft_consensus.cc:740] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.719734 17725 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.720464 17644 consensus_queue.cc:260] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.722599 17644 ts_tablet_manager.cc:1434] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:17:45.723474 17644 tablet_bootstrap.cc:492] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:45.729060 17644 tablet_bootstrap.cc:654] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.736267 17645 tablet_bootstrap.cc:492] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:45.736847 17645 ts_tablet_manager.cc:1403] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.002s
I20260709 13:17:45.739651 17643 tablet_bootstrap.cc:492] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:45.740175 17643 ts_tablet_manager.cc:1403] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.001s
I20260709 13:17:45.740973 17644 tablet_bootstrap.cc:492] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:45.741405 17644 ts_tablet_manager.cc:1403] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 13:17:45.743796 17643 raft_consensus.cc:359] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.744079 17644 raft_consensus.cc:359] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.744465 17830 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:45.744637 17643 raft_consensus.cc:385] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.744773 17644 raft_consensus.cc:385] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.745170 17643 raft_consensus.cc:740] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.745190 17644 raft_consensus.cc:740] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.746109 17644 consensus_queue.cc:260] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.746150 17643 consensus_queue.cc:260] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.747308 17867 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.747740 17867 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.748450 17644 ts_tablet_manager.cc:1434] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:17:45.749289 17644 tablet_bootstrap.cc:492] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:45.749672 17867 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.749949 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:45.750615 17451 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.751741 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:17:45.752890 17419 leader_election.cc:343] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.755578 17644 tablet_bootstrap.cc:654] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.756325 17643 ts_tablet_manager.cc:1434] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:17:45.757146 17643 tablet_bootstrap.cc:492] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:45.759534 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:17:45.760737 17420 leader_election.cc:343] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.761171 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:45.762547 17705 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:45.762389 17723 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.766175 17832 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.766640 17832 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.769186 17832 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.770844 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:45.771466 17450 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:45.773578 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.774477 17529 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:45.776242 17568 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:45.777725 17723 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:45.778285 17723 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.778749 17723 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.784794 17643 tablet_bootstrap.cc:654] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.786864 17645 raft_consensus.cc:359] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.787662 17645 raft_consensus.cc:385] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.787904 17645 raft_consensus.cc:740] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.757745 17451 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:45.788496 17645 consensus_queue.cc:260] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.791721 17645 ts_tablet_manager.cc:1434] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.002s
I20260709 13:17:45.798661 17789 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.805192 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:45.806085 17830 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:45.806813 17830 raft_consensus.cc:697] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:45.807912 17830 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.813401 17723 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.813756 17867 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.815687 17723 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.816308 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:45.817209 17450 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.815721 17867 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:45.824796 17450 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:45.826507 17569 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:45.828202 17832 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:45.829059 17832 raft_consensus.cc:697] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:45.830470 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:45.830235 17832 consensus_queue.cc:237] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:45.833346 17568 leader_election.cc:343] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.837618 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:45.838536 17529 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.864737 17645 tablet_bootstrap.cc:492] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:45.865526 17644 tablet_bootstrap.cc:492] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:45.873466 17644 ts_tablet_manager.cc:1403] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.124s	user 0.025s	sys 0.069s
I20260709 13:17:45.875478 17643 tablet_bootstrap.cc:492] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:45.875991 17643 ts_tablet_manager.cc:1403] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.002s
I20260709 13:17:45.878996 17643 raft_consensus.cc:359] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.879803 17643 raft_consensus.cc:385] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.880075 17643 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.880885 17643 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.881484 17644 raft_consensus.cc:359] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.882181 17644 raft_consensus.cc:385] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.882442 17644 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.883627 17644 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.885811 17644 ts_tablet_manager.cc:1434] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:17:45.886663 17644 tablet_bootstrap.cc:492] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:45.887300 17643 ts_tablet_manager.cc:1434] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:45.888154 17643 tablet_bootstrap.cc:492] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:45.892602 17644 tablet_bootstrap.cc:654] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.893740 17643 tablet_bootstrap.cc:654] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.901942 17789 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.903002 17789 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.905083 17789 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.904874 17350 catalog_manager.cc:5697] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.908691 17781 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.912446 17529 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:45.923394 17781 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.923820 17350 catalog_manager.cc:5697] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.916576 17645 tablet_bootstrap.cc:654] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:45.919606 17705 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:45.927403 17781 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:45.928131 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:45.929859 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.930521 17527 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:45.931579 17568 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:45.922271 17644 tablet_bootstrap.cc:492] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:45.922080 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:45.932490 17644 ts_tablet_manager.cc:1403] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.016s
I20260709 13:17:45.922399 17834 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.933321 17834 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.933751 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:45.934522 17601 raft_consensus.cc:2393] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 1: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:17:45.936614 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:45.936616 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:45.938678 17782 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:45.940842 17569 leader_election.cc:343] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:45.942138 17723 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:45.942549 17723 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.942739 17602 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.942880 17723 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:45.949018 17644 raft_consensus.cc:359] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.950119 17644 raft_consensus.cc:385] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:45.950591 17644 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:45.951414 17644 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.978891 17644 ts_tablet_manager.cc:1434] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:17:45.973807 17834 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:45.982563 17644 tablet_bootstrap.cc:492] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:45.982144 17705 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.014629 17705 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.021283 17705 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:46.023495 17782 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:46.028466 17645 tablet_bootstrap.cc:492] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:46.029019 17645 ts_tablet_manager.cc:1403] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.164s	user 0.016s	sys 0.014s
I20260709 13:17:46.036580 17645 raft_consensus.cc:359] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.037345 17645 raft_consensus.cc:385] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.037611 17645 raft_consensus.cc:740] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.038523 17644 tablet_bootstrap.cc:654] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.038329 17645 consensus_queue.cc:260] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:45.991863 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:46.041464 17643 tablet_bootstrap.cc:492] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:46.042471 17643 ts_tablet_manager.cc:1403] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.154s	user 0.025s	sys 0.044s
I20260709 13:17:46.042624 17645 ts_tablet_manager.cc:1434] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 13:17:46.029019 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:46.040402 17832 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.043788 17524 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:46.043926 17832 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.047160 17832 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:46.048164 17723 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.050351 17723 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:46.051353 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:46.051997 17601 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:46.053049 17598 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:46.053179 17644 tablet_bootstrap.cc:492] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:46.052942 17643 raft_consensus.cc:359] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.053740 17644 ts_tablet_manager.cc:1403] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.000s
I20260709 13:17:46.053659 17643 raft_consensus.cc:385] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.054137 17643 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.054818 17643 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.056257 17643 ts_tablet_manager.cc:1434] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:17:46.056255 17644 raft_consensus.cc:359] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.057109 17644 raft_consensus.cc:385] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.057389 17644 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.057471 17643 tablet_bootstrap.cc:492] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:46.058230 17644 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.060101 17644 ts_tablet_manager.cc:1434] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:46.061080 17644 tablet_bootstrap.cc:492] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:46.104542 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:46.107893 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:17:46.108225 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 87594.2us
I20260709 13:17:46.109534 17527 raft_consensus.cc:2393] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 1: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:17:46.109625 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:46.107007 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:46.110742 17525 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:46.106972 17419 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:46.124236 17645 tablet_bootstrap.cc:492] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:46.128484 17705 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:46.138808 17705 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:46.139647 17705 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.140146 17705 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:46.128916 17652 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:46.146733 17782 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.148092 17782 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.177799 17643 tablet_bootstrap.cc:654] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.180608 17569 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:46.184834 17789 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:46.168651 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 62066.3us
I20260709 13:17:46.191641 17782 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:46.208159 17644 tablet_bootstrap.cc:654] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.207942 17525 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:46.199968 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:17:46.219168 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 105761us
I20260709 13:17:46.224049 17908 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.226511 17652 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:46.228736 17725 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:46.224823 17908 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.239526 17705 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.214064 17789 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.253985 17643 tablet_bootstrap.cc:492] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:46.256732 17645 tablet_bootstrap.cc:654] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.258136 17568 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:46.261786 17725 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:46.261952 17526 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:46.262501 17725 raft_consensus.cc:697] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:46.244256 17789 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.264963 17908 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:17:46.267901 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 74742.2us
I20260709 13:17:46.267892 17705 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:46.277211 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:46.281152 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:17:46.282310 17569 leader_election.cc:343] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:46.287299 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:46.291311 17912 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:46.292235 17568 leader_election.cc:343] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:46.263592 17725 consensus_queue.cc:237] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.297320 17643 ts_tablet_manager.cc:1403] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.240s	user 0.016s	sys 0.002s
I20260709 13:17:46.298575 17789 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:46.297562 17601 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:46.291791 17912 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:46.302767 17568 consensus_peers.cc:597] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:46.304713 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:46.305514 17527 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:46.298640 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:46.317000 17643 raft_consensus.cc:359] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.318310 17643 raft_consensus.cc:385] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.319859 17643 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.324020 17643 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.321516 17644 tablet_bootstrap.cc:492] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:46.320547 17912 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:46.327821 17913 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:46.330354 17644 ts_tablet_manager.cc:1403] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.269s	user 0.012s	sys 0.004s
I20260709 13:17:46.319380 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:46.342300 17527 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
W20260709 13:17:46.337606 17495 leader_election.cc:343] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:46.344684 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:46.334098 17912 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:46.350172 17525 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:46.352775 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:46.347810 17913 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:17:46.351970 17912 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.353513 17602 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:46.354080 17912 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:46.356428 17913 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:46.361531 17645 tablet_bootstrap.cc:492] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:46.362550 17645 ts_tablet_manager.cc:1403] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.239s	user 0.018s	sys 0.000s
I20260709 13:17:46.360396 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:46.378126 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:46.380235 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:46.386638 17644 raft_consensus.cc:359] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.389585 17644 raft_consensus.cc:385] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.389923 17644 raft_consensus.cc:740] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.390663 17643 ts_tablet_manager.cc:1434] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.002s
I20260709 13:17:46.392453 17644 consensus_queue.cc:260] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.368821 17419 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:46.399086 17644 ts_tablet_manager.cc:1434] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:17:46.399664 17705 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:46.400308 17705 raft_consensus.cc:697] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:46.400892 17644 tablet_bootstrap.cc:492] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:46.401320 17705 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.407280 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:46.413596 17916 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:46.391242 17725 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:17:46.426788 17912 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.428325 17645 raft_consensus.cc:359] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.429610 17645 raft_consensus.cc:385] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.429970 17645 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.431429 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:46.431900 17645 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:46.435456 17495 leader_election.cc:343] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:46.436441 17912 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:46.437953 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:46.438167 17913 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:46.438565 17597 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:46.448725 17645 ts_tablet_manager.cc:1434] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 13:17:46.449246 17568 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:46.464411 17645 tablet_bootstrap.cc:492] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:46.456437 17602 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:46.464637 17643 tablet_bootstrap.cc:492] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:46.486547 17789 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:17:46.523066 17352 catalog_manager.cc:5697] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:46.506492 17569 leader_election.cc:343] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:46.529680 17705 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:46.608789 17927 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:17:46.571676 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:46.596518 17705 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.610877 17789 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:46.610975 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 120081us
W20260709 13:17:46.611786 17569 leader_election.cc:343] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:46.615643 17918 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.616142 17918 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.640354 17351 catalog_manager.cc:5697] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.663805 17789 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.667485 17789 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.692188 17789 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:17:46.700030 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 88245.2us
I20260709 13:17:46.702544 17705 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:46.703836 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:17:46.713809 17928 log.cc:927] Time spent T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:17:46.708810 17908 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:17:46.707285 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:46.723261 17597 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:46.728012 17643 tablet_bootstrap.cc:654] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.728366 17918 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:46.726420 17725 raft_consensus.cc:2764] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:17:46.737565 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:46.741566 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:46.736761 17450 raft_consensus.cc:2393] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:17:46.750372 17400 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:17:46.736428 17419 leader_election.cc:343] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:46.755656 17644 tablet_bootstrap.cc:654] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.757542 17916 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:46.766234 17568 leader_election.cc:343] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:46.763589 17916 raft_consensus.cc:697] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:46.766695 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:46.773168 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:46.773344 17916 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:46.805639 17495 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:46.818638 17914 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:46.851392 17644 tablet_bootstrap.cc:492] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:46.852084 17644 ts_tablet_manager.cc:1403] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.452s	user 0.021s	sys 0.014s
W20260709 13:17:46.873301 17569 leader_election.cc:343] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:46.873777 17569 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:46.876003 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:46.880707 17789 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:46.881955 17645 tablet_bootstrap.cc:654] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:46.905238 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 56954.5us
W20260709 13:17:46.884496 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 56469.3us
I20260709 13:17:46.916994 17834 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:46.924175 17914 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:46.925581 17943 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.926106 17943 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:46.930929 17420 leader_election.cc:343] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:46.931408 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:46.961609 17652 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:47.044256 17644 raft_consensus.cc:359] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.048115 17644 raft_consensus.cc:385] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.049568 17644 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.067319 17943 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:17:47.146893 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 214019us
I20260709 13:17:47.151608 17644 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.155287 17644 ts_tablet_manager.cc:1434] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.303s	user 0.006s	sys 0.009s
I20260709 13:17:47.156299 17644 tablet_bootstrap.cc:492] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:47.172814 17643 tablet_bootstrap.cc:492] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:47.173324 17643 ts_tablet_manager.cc:1403] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.715s	user 0.014s	sys 0.007s
W20260709 13:17:47.175959 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 244507us
I20260709 13:17:47.185756 17645 tablet_bootstrap.cc:492] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
W20260709 13:17:47.192535 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 44971.9us
I20260709 13:17:47.204331 17645 ts_tablet_manager.cc:1403] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.746s	user 0.015s	sys 0.034s
I20260709 13:17:47.207947 17645 raft_consensus.cc:359] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.208834 17645 raft_consensus.cc:385] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.209175 17645 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.209960 17645 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.217902 17643 raft_consensus.cc:359] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.218712 17643 raft_consensus.cc:385] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.218994 17643 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.219744 17643 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.219939 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:47.224608 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:47.225304 17598 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:47.229996 17643 ts_tablet_manager.cc:1434] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.005s
I20260709 13:17:47.231137 17643 tablet_bootstrap.cc:492] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:47.242331 17645 ts_tablet_manager.cc:1434] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:17:47.243521 17645 tablet_bootstrap.cc:492] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:47.243752 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:47.245280 17944 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.245622 17944 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.245951 17944 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.254648 17652 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.270838 17643 tablet_bootstrap.cc:654] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.276708 17944 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:47.288964 17419 leader_election.cc:343] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.314217 17645 tablet_bootstrap.cc:654] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:47.315251 17569 consensus_peers.cc:597] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:47.315377 17495 consensus_peers.cc:597] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:47.321517 17914 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.323132 17914 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.330813 17914 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:47.331476 17644 tablet_bootstrap.cc:654] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.331733 17643 tablet_bootstrap.cc:492] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:47.332194 17643 ts_tablet_manager.cc:1403] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.007s
I20260709 13:17:47.336750 17350 catalog_manager.cc:5697] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.335747 17914 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:17:47.338290 17956 log.cc:927] Time spent T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:17:47.338558 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:47.339166 17603 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:47.340195 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:47.340281 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:47.341482 17914 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.341823 17914 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:47.342213 17495 leader_election.cc:343] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.342175 17914 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.347816 17944 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:47.355587 17914 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.359036 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:47.359638 17597 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.361799 17914 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:47.366228 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:47.367646 17598 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.379427 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:17:47.390678 17495 leader_election.cc:343] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.392249 17867 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:47.392459 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:47.395464 17645 tablet_bootstrap.cc:492] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:47.395931 17645 ts_tablet_manager.cc:1403] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.153s	user 0.013s	sys 0.001s
I20260709 13:17:47.397234 17643 raft_consensus.cc:359] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.397857 17643 raft_consensus.cc:385] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.398106 17643 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.398576 17643 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.400055 17643 ts_tablet_manager.cc:1434] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.001s
I20260709 13:17:47.399690 17645 raft_consensus.cc:359] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.400626 17645 raft_consensus.cc:385] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.400988 17645 raft_consensus.cc:740] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.413223 17645 consensus_queue.cc:260] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.415911 17645 ts_tablet_manager.cc:1434] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:17:47.416740 17645 tablet_bootstrap.cc:492] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:47.407611 17597 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
W20260709 13:17:47.418835 17419 leader_election.cc:343] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.419090 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:47.423439 17948 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.424007 17948 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.423055 17918 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.438779 17918 raft_consensus.cc:697] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:47.439694 17918 consensus_queue.cc:237] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.445044 17948 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:47.446940 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:47.449507 17495 leader_election.cc:343] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.450660 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:47.451325 17603 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:47.452800 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:47.455176 17644 tablet_bootstrap.cc:492] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:47.455646 17644 ts_tablet_manager.cc:1403] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.300s	user 0.018s	sys 0.027s
I20260709 13:17:47.464716 17644 raft_consensus.cc:359] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.465505 17644 raft_consensus.cc:385] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.465785 17644 raft_consensus.cc:740] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.468451 17644 consensus_queue.cc:260] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.470814 17644 ts_tablet_manager.cc:1434] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:17:47.471930 17644 tablet_bootstrap.cc:492] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:47.475682 17598 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:47.476939 17643 tablet_bootstrap.cc:492] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:47.477324 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:47.478788 17867 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.479405 17867 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:47.482121 17725 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.481026 17867 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.482733 17725 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.460748 17914 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.486788 17725 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:47.490937 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:47.485584 17914 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.492360 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:47.492748 17914 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:47.494200 17568 leader_election.cc:343] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:47.494656 17569 leader_election.cc:343] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.495059 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:47.496075 17725 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:47.503022 17645 tablet_bootstrap.cc:654] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.511343 17643 tablet_bootstrap.cc:654] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.511969 17644 tablet_bootstrap.cc:654] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.511665 17914 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.516438 17914 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:47.518239 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:47.521039 17350 catalog_manager.cc:5697] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:47.522135 17495 leader_election.cc:343] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.523047 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:47.530313 17598 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.538586 17598 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:47.540009 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:47.540800 17914 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.541285 17644 tablet_bootstrap.cc:492] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:47.541260 17914 raft_consensus.cc:697] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:47.541899 17644 ts_tablet_manager.cc:1403] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.002s
I20260709 13:17:47.542328 17914 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.545436 17644 raft_consensus.cc:359] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.546275 17644 raft_consensus.cc:385] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.546567 17644 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.547329 17644 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.549468 17644 ts_tablet_manager.cc:1434] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:47.551432 17645 tablet_bootstrap.cc:492] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:47.551908 17645 ts_tablet_manager.cc:1403] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.135s	user 0.007s	sys 0.011s
I20260709 13:17:47.553705 17644 tablet_bootstrap.cc:492] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:47.555712 17351 catalog_manager.cc:5697] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.557711 17645 raft_consensus.cc:359] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.558432 17645 raft_consensus.cc:385] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.558710 17645 raft_consensus.cc:740] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.561216 17644 tablet_bootstrap.cc:654] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.566677 17645 consensus_queue.cc:260] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.568194 17643 tablet_bootstrap.cc:492] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:47.570859 17645 ts_tablet_manager.cc:1434] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:17:47.576252 17645 tablet_bootstrap.cc:492] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:47.576579 17643 ts_tablet_manager.cc:1403] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.134s	user 0.009s	sys 0.016s
I20260709 13:17:47.577775 17644 tablet_bootstrap.cc:492] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:47.578245 17644 ts_tablet_manager.cc:1403] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.001s
I20260709 13:17:47.581039 17867 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.580981 17644 raft_consensus.cc:359] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.581717 17644 raft_consensus.cc:385] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.581524 17867 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.581982 17644 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.582122 17645 tablet_bootstrap.cc:654] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.581432 17349 catalog_manager.cc:5697] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.582726 17644 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.583666 17867 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:47.585745 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:17:47.587600 17419 leader_election.cc:343] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.589147 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:47.589753 17598 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:47.591055 17420 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:47.592321 17867 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.592729 17867 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.593133 17867 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.597458 17644 ts_tablet_manager.cc:1434] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:17:47.598516 17644 tablet_bootstrap.cc:492] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:47.606089 17644 tablet_bootstrap.cc:654] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.612787 17644 tablet_bootstrap.cc:492] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:47.613233 17644 ts_tablet_manager.cc:1403] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:17:47.619752 17645 tablet_bootstrap.cc:492] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:47.599474 17643 raft_consensus.cc:359] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.620229 17645 ts_tablet_manager.cc:1403] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.020s
I20260709 13:17:47.620514 17643 raft_consensus.cc:385] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.621574 17643 raft_consensus.cc:740] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.623040 17645 raft_consensus.cc:359] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.626549 17645 raft_consensus.cc:385] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.626787 17645 raft_consensus.cc:740] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.627478 17645 consensus_queue.cc:260] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.622004 17867 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.628957 17644 raft_consensus.cc:359] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.630118 17644 raft_consensus.cc:385] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.630406 17644 raft_consensus.cc:740] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.631246 17645 ts_tablet_manager.cc:1434] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:47.631037 17644 consensus_queue.cc:260] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.632887 17644 ts_tablet_manager.cc:1434] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:17:47.627728 17643 consensus_queue.cc:260] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.633637 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:47.634586 17644 tablet_bootstrap.cc:492] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
W20260709 13:17:47.635247 17419 leader_election.cc:343] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.635769 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:47.636338 17598 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.637576 17645 tablet_bootstrap.cc:492] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:47.641806 17957 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.642308 17957 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.643714 17645 tablet_bootstrap.cc:654] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.644500 17957 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:47.646090 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:47.648061 17598 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
W20260709 13:17:47.649160 17569 leader_election.cc:343] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.650184 17420 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:47.651252 17943 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.651736 17943 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:47.652500 17943 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.654965 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:47.655824 17524 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:47.658077 17644 tablet_bootstrap.cc:654] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.660593 17643 ts_tablet_manager.cc:1434] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.084s	user 0.001s	sys 0.005s
I20260709 13:17:47.661610 17643 tablet_bootstrap.cc:492] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:47.662494 17867 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:47.665454 17568 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:47.666446 17725 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.666785 17725 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.667073 17725 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.674173 17725 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.680121 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:17:47.681982 17569 leader_election.cc:343] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.685041 17725 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:47.686471 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:47.687336 17524 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.695669 17643 tablet_bootstrap.cc:654] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.701713 17645 tablet_bootstrap.cc:492] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:47.702231 17645 ts_tablet_manager.cc:1403] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.065s	user 0.034s	sys 0.028s
I20260709 13:17:47.702860 17725 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.703302 17725 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.707329 17725 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:47.708056 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:47.708909 17450 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:47.710266 17645 raft_consensus.cc:359] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.710850 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:47.711385 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:47.712011 17725 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.712347 17725 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.712654 17725 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:47.712693 17568 leader_election.cc:343] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.710954 17645 raft_consensus.cc:385] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.714628 17645 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.715416 17645 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.717514 17645 ts_tablet_manager.cc:1434] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:17:47.708094 17644 tablet_bootstrap.cc:492] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:47.720285 17725 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.721630 17644 ts_tablet_manager.cc:1403] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.011s
I20260709 13:17:47.724964 17645 tablet_bootstrap.cc:492] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:47.725445 17725 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:47.725677 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:47.726318 17450 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.731649 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:17:47.733408 17568 leader_election.cc:343] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.753548 17943 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.754347 17943 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.781714 17782 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.782313 17782 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.784047 17524 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:47.796083 17350 catalog_manager.cc:5697] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.811069 17914 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.826259 17914 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.828251 17914 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:47.817134 17644 raft_consensus.cc:359] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.828781 17644 raft_consensus.cc:385] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.829092 17644 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.829715 17644 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.831547 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:47.833252 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:47.833873 17598 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:47.834398 17644 ts_tablet_manager.cc:1434] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.112s	user 0.020s	sys 0.024s
I20260709 13:17:47.835445 17644 tablet_bootstrap.cc:492] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:47.838976 17643 tablet_bootstrap.cc:492] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
W20260709 13:17:47.813798 17400 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:47.846315 17643 ts_tablet_manager.cc:1403] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.185s	user 0.015s	sys 0.005s
I20260709 13:17:47.848675 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:47.850251 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:47.850873 17602 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:47.814826 17943 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:47.818581 17782 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:47.819312 17450 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:47.821331 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:47.856377 17643 raft_consensus.cc:359] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.856918 17522 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:47.857097 17643 raft_consensus.cc:385] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.857162 17644 tablet_bootstrap.cc:654] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.822839 17867 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.813671 17645 tablet_bootstrap.cc:654] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.858011 17419 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:47.858167 17867 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.858877 17943 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.859221 17943 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.859557 17943 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.860273 17867 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:17:47.842548 17495 leader_election.cc:343] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.841738 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:47.860874 17448 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.857425 17643 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
W20260709 13:17:47.861994 17495 leader_election.cc:343] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.862917 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:47.863934 17914 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:47.865360 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:47.866640 17643 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.868136 17867 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.875062 17867 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.869652 17918 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:17:47.871124 17914 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.891812 17568 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:47.889575 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:47.890738 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:47.893996 17643 ts_tablet_manager.cc:1434] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:17:47.880159 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:47.897527 17907 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.894821 17834 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.901057 17834 raft_consensus.cc:697] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:47.901877 17834 consensus_queue.cc:237] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.904644 17907 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:47.905545 17907 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.892153 17914 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.907083 17914 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.931870 17643 tablet_bootstrap.cc:492] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
W20260709 13:17:47.932824 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 59600.6us
I20260709 13:17:47.955009 17645 tablet_bootstrap.cc:492] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:47.955505 17645 ts_tablet_manager.cc:1403] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.231s	user 0.025s	sys 0.035s
I20260709 13:17:47.961730 17914 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:47.964248 17914 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:47.989220 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:47.993484 17867 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:47.993956 17602 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.007884 17645 raft_consensus.cc:359] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.008589 17645 raft_consensus.cc:385] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.008855 17645 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.008944 17644 tablet_bootstrap.cc:492] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:48.009419 17644 ts_tablet_manager.cc:1403] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.174s	user 0.019s	sys 0.021s
I20260709 13:17:48.015916 17645 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.014523 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:48.019320 17644 raft_consensus.cc:359] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.020001 17644 raft_consensus.cc:385] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.020273 17644 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.011090 17943 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.022456 17451 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 1: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:17:48.023375 17943 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:48.023638 17643 tablet_bootstrap.cc:654] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.020916 17644 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.031103 17644 ts_tablet_manager.cc:1434] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:17:48.031025 17914 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.031678 17914 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.015610 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:48.043655 17419 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:48.047773 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:48.048610 17525 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:17:48.048622 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:48.051245 17450 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:48.052814 17419 consensus_peers.cc:597] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.055963 17419 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:48.056329 17350 catalog_manager.cc:5697] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.058001 17350 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.068657 17645 ts_tablet_manager.cc:1434] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.113s	user 0.006s	sys 0.003s
I20260709 13:17:48.058398 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:48.077550 17645 tablet_bootstrap.cc:492] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:48.079154 17914 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:48.080960 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:48.081121 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:48.082283 17451 raft_consensus.cc:2393] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:17:48.075991 17447 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 1: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:17:48.087152 17495 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:48.089270 17916 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.095707 17602 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:48.099507 17916 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:48.102913 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:48.103621 17943 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:48.105396 17644 tablet_bootstrap.cc:492] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:48.106997 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:48.112206 17943 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:48.147944 17914 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:48.148685 17914 raft_consensus.cc:697] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:48.150579 17867 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:48.159008 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 52090.9us
W20260709 13:17:48.170002 17495 consensus_peers.cc:597] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.170358 17916 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:17:48.175765 17643 tablet_bootstrap.cc:492] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:48.176265 17643 ts_tablet_manager.cc:1403] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.252s	user 0.014s	sys 0.052s
I20260709 13:17:48.149763 17914 consensus_queue.cc:237] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:48.186245 17419 consensus_peers.cc:597] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.186158 17643 raft_consensus.cc:359] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.186914 17643 raft_consensus.cc:385] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.187196 17643 raft_consensus.cc:740] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.191020 17643 consensus_queue.cc:260] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.191324 17984 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:48.196084 17643 ts_tablet_manager.cc:1434] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:17:48.196941 17644 tablet_bootstrap.cc:654] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.197052 17643 tablet_bootstrap.cc:492] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:48.198607 17782 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:48.210314 17957 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.210778 17957 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.212842 17957 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:48.215118 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:48.217451 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:48.217837 17568 leader_election.cc:343] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:48.219977 17569 leader_election.cc:343] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:48.220381 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:48.185909 17645 tablet_bootstrap.cc:654] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.222790 17907 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:48.236397 17643 tablet_bootstrap.cc:654] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.250527 17349 catalog_manager.cc:5697] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.266615 17643 tablet_bootstrap.cc:492] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:48.267148 17643 ts_tablet_manager.cc:1403] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.001s
I20260709 13:17:48.274371 17643 raft_consensus.cc:359] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.275090 17643 raft_consensus.cc:385] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.275369 17643 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.276028 17643 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.288676 17645 tablet_bootstrap.cc:492] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:48.289222 17645 ts_tablet_manager.cc:1403] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.214s	user 0.027s	sys 0.019s
I20260709 13:17:48.290231 17867 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:48.291440 17645 raft_consensus.cc:359] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.292102 17645 raft_consensus.cc:385] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.292356 17645 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.292954 17645 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.294874 17645 ts_tablet_manager.cc:1434] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:17:48.296551 17645 tablet_bootstrap.cc:492] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
W20260709 13:17:48.297719 17569 consensus_peers.cc:597] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.297941 17643 ts_tablet_manager.cc:1434] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:17:48.301376 17643 tablet_bootstrap.cc:492] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:48.304459 17645 tablet_bootstrap.cc:654] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.308276 17834 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:48.318243 17984 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.318758 17984 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.320714 17984 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:48.322139 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:48.326875 17643 tablet_bootstrap.cc:654] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.334812 17916 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.335537 17916 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.339821 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:48.348021 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:48.350896 17916 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:48.353638 17644 tablet_bootstrap.cc:492] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:48.354140 17644 ts_tablet_manager.cc:1403] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.249s	user 0.015s	sys 0.015s
I20260709 13:17:48.355968 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:48.358404 17644 raft_consensus.cc:359] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.359443 17644 raft_consensus.cc:385] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.359783 17644 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.360740 17644 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.365833 17644 ts_tablet_manager.cc:1434] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:48.362874 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:48.371804 17782 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:48.371830 17644 tablet_bootstrap.cc:492] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:48.363633 17643 tablet_bootstrap.cc:492] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:48.373467 17643 ts_tablet_manager.cc:1403] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.000s
I20260709 13:17:48.361522 17420 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:48.368839 17907 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:48.379454 17984 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:48.398304 17643 raft_consensus.cc:359] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.403223 17643 raft_consensus.cc:385] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.405454 17643 raft_consensus.cc:740] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.417507 17643 consensus_queue.cc:260] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.428557 17645 tablet_bootstrap.cc:492] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:48.429109 17645 ts_tablet_manager.cc:1403] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.133s	user 0.049s	sys 0.061s
I20260709 13:17:48.431160 17644 tablet_bootstrap.cc:654] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.431834 17645 raft_consensus.cc:359] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.434821 17645 raft_consensus.cc:385] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.435151 17645 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.437011 17643 ts_tablet_manager.cc:1434] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:17:48.437340 17645 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.440482 17645 ts_tablet_manager.cc:1434] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:48.441390 17645 tablet_bootstrap.cc:492] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:48.451571 17907 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:48.463059 17643 tablet_bootstrap.cc:492] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:48.462888 17907 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.468164 17907 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.471509 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:48.472158 17447 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:48.474013 17569 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:48.476662 17834 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:48.476850 17907 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:48.477087 17834 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.477432 17834 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.480458 17643 tablet_bootstrap.cc:654] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.482172 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:48.482745 17524 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
W20260709 13:17:48.485121 17629 tablet.cc:2406] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:48.485170 17644 tablet_bootstrap.cc:492] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:48.485802 17644 ts_tablet_manager.cc:1403] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.114s	user 0.025s	sys 0.016s
I20260709 13:17:48.491181 17644 raft_consensus.cc:359] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.491849 17644 raft_consensus.cc:385] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.492106 17644 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.492754 17644 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.509238 17644 ts_tablet_manager.cc:1434] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:17:48.532101 17644 tablet_bootstrap.cc:492] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:48.532601 17834 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.543633 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:48.544267 17452 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.555960 17645 tablet_bootstrap.cc:654] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.557825 17644 tablet_bootstrap.cc:654] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.564898 17524 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.575304 17452 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:48.581180 17569 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:48.582974 17834 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:48.585444 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:48.586082 17527 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.591537 17907 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:48.592321 17907 raft_consensus.cc:697] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:48.585999 17452 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.605507 17643 tablet_bootstrap.cc:492] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:48.605154 17528 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.606148 17643 ts_tablet_manager.cc:1403] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.159s	user 0.033s	sys 0.001s
I20260709 13:17:48.606959 17907 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.609352 17643 raft_consensus.cc:359] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.615695 17643 raft_consensus.cc:385] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.616052 17643 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.616616 17643 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.625532 17643 ts_tablet_manager.cc:1434] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:17:48.626705 17527 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:48.627643 17644 tablet_bootstrap.cc:492] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:48.634438 17644 ts_tablet_manager.cc:1403] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.103s	user 0.021s	sys 0.028s
I20260709 13:17:48.634660 17643 tablet_bootstrap.cc:492] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:48.637375 17644 raft_consensus.cc:359] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.638055 17644 raft_consensus.cc:385] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.638314 17644 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.638918 17644 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.640811 17644 ts_tablet_manager.cc:1434] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:17:48.641775 17644 tablet_bootstrap.cc:492] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:48.642096 17643 tablet_bootstrap.cc:654] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.630657 17645 tablet_bootstrap.cc:492] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:48.631940 17834 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.645246 17645 ts_tablet_manager.cc:1403] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.204s	user 0.018s	sys 0.004s
I20260709 13:17:48.646435 17834 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.650311 17834 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:48.652412 17645 raft_consensus.cc:359] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.652829 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:48.653110 17645 raft_consensus.cc:385] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.653398 17645 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.654011 17645 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.656227 17645 ts_tablet_manager.cc:1434] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
W20260709 13:17:48.656286 17569 leader_election.cc:343] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:48.656476 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:48.657207 17645 tablet_bootstrap.cc:492] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
W20260709 13:17:48.658640 17568 leader_election.cc:343] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:48.659217 17568 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:48.661186 17957 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:48.667362 17644 tablet_bootstrap.cc:654] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.670356 17352 catalog_manager.cc:5697] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.691679 17782 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:48.692703 17643 tablet_bootstrap.cc:492] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:48.693460 17643 ts_tablet_manager.cc:1403] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.003s
I20260709 13:17:48.701848 17645 tablet_bootstrap.cc:654] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.710194 17643 raft_consensus.cc:359] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.720170 17643 raft_consensus.cc:385] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.711985 17644 tablet_bootstrap.cc:492] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:48.718897 17914 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:48.720574 17643 raft_consensus.cc:740] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.721382 17643 consensus_queue.cc:260] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.730470 17644 ts_tablet_manager.cc:1403] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.089s	user 0.020s	sys 0.010s
I20260709 13:17:48.731739 17643 ts_tablet_manager.cc:1434] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:17:48.733029 17643 tablet_bootstrap.cc:492] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:48.737533 17644 raft_consensus.cc:359] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.738229 17644 raft_consensus.cc:385] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.749295 17645 tablet_bootstrap.cc:492] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:48.749818 17645 ts_tablet_manager.cc:1403] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.093s	user 0.028s	sys 0.006s
I20260709 13:17:48.751961 17643 tablet_bootstrap.cc:654] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.752306 17645 raft_consensus.cc:359] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.753015 17645 raft_consensus.cc:385] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.753288 17645 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.753887 17645 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.755872 17645 ts_tablet_manager.cc:1434] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:48.738487 17644 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.756798 17645 tablet_bootstrap.cc:492] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:48.756765 17644 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.759630 17644 ts_tablet_manager.cc:1434] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.001s
I20260709 13:17:48.762272 17644 tablet_bootstrap.cc:492] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:48.763341 17645 tablet_bootstrap.cc:654] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.786000 17984 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.786701 17984 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.792526 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:48.799160 17984 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:48.801724 17644 tablet_bootstrap.cc:654] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.807034 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:48.807991 17644 tablet_bootstrap.cc:492] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:48.808491 17644 ts_tablet_manager.cc:1403] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 13:17:48.808429 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:48.810098 17984 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:48.811156 17644 raft_consensus.cc:359] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.811882 17644 raft_consensus.cc:385] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.812134 17644 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.813309 17645 tablet_bootstrap.cc:492] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:48.812947 17644 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.815055 17644 ts_tablet_manager.cc:1434] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:48.816588 17644 tablet_bootstrap.cc:492] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:48.821926 17644 tablet_bootstrap.cc:654] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.813747 17645 ts_tablet_manager.cc:1403] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.004s
I20260709 13:17:48.838366 17645 raft_consensus.cc:359] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.839037 17645 raft_consensus.cc:385] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.839293 17645 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.839951 17643 tablet_bootstrap.cc:492] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:48.840430 17643 ts_tablet_manager.cc:1403] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.108s	user 0.019s	sys 0.021s
I20260709 13:17:48.843093 17643 raft_consensus.cc:359] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.843770 17643 raft_consensus.cc:385] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.844027 17643 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.844587 17643 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.846916 17643 ts_tablet_manager.cc:1434] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:17:48.847906 17643 tablet_bootstrap.cc:492] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:48.850425 17447 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.852041 17452 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.855957 17644 tablet_bootstrap.cc:492] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:48.856500 17644 ts_tablet_manager.cc:1403] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.012s
I20260709 13:17:48.859162 17644 raft_consensus.cc:359] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.859817 17644 raft_consensus.cc:385] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.860097 17644 raft_consensus.cc:740] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.860709 17644 consensus_queue.cc:260] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.862931 17644 ts_tablet_manager.cc:1434] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:17:48.864042 17907 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.864539 17644 tablet_bootstrap.cc:492] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:48.864539 17907 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.866683 17907 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:48.867930 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:48.868556 17524 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:48.869819 17568 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:48.871389 17644 tablet_bootstrap.cc:654] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.871666 17957 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:48.872013 17957 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.872370 17957 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.884505 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:48.885196 17452 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:48.885897 17644 tablet_bootstrap.cc:492] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:48.886441 17644 ts_tablet_manager.cc:1403] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.001s
I20260709 13:17:48.894351 17644 raft_consensus.cc:359] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.853530 17645 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.895319 17644 raft_consensus.cc:385] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.895766 17644 raft_consensus.cc:740] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.896693 17645 ts_tablet_manager.cc:1434] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.000s
I20260709 13:17:48.897672 17645 tablet_bootstrap.cc:492] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:48.896497 17644 consensus_queue.cc:260] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.900168 17644 ts_tablet_manager.cc:1434] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:17:48.901095 17644 tablet_bootstrap.cc:492] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:48.905483 17645 tablet_bootstrap.cc:654] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.853233 17643 tablet_bootstrap.cc:654] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.906777 17644 tablet_bootstrap.cc:654] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.894343 17957 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.908883 17957 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:48.912618 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:48.921402 17527 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.922166 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:48.923135 17447 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.917541 17830 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.926928 17830 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.929916 17447 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:48.929651 17830 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:48.933959 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:17:48.938745 17568 leader_election.cc:343] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:48.937896 17527 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:48.941321 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:48.941871 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:17:48.943078 17569 leader_election.cc:343] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:48.943490 17569 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:48.947687 17914 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.948362 17914 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.949568 17644 tablet_bootstrap.cc:492] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:48.950089 17644 ts_tablet_manager.cc:1403] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.022s
I20260709 13:17:48.951078 17914 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:48.953095 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:48.953985 17447 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:48.956373 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:48.958500 17916 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:48.958988 17916 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.959445 17916 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:48.960250 18026 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:48.963843 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:48.964501 17602 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:48.965060 17643 tablet_bootstrap.cc:492] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:48.965572 17643 ts_tablet_manager.cc:1403] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.014s
I20260709 13:17:48.966826 18026 raft_consensus.cc:697] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:48.968235 17643 raft_consensus.cc:359] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.967736 18026 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.969090 17643 raft_consensus.cc:385] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.969439 17643 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.970110 17643 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.972177 17907 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:48.972244 17643 ts_tablet_manager.cc:1434] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:17:48.973197 17957 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.973757 17643 tablet_bootstrap.cc:492] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:48.973483 17644 raft_consensus.cc:359] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.973713 17957 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.974213 17644 raft_consensus.cc:385] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:48.974591 17644 raft_consensus.cc:740] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:48.975190 17644 consensus_queue.cc:260] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:48.975792 17957 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:48.977613 17644 ts_tablet_manager.cc:1434] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
W20260709 13:17:48.978219 17400 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:48.978636 17644 tablet_bootstrap.cc:492] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:48.984493 17644 tablet_bootstrap.cc:654] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.985143 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:48.990387 17643 tablet_bootstrap.cc:654] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:48.996989 17644 tablet_bootstrap.cc:492] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:48.997843 17644 ts_tablet_manager.cc:1403] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
W20260709 13:17:48.998533 17569 leader_election.cc:343] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:48.997476 17916 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.001706 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:49.002395 17447 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.004552 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:49.005155 17598 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.005820 17644 raft_consensus.cc:359] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.006525 17644 raft_consensus.cc:385] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.006774 17644 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.007431 17644 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.009254 17447 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:49.009557 17644 ts_tablet_manager.cc:1434] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260709 13:17:49.010540 17644 tablet_bootstrap.cc:492] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:49.010406 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:49.011920 17918 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:49.012355 17918 raft_consensus.cc:697] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:49.013157 17918 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.015901 17643 tablet_bootstrap.cc:492] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:49.016402 17643 ts_tablet_manager.cc:1403] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.003s
I20260709 13:17:49.016423 17598 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:49.019922 17643 raft_consensus.cc:359] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.020761 17643 raft_consensus.cc:385] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.021126 17643 raft_consensus.cc:740] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.021899 17643 consensus_queue.cc:260] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.024560 17916 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.026718 17644 tablet_bootstrap.cc:654] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.029423 17643 ts_tablet_manager.cc:1434] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:17:49.030900 17643 tablet_bootstrap.cc:492] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:49.039646 17645 tablet_bootstrap.cc:492] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:49.038972 17351 catalog_manager.cc:5697] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.040303 17645 ts_tablet_manager.cc:1403] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.143s	user 0.030s	sys 0.023s
I20260709 13:17:49.043788 17644 tablet_bootstrap.cc:492] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:49.044068 17643 tablet_bootstrap.cc:654] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.044260 17644 ts_tablet_manager.cc:1403] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.004s
I20260709 13:17:49.044636 18026 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.044507 17645 raft_consensus.cc:359] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.045219 17645 raft_consensus.cc:385] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.045073 18026 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.046977 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.047911 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:49.048545 17447 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:49.047192 17644 raft_consensus.cc:359] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.049937 17569 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:49.049957 17644 raft_consensus.cc:385] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.050689 17830 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:49.050715 17644 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.051203 17830 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.051580 17830 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.045480 17645 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.051715 17644 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.054098 17645 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.058261 17644 ts_tablet_manager.cc:1434] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 13:17:49.058802 17830 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.059520 17644 tablet_bootstrap.cc:492] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:49.061424 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:49.061998 17447 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.063300 17645 ts_tablet_manager.cc:1434] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:17:49.068362 17643 tablet_bootstrap.cc:492] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:49.069203 17645 tablet_bootstrap.cc:492] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:49.071874 17644 tablet_bootstrap.cc:654] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.069006 17643 ts_tablet_manager.cc:1403] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.000s
I20260709 13:17:49.069011 17447 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:49.076745 17569 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:49.077518 17907 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:49.077991 17907 raft_consensus.cc:697] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:49.078833 17907 consensus_queue.cc:237] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.081699 17645 tablet_bootstrap.cc:654] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.091925 17834 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.092425 17834 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.094628 17834 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:49.096311 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:49.096647 17568 leader_election.cc:343] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.097401 17834 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.097921 17834 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.100498 17834 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:49.102425 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:49.104055 17569 leader_election.cc:343] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.090693 18026 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:49.106316 17643 raft_consensus.cc:359] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.107138 17643 raft_consensus.cc:385] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.107496 17643 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.097025 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:49.110209 17830 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:49.110775 17907 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:49.113757 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.114391 17524 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:49.119067 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.108374 17643 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.119637 17527 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:49.119771 17447 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:49.122390 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:49.122953 17916 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.122676 17569 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:17:49.121574 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 105940us
I20260709 13:17:49.123546 17916 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.124961 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.122995 17525 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.132507 17916 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.133323 18028 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:49.133809 18028 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.134166 18028 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.138880 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:49.139300 17643 ts_tablet_manager.cc:1434] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 13:17:49.139592 17645 tablet_bootstrap.cc:492] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:49.140043 17645 ts_tablet_manager.cc:1403] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.004s
I20260709 13:17:49.140239 17643 tablet_bootstrap.cc:492] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:49.143275 17525 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:49.140105 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:49.139495 17450 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:49.144784 17644 tablet_bootstrap.cc:492] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:49.145253 17644 ts_tablet_manager.cc:1403] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.086s	user 0.018s	sys 0.020s
I20260709 13:17:49.145256 17352 catalog_manager.cc:5697] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.147300 17352 catalog_manager.cc:5697] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.150590 17645 raft_consensus.cc:359] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.151316 17645 raft_consensus.cc:385] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.151595 17645 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.152163 17645 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.155578 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:49.148067 17644 raft_consensus.cc:359] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.156656 17916 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:49.156884 17644 raft_consensus.cc:385] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.157027 17916 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.157236 17644 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.157409 17916 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.157910 17644 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.150466 18028 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.146339 17643 tablet_bootstrap.cc:654] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.165824 18028 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:49.166154 17644 ts_tablet_manager.cc:1434] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:17:49.166616 17602 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:17:49.168130 17645 ts_tablet_manager.cc:1434] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:17:49.169159 17645 tablet_bootstrap.cc:492] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:49.169796 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:49.170383 17644 tablet_bootstrap.cc:492] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Bootstrap starting.
I20260709 13:17:49.170392 17450 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.178881 17645 tablet_bootstrap.cc:654] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:49.182690 17568 leader_election.cc:343] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.181879 17916 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.184429 17644 tablet_bootstrap.cc:654] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.183112 17568 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:49.185945 17916 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.181828 17450 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:49.186605 17830 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:49.189635 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:49.190440 17452 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:17:49.191728 17830 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:49.193920 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:49.194633 17598 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:17:49.196175 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:49.196976 17918 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:49.197263 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:49.198074 17525 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 1: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:17:49.198989 17569 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:49.199699 17644 tablet_bootstrap.cc:492] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: No bootstrap required, opened a new log
I20260709 13:17:49.200150 17644 ts_tablet_manager.cc:1403] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.005s
I20260709 13:17:49.200484 17907 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:49.201345 17907 raft_consensus.cc:697] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:49.202487 17907 consensus_queue.cc:237] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.203306 17644 raft_consensus.cc:359] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.204016 17644 raft_consensus.cc:385] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.204303 17644 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.205029 17644 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.213665 17644 ts_tablet_manager.cc:1434] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:17:49.216212 17645 tablet_bootstrap.cc:492] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:49.216396 17643 tablet_bootstrap.cc:492] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:49.216682 17645 ts_tablet_manager.cc:1403] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.009s
I20260709 13:17:49.216832 17643 ts_tablet_manager.cc:1403] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.000s
I20260709 13:17:49.219442 17645 raft_consensus.cc:359] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.220182 17645 raft_consensus.cc:385] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.220458 17645 raft_consensus.cc:740] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.221087 17645 consensus_queue.cc:260] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.221391 17643 raft_consensus.cc:359] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.222160 17643 raft_consensus.cc:385] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.223291 17645 ts_tablet_manager.cc:1434] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:49.222473 17643 raft_consensus.cc:740] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.224331 17645 tablet_bootstrap.cc:492] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:49.224509 17643 consensus_queue.cc:260] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.231068 17830 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.231616 17830 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.235000 17643 ts_tablet_manager.cc:1434] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:17:49.236915 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:49.237768 17830 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:17:49.238273 17569 leader_election.cc:343] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.232793 17645 tablet_bootstrap.cc:654] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.233477 17957 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.242419 17957 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.245051 17957 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:49.262284 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.262969 17525 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 0.
I20260709 13:17:49.264212 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.265292 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:49.266834 18028 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:49.267727 17569 leader_election.cc:343] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.271199 17568 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:49.272086 17957 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:49.272575 17957 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.272966 17957 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.277868 17643 tablet_bootstrap.cc:492] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
W20260709 13:17:49.278595 17568 leader_election.cc:343] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.279012 17568 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:49.280146 17834 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:49.297412 17943 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.298002 17943 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.300062 17943 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.302565 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:17:49.304018 17419 leader_election.cc:343] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.287362 17957 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.302541 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:49.310591 17598 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:49.311158 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:49.311522 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:49.312965 17957 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:49.313007 17943 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:17:49.313177 17569 leader_election.cc:343] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.313555 17943 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.313936 17943 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.315618 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:49.316200 17525 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.320860 17943 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.327772 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:49.328688 17943 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.329394 17525 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:17:49.331946 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:49.334429 17602 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:49.335233 17419 leader_election.cc:343] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.330803 17352 catalog_manager.cc:5697] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.333750 17643 tablet_bootstrap.cc:654] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.343086 17602 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:49.344784 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:49.345796 17645 tablet_bootstrap.cc:492] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:49.345932 17943 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:49.349237 17943 raft_consensus.cc:697] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:49.347894 17568 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:17:49.350091 17943 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.350939 18026 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:49.353091 18026 raft_consensus.cc:697] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:49.354077 18026 consensus_queue.cc:237] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.355162 17645 ts_tablet_manager.cc:1403] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.131s	user 0.025s	sys 0.018s
I20260709 13:17:49.357605 17645 raft_consensus.cc:359] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.358294 17645 raft_consensus.cc:385] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.360324 17643 tablet_bootstrap.cc:492] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:49.360859 17643 ts_tablet_manager.cc:1403] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.008s
I20260709 13:17:49.364535 17643 raft_consensus.cc:359] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.366528 17643 raft_consensus.cc:385] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.366820 17643 raft_consensus.cc:740] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.367523 17643 consensus_queue.cc:260] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.370980 17643 ts_tablet_manager.cc:1434] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:17:49.373636 17643 tablet_bootstrap.cc:492] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:49.358574 17645 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.399541 17645 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.401109 17645 ts_tablet_manager.cc:1434] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.003s
I20260709 13:17:49.393208 17643 tablet_bootstrap.cc:654] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.383589 17916 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.401782 17916 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.404439 17645 tablet_bootstrap.cc:492] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:49.405026 17352 catalog_manager.cc:5697] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 0 to 1, leader changed from <none> to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.413439 17643 tablet_bootstrap.cc:492] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:49.414577 17643 ts_tablet_manager.cc:1403] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 13:17:49.414481 17916 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.417620 17643 raft_consensus.cc:359] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.418299 17645 tablet_bootstrap.cc:654] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.418407 17643 raft_consensus.cc:385] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.418008 17350 catalog_manager.cc:5697] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.418795 17643 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.419966 17643 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.421468 17943 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.422250 17643 ts_tablet_manager.cc:1434] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:49.421978 17943 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.424324 17943 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.427605 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:49.428217 17602 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:49.429540 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.431494 17420 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:17:49.432888 17419 leader_election.cc:343] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.433632 17943 raft_consensus.cc:2804] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:49.434223 17943 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.435190 17943 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.423719 17643 tablet_bootstrap.cc:492] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:49.455731 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:49.456005 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:49.456591 17602 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:49.456622 17449 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:49.465359 17943 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.466678 17907 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.472805 17907 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.472165 17643 tablet_bootstrap.cc:654] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.476135 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:49.476526 17907 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:49.476856 17918 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:49.477245 17918 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.477563 17918 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.478294 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.479336 17645 tablet_bootstrap.cc:492] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:49.479476 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:49.479784 17568 leader_election.cc:343] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.478363 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:49.479799 17645 ts_tablet_manager.cc:1403] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.076s	user 0.030s	sys 0.026s
W20260709 13:17:49.480875 17569 leader_election.cc:343] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:49.481233 17419 leader_election.cc:343] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.481914 17943 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.481251 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:49.483774 17645 raft_consensus.cc:359] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.484436 17645 raft_consensus.cc:385] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.484704 17645 raft_consensus.cc:740] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.485411 17645 consensus_queue.cc:260] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.485917 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:49.486591 17602 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.488027 17984 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.488495 17984 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.487515 17907 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:49.491209 17984 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.489714 17957 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.492741 17957 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.493124 17602 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:49.495005 17420 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:49.495231 17645 ts_tablet_manager.cc:1434] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:17:49.495705 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.496376 17525 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:49.496536 17643 tablet_bootstrap.cc:492] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:49.496613 17957 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:49.497100 17643 ts_tablet_manager.cc:1403] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.007s
I20260709 13:17:49.495735 17943 raft_consensus.cc:2804] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:49.497987 17419 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:49.499491 17867 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:49.499650 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:49.499668 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.499228 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:49.500715 17867 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:49.501473 17569 leader_election.cc:343] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.501547 17867 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.504720 17645 tablet_bootstrap.cc:492] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:49.505568 17643 raft_consensus.cc:359] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.506230 17643 raft_consensus.cc:385] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.506500 17643 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.506943 17602 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:49.508234 17643 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.510596 17643 ts_tablet_manager.cc:1434] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:17:49.511598 17643 tablet_bootstrap.cc:492] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
W20260709 13:17:49.510535 17568 leader_election.cc:343] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.511587 17867 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.512221 17568 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:49.513697 17867 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.514456 18026 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:49.516407 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:49.516516 17918 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.517015 17528 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.518519 17918 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.518935 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:49.519479 17598 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.519930 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:49.520475 17597 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.522289 17645 tablet_bootstrap.cc:654] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.524852 17943 raft_consensus.cc:697] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:49.525753 17943 consensus_queue.cc:237] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.527678 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:49.528231 17449 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.530297 18028 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.530790 18028 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.531402 17597 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:49.534637 17643 tablet_bootstrap.cc:654] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.535436 17449 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:49.535488 17598 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:49.535924 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.539148 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:17:49.539487 17568 leader_election.cc:343] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.539856 17916 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:49.540345 17916 raft_consensus.cc:697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:49.541101 17916 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.541718 18028 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:49.544269 17528 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:49.545717 17419 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:49.546011 17914 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:49.547062 17867 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:49.547437 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:49.547742 17867 raft_consensus.cc:697] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:49.548794 17867 consensus_queue.cc:237] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.551944 17914 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:49.555621 18028 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:49.557693 17569 leader_election.cc:343] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.559931 17569 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:49.562650 17643 tablet_bootstrap.cc:492] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:49.562815 18028 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:49.563304 17643 ts_tablet_manager.cc:1403] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.001s
I20260709 13:17:49.565330 17352 catalog_manager.cc:5697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.565794 17643 raft_consensus.cc:359] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.567354 17643 raft_consensus.cc:385] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.567632 17643 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.568445 17643 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.571097 17645 tablet_bootstrap.cc:492] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:49.571533 17645 ts_tablet_manager.cc:1403] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.001s
I20260709 13:17:49.579030 17645 raft_consensus.cc:359] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.579705 17645 raft_consensus.cc:385] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.580089 17645 raft_consensus.cc:740] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.583040 17645 consensus_queue.cc:260] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.595151 17645 ts_tablet_manager.cc:1434] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 13:17:49.600945 17645 tablet_bootstrap.cc:492] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:49.609618 18026 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:49.617026 17643 ts_tablet_manager.cc:1434] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.053s	user 0.019s	sys 0.012s
I20260709 13:17:49.624994 17643 tablet_bootstrap.cc:492] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:49.618249 17867 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.630393 17867 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.634054 17352 catalog_manager.cc:5697] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.634616 18054 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.635718 18054 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.640781 18063 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.665802 17643 tablet_bootstrap.cc:654] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.679382 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:49.672885 18054 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.686381 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:49.686905 17598 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:49.671015 17867 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.641469 18063 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.690456 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.680415 18028 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:17:49.704980 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:17:49.705327 17419 leader_election.cc:343] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.705744 17527 raft_consensus.cc:2393] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:17:49.708648 17645 tablet_bootstrap.cc:654] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:49.780884 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 68847.9us
I20260709 13:17:49.781831 17643 tablet_bootstrap.cc:492] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:49.782348 17643 ts_tablet_manager.cc:1403] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.158s	user 0.005s	sys 0.010s
I20260709 13:17:49.785880 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:49.710806 17830 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.076s
I20260709 13:17:49.792147 17419 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:17:49.790699 18061 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.079s	user 0.004s	sys 0.014s
I20260709 13:17:49.791188 18054 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:49.831002 18063 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:49.832772 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:49.821944 18054 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.836032 18054 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.836455 17643 raft_consensus.cc:359] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.837148 17643 raft_consensus.cc:385] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.837473 17643 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.823799 17943 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.838157 17643 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:49.843940 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 51886.7us
I20260709 13:17:49.845026 17643 ts_tablet_manager.cc:1434] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.001s
W20260709 13:17:49.861227 17419 leader_election.cc:343] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:49.866142 17524 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:49.866824 17643 tablet_bootstrap.cc:492] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Bootstrap starting.
I20260709 13:17:49.850814 18026 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:17:49.939780 17643 tablet_bootstrap.cc:654] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:49.946301 17645 tablet_bootstrap.cc:492] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:49.946792 17645 ts_tablet_manager.cc:1403] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.346s	user 0.010s	sys 0.005s
W20260709 13:17:49.948958 18067 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:17:49.962579 17645 raft_consensus.cc:359] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.963380 17645 raft_consensus.cc:385] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:49.963735 17645 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:49.964676 17352 catalog_manager.cc:5697] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.966424 17645 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:49.969785 17645 ts_tablet_manager.cc:1434] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:17:49.973654 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:49.974475 17602 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:49.977269 17943 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:49.994477 17420 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:49.997366 18065 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:50.002955 18065 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.003319 18065 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:50.010362 18078 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:17:50.015094 18054 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.023479 17645 tablet_bootstrap.cc:492] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:50.038156 18082 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.038672 18082 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.040340 18083 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.040829 18083 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.055142 18082 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:17:50.083256 17400 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:50.086280 18083 leader_election.cc:290] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:50.098898 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:50.099673 17602 raft_consensus.cc:2393] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 1: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:17:50.101630 17830 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:50.105237 17645 tablet_bootstrap.cc:654] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:50.109843 17943 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:50.111075 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:50.112385 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:50.106066 18054 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:50.123881 18028 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:50.121477 18063 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.125700 18063 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.123879 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:50.126834 17600 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:50.131049 17645 tablet_bootstrap.cc:492] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:50.131511 17645 ts_tablet_manager.cc:1403] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.117s	user 0.006s	sys 0.013s
I20260709 13:17:50.133910 17645 raft_consensus.cc:359] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.134572 17645 raft_consensus.cc:385] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:50.134861 17645 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:50.135473 17645 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.139653 17830 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:17:50.145990 17645 ts_tablet_manager.cc:1434] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:17:50.146294 18065 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.147061 17645 tablet_bootstrap.cc:492] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:50.153415 17495 leader_election.cc:304] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:50.155943 18083 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:50.156304 18083 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.156630 18083 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.158087 18063 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:50.166841 17643 tablet_bootstrap.cc:492] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: No bootstrap required, opened a new log
I20260709 13:17:50.167512 17643 ts_tablet_manager.cc:1403] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent bootstrapping tablet: real 0.301s	user 0.022s	sys 0.008s
I20260709 13:17:50.171788 18065 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:50.150240 17867 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
W20260709 13:17:50.200417 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 56352.4us
I20260709 13:17:50.201946 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:50.202549 17602 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:50.201028 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:50.204041 17526 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:50.208969 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:50.210660 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:50.210932 18032 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:17:50.211293 17599 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 0.
I20260709 13:17:50.180011 17916 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.217561 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:50.218281 17596 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:50.215384 17916 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.258076 17916 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:17:50.259511 17419 leader_election.cc:343] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:50.276090 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:50.282817 17643 raft_consensus.cc:359] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.283812 17643 raft_consensus.cc:385] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:50.285352 17602 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:50.284202 17643 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Initialized, Role: FOLLOWER
I20260709 13:17:50.274408 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:50.291863 17525 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:50.291774 18064 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:17:50.286741 17643 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.257819 18083 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.306890 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:50.311079 17528 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:17:50.312254 18062 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:50.312667 18062 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.312978 18062 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:50.325110 17643 ts_tablet_manager.cc:1434] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent starting tablet: real 0.157s	user 0.004s	sys 0.005s
I20260709 13:17:50.303773 17984 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.361225 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:50.361907 17598 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
I20260709 13:17:50.349059 17525 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:50.418377 17914 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:50.360584 17984 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.421347 17984 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:50.423420 18083 leader_election.cc:290] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:50.459273 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:17:50.478694 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 166122us
I20260709 13:17:50.490847 17645 tablet_bootstrap.cc:654] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:50.490600 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:50.501873 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:17:50.505192 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 198351us
I20260709 13:17:50.508272 18088 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:50.505455 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:50.510162 17596 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:50.515072 18074 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:50.517241 18074 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.517609 18074 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:50.524721 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:50.526314 17419 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:17:50.527817 17419 leader_election.cc:343] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:50.538050 18069 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:50.539762 17943 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:50.540531 17984 consensus_queue.cc:1059] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:50.514992 18088 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:50.565099 17645 tablet_bootstrap.cc:492] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:50.565768 17645 ts_tablet_manager.cc:1403] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.419s	user 0.026s	sys 0.025s
I20260709 13:17:50.565531 18062 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:50.576139 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 63975.4us
I20260709 13:17:50.579618 18065 raft_consensus.cc:3055] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:50.580039 18065 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:50.580857 18065 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.581985 18065 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:50.658360 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 100245us
I20260709 13:17:50.664115 17645 raft_consensus.cc:359] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.665134 17645 raft_consensus.cc:385] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:50.665447 17645 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:50.666121 17645 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.668001 17645 ts_tablet_manager.cc:1434] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.102s	user 0.005s	sys 0.000s
I20260709 13:17:50.668532 18069 raft_consensus.cc:697] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:50.669785 18069 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:50.672755 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 108523us
W20260709 13:17:50.691776 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 128831us
W20260709 13:17:50.693668 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 102222us
W20260709 13:17:50.727612 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 52344.9us
I20260709 13:17:50.732684 18062 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:50.675967 18088 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.745683 17495 leader_election.cc:304] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:17:50.748994 18091 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.202s	user 0.001s	sys 0.001s
I20260709 13:17:50.768761 18113 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.769444 18113 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.772027 18113 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:50.764400 17914 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:50.801740 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:17:50.804841 17419 leader_election.cc:343] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:50.817221 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 71648.6us
I20260709 13:17:50.766270 18074 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:50.853861 17528 raft_consensus.cc:2393] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 1: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:17:50.855922 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:50.855815 18114 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:17:50.864493 18074 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:17:50.865242 18096 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:50.868415 17454 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 0.
W20260709 13:17:50.870196 18100 log.cc:927] Time spent T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:17:50.870947 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:50.896283 18073 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:17:50.909478 17594 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 1: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:17:50.927240 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:50.927896 17594 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:50.940559 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:50.955724 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:50.956182 17645 tablet_bootstrap.cc:492] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Bootstrap starting.
I20260709 13:17:50.956354 17454 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.007099 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:17:51.015518 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.048084 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:17:51.048710 17602 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.050204 17594 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:51.051445 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:17:51.055575 17602 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:17:51.059708 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:51.061817 18087 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:17:51.066310 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:51.073920 18108 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.074477 18108 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:17:51.075278 18108 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:51.058012 17916 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.079592 17916 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:17:51.080292 18083 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:51.143366 17400 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:17:51.192780 18126 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:17:51.208627 17454 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:17:51.305930 17645 tablet_bootstrap.cc:654] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.208061 17916 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:17:51.320438 18125 log.cc:927] Time spent T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:17:51.340130 18083 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:51.362663 17419 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:51.364141 18062 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:51.385408 18099 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.392217 18099 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:51.407938 18099 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:51.414225 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:51.420900 17645 tablet_bootstrap.cc:492] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: No bootstrap required, opened a new log
I20260709 13:17:51.421386 17645 ts_tablet_manager.cc:1403] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent bootstrapping tablet: real 0.465s	user 0.030s	sys 0.033s
I20260709 13:17:51.423928 17645 raft_consensus.cc:359] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:51.424585 17645 raft_consensus.cc:385] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.424849 17645 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.425478 17645 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:51.432214 17645 ts_tablet_manager.cc:1434] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:17:51.455430 18111 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:51.456390 18130 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:51.460831 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:17:51.482532 18063 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:51.487818 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:17:51.490502 17352 catalog_manager.cc:5697] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.494354 18114 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.497319 17352 catalog_manager.cc:5697] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.515689 18104 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:17:51.572693 17351 catalog_manager.cc:5697] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.597784 17352 catalog_manager.cc:5697] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.626255 17526 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.632212 18104 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:51.643000 18104 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:51.859241 18099 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:51.860770 18077 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:17:51.861299 18077 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:51.864120 18077 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:51.864315 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:17:51.865280 17449 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:17:51.865213 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:17:51.866120 17528 raft_consensus.cc:2393] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:17:51.866467 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:17:51.867268 18077 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:51.868762 18077 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:17:51.869218 18077 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.874243 17916 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:51.885385 18077 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:51.888653 18077 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:51.891628 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:17:51.896777 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:17:51.897397 17526 raft_consensus.cc:2393] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:17:51.905982 17451 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:17:51.908789 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:17:51.909603 17830 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:51.910096 17830 raft_consensus.cc:697] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:17:51.910912 17830 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:17:51.922506 17351 catalog_manager.cc:5697] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 2, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 2 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.308280 17451 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:52.309454 18115 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.319551 17528 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:52.321499 18077 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.934180 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:52.968768 18158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:52.968878 18156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:52.968870 18155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:52.970795 16329 server_base.cc:1061] running on GCE node
I20260709 13:17:52.971901 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:52.972143 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:52.972338 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603072972319 us; error 0 us; skew 500 ppm
I20260709 13:17:52.972916 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:52.975665 16329 webserver.cc:533] Webserver started at http://127.15.242.68:33541/ using document root <none> and password file <none>
I20260709 13:17:52.976189 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:52.976409 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:52.976717 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:52.978171 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-3-root/instance:
uuid: "2158c0f750fd4b21afe24135c52167b2"
format_stamp: "Formatted at 2026-07-09 13:17:52 on dist-test-slave-fh5z"
I20260709 13:17:52.983973 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:17:52.987869 18163 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:52.988711 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:17:52.989091 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-3-root
uuid: "2158c0f750fd4b21afe24135c52167b2"
format_stamp: "Formatted at 2026-07-09 13:17:52 on dist-test-slave-fh5z"
I20260709 13:17:52.989514 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:53.012185 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:53.013767 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:53.015858 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:53.018553 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:53.018818 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:53.019105 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:53.019323 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:53.085012 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.68:36313
I20260709 13:17:53.085117 18225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.68:36313 every 8 connection(s)
I20260709 13:17:53.090344 16329 auto_leader_rebalancer-test.cc:384] add a tserver: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:17:53.105780 18226 heartbeater.cc:344] Connected to a master server at 127.15.242.126:39589
I20260709 13:17:53.106251 18226 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:53.107189 18226 heartbeater.cc:507] Master 127.15.242.126:39589 requested a full tablet report, sending...
I20260709 13:17:53.109251 17350 ts_manager.cc:194] Registered new tserver with Master: 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:17:53.110771 17350 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33624
I20260709 13:17:53.271282 17528 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:53.286368 17598 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:53.287873 17451 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:53.289032 18152 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.291941 18236 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.303092 18114 raft_consensus.cc:2955] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:17:53.304541 17495 consensus_peers.cc:597] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a2d603d87b8422dad32dfbb77b7e95c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.304894 17603 raft_consensus.cc:2955] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.306542 17451 raft_consensus.cc:2955] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.325745 17350 catalog_manager.cc:5697] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.362311 17449 consensus_queue.cc:237] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:53.380661 17526 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:53.382128 17603 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:53.384007 18104 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.386536 18069 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.398553 18069 raft_consensus.cc:2955] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.400326 17528 raft_consensus.cc:2955] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:17:53.403757 17420 consensus_peers.cc:597] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36043ed9ab7c47e9882fa33c5c135545. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.417229 17352 catalog_manager.cc:5697] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.425046 17598 raft_consensus.cc:2955] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.443944 17598 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:53.463798 17526 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:53.465250 17449 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:53.465252 18154 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:53.467958 18154 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:53.490957 17569 consensus_peers.cc:597] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 777822978f904e159194479932f1936f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.495128 18240 raft_consensus.cc:2955] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.499809 17449 raft_consensus.cc:2955] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.502875 17528 raft_consensus.cc:2955] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.508797 17447 consensus_queue.cc:237] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:53.518472 17351 catalog_manager.cc:5697] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 3, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 2 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.523895 17598 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:53.525095 17420 consensus_peers.cc:597] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 545b345ea8d04e8daea29d4a4f6477a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.525751 17528 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:53.526925 18251 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:53.527837 18104 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.538677 18069 raft_consensus.cc:2955] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.540194 17528 raft_consensus.cc:2955] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.544389 17603 raft_consensus.cc:2955] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:53.559290 17350 catalog_manager.cc:5697] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.736963 18259 ts_tablet_manager.cc:933] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:17:53.739080 18259 tablet_copy_client.cc:323] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:17:53.768497 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet 1a2d603d87b8422dad32dfbb77b7e95c from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:17:53.769177 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet 1a2d603d87b8422dad32dfbb77b7e95c from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-1a2d603d87b8422dad32dfbb77b7e95c
I20260709 13:17:53.790594 17539 tablet_copy_source_session.cc:215] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:53.794973 18259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2d603d87b8422dad32dfbb77b7e95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:53.823448 18259 tablet_copy_client.cc:806] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:53.824185 18259 tablet_copy_client.cc:670] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:53.829531 18259 tablet_copy_client.cc:538] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:53.842338 18259 tablet_bootstrap.cc:492] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:17:53.903000 18263 ts_tablet_manager.cc:933] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:53.906705 18264 ts_tablet_manager.cc:933] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
I20260709 13:17:53.918107 18264 tablet_copy_client.cc:323] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.65:36303
I20260709 13:17:53.934190 18259 tablet_bootstrap.cc:492] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:53.935309 18259 tablet_bootstrap.cc:492] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:17:53.961928 18263 tablet_copy_client.cc:323] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:17:54.113478 18226 heartbeater.cc:499] Master 127.15.242.126:39589 was elected leader, sending a full tablet report...
I20260709 13:17:54.166990 18275 ts_tablet_manager.cc:933] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
I20260709 13:17:54.176679 18259 ts_tablet_manager.cc:1403] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.335s	user 0.018s	sys 0.017s
I20260709 13:17:54.194249 17464 tablet_copy_service.cc:140] P 0480cf54c3cc424ab94b963ef2ff5bf4: Received BeginTabletCopySession request for tablet 36043ed9ab7c47e9882fa33c5c135545 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:47864)
I20260709 13:17:54.212658 17464 tablet_copy_service.cc:161] P 0480cf54c3cc424ab94b963ef2ff5bf4: Beginning new tablet copy session on tablet 36043ed9ab7c47e9882fa33c5c135545 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:47864: session id = 2158c0f750fd4b21afe24135c52167b2-36043ed9ab7c47e9882fa33c5c135545
W20260709 13:17:54.198815 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 287364us
I20260709 13:17:54.221191 18275 tablet_copy_client.cc:323] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.65:36303
I20260709 13:17:54.211948 18259 raft_consensus.cc:359] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:54.229694 18259 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:17:54.230453 18259 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:54.240258 18259 ts_tablet_manager.cc:1434] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.009s
I20260709 13:17:54.247449 17464 tablet_copy_source_session.cc:215] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:54.248224 17463 tablet_copy_service.cc:140] P 0480cf54c3cc424ab94b963ef2ff5bf4: Received BeginTabletCopySession request for tablet 545b345ea8d04e8daea29d4a4f6477a9 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:47864)
I20260709 13:17:54.248821 17463 tablet_copy_service.cc:161] P 0480cf54c3cc424ab94b963ef2ff5bf4: Beginning new tablet copy session on tablet 545b345ea8d04e8daea29d4a4f6477a9 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:47864: session id = 2158c0f750fd4b21afe24135c52167b2-545b345ea8d04e8daea29d4a4f6477a9
I20260709 13:17:54.252183 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-1a2d603d87b8422dad32dfbb77b7e95c received from {username='slave'} at 127.0.0.1:35586
I20260709 13:17:54.252702 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-1a2d603d87b8422dad32dfbb77b7e95c on tablet 1a2d603d87b8422dad32dfbb77b7e95c with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:17:54.256317 17463 tablet_copy_source_session.cc:215] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:54.260666 18264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36043ed9ab7c47e9882fa33c5c135545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.267916 18275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 545b345ea8d04e8daea29d4a4f6477a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.302740 18275 tablet_copy_client.cc:806] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:54.309159 18275 tablet_copy_client.cc:670] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:54.321403 18275 tablet_copy_client.cc:538] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:54.323860 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet 777822978f904e159194479932f1936f from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:17:54.325207 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet 777822978f904e159194479932f1936f from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-777822978f904e159194479932f1936f
I20260709 13:17:54.326948 18264 tablet_copy_client.cc:806] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:54.327557 18264 tablet_copy_client.cc:670] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:54.331241 18264 tablet_copy_client.cc:538] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:54.333957 17613 tablet_copy_source_session.cc:215] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:54.337006 18275 tablet_bootstrap.cc:492] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:17:54.341527 18263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777822978f904e159194479932f1936f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.358739 18200 raft_consensus.cc:1217] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:54.374380 18264 tablet_bootstrap.cc:492] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:17:54.381108 18263 tablet_copy_client.cc:806] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:54.381840 18263 tablet_copy_client.cc:670] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:54.395053 18263 tablet_copy_client.cc:538] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:54.406391 18263 tablet_bootstrap.cc:492] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:17:54.428344 18275 tablet_bootstrap.cc:492] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:54.429334 18275 tablet_bootstrap.cc:492] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:17:54.429620 18264 tablet_bootstrap.cc:492] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:54.430125 18275 ts_tablet_manager.cc:1403] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.018s
I20260709 13:17:54.430605 18264 tablet_bootstrap.cc:492] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:17:54.431377 18264 ts_tablet_manager.cc:1403] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.014s
I20260709 13:17:54.434384 18264 raft_consensus.cc:359] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:54.435652 18264 raft_consensus.cc:740] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:17:54.436470 18264 consensus_queue.cc:260] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:54.433504 18275 raft_consensus.cc:359] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:54.438241 18275 raft_consensus.cc:740] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:17:54.439002 18275 consensus_queue.cc:260] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:54.441197 18275 ts_tablet_manager.cc:1434] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:17:54.443778 18264 ts_tablet_manager.cc:1434] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:17:54.447526 17463 tablet_copy_service.cc:342] P 0480cf54c3cc424ab94b963ef2ff5bf4: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-545b345ea8d04e8daea29d4a4f6477a9 received from {username='slave'} at 127.0.0.1:47864
I20260709 13:17:54.447975 17463 tablet_copy_service.cc:434] P 0480cf54c3cc424ab94b963ef2ff5bf4: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-545b345ea8d04e8daea29d4a4f6477a9 on tablet 545b345ea8d04e8daea29d4a4f6477a9 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:17:54.451169 17463 tablet_copy_service.cc:342] P 0480cf54c3cc424ab94b963ef2ff5bf4: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-36043ed9ab7c47e9882fa33c5c135545 received from {username='slave'} at 127.0.0.1:47864
I20260709 13:17:54.451579 17463 tablet_copy_service.cc:434] P 0480cf54c3cc424ab94b963ef2ff5bf4: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-36043ed9ab7c47e9882fa33c5c135545 on tablet 36043ed9ab7c47e9882fa33c5c135545 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:17:54.452683 18263 tablet_bootstrap.cc:492] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:54.453661 18263 tablet_bootstrap.cc:492] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:17:54.454422 18263 ts_tablet_manager.cc:1403] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.011s
I20260709 13:17:54.461321 18263 raft_consensus.cc:359] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:54.462271 18263 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:17:54.463198 18263 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:54.467584 18263 ts_tablet_manager.cc:1434] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:17:54.470554 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-777822978f904e159194479932f1936f received from {username='slave'} at 127.0.0.1:52572
I20260709 13:17:54.471021 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-777822978f904e159194479932f1936f on tablet 777822978f904e159194479932f1936f with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:17:54.594863 18200 raft_consensus.cc:1217] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:54.736582 18200 raft_consensus.cc:1217] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:54.739589 18200 raft_consensus.cc:1217] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:54.856727 18272 raft_consensus.cc:1064] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:17:54.859998 18272 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:54.870157 18200 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:54.872881 17603 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:54.873386 17447 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:54.874727 18287 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:54.876986 18272 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:54.878072 18280 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:54.892517 18287 raft_consensus.cc:2955] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:54.894446 18200 raft_consensus.cc:2955] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:54.911346 17351 catalog_manager.cc:5697] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:54.911942 17603 raft_consensus.cc:2955] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:54.918304 17449 raft_consensus.cc:2955] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:54.949488 17526 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:54.957813 18200 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:54.958130 17603 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:54.959626 18280 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:54.960435 18272 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:54.966713 18280 raft_consensus.cc:2955] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:54.969404 17603 raft_consensus.cc:2955] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:54.971431 18200 raft_consensus.cc:2955] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:17:54.979346 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08001fc240 after lost signal to thread 16332
W20260709 13:17:54.980396 17550 debug-util.cc:398] Leaking SignalData structure 0x7b080013c780 after lost signal to thread 17386
W20260709 13:17:54.982302 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08002f8b60 after lost signal to thread 17553
W20260709 13:17:54.984125 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08002fec00 after lost signal to thread 18225
I20260709 13:17:54.988157 17350 catalog_manager.cc:5697] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:54.998476 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a2d603d87b8422dad32dfbb77b7e95c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:55.008352 17436 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a2d603d87b8422dad32dfbb77b7e95c with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55872
I20260709 13:17:55.018260 18295 tablet_replica.cc:333] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:17:55.027932 18069 raft_consensus.cc:1064] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:17:55.034833 18295 raft_consensus.cc:2243] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:55.035939 18295 raft_consensus.cc:2272] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:55.036737 18069 consensus_queue.cc:237] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:55.039278 18295 ts_tablet_manager.cc:1916] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:55.061124 18200 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:55.061599 17603 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:55.063072 17528 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:55.063721 18069 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:55.063148 18295 ts_tablet_manager.cc:1929] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:55.064805 18295 log.cc:1199] T 1a2d603d87b8422dad32dfbb77b7e95c P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/1a2d603d87b8422dad32dfbb77b7e95c
I20260709 13:17:55.064658 18247 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:55.066726 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet 1a2d603d87b8422dad32dfbb77b7e95c (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:17:55.068078 18104 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:55.107129 18069 raft_consensus.cc:2955] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.113237 17528 raft_consensus.cc:2955] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.130784 17603 raft_consensus.cc:2955] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.139724 18200 raft_consensus.cc:2955] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.162773 17350 catalog_manager.cc:5697] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.229242 17449 consensus_queue.cc:237] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:55.241813 17526 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:55.243956 18200 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:55.244112 18104 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:55.247859 18069 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:55.255184 18104 raft_consensus.cc:2955] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.264030 17526 raft_consensus.cc:2955] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.266206 18200 raft_consensus.cc:2955] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.288097 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36043ed9ab7c47e9882fa33c5c135545 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:55.306809 17349 catalog_manager.cc:5697] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.340806 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet 36043ed9ab7c47e9882fa33c5c135545 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49550
I20260709 13:17:55.359436 18297 raft_consensus.cc:1064] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:17:55.362303 18278 raft_consensus.cc:1064] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:17:55.364549 18301 tablet_replica.cc:333] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:17:55.364837 18278 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:55.393430 18297 consensus_queue.cc:237] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:55.403076 18200 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:55.404930 18077 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:55.411340 17528 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:55.413357 17447 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:55.414883 18077 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:55.417639 18077 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:55.443290 17447 raft_consensus.cc:2955] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.445201 17526 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:55.446765 18302 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:55.445060 18278 raft_consensus.cc:2955] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.454969 17594 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:55.457703 18200 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:55.460152 18302 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:55.464478 18069 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:55.504676 18301 raft_consensus.cc:2243] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:55.505523 18301 raft_consensus.cc:2272] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:55.515461 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 87441us
I20260709 13:17:55.507741 17350 catalog_manager.cc:5697] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 3 to 4, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.524698 17528 raft_consensus.cc:2955] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.557826 18301 ts_tablet_manager.cc:1916] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:55.582902 18302 raft_consensus.cc:2955] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.597360 18200 raft_consensus.cc:2955] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.611699 17599 raft_consensus.cc:2955] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.616942 18201 raft_consensus.cc:2955] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.630193 17594 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:55.643011 17352 catalog_manager.cc:5697] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.647575 18301 ts_tablet_manager.cc:1929] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:55.648066 18301 log.cc:1199] T 36043ed9ab7c47e9882fa33c5c135545 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/36043ed9ab7c47e9882fa33c5c135545
I20260709 13:17:55.657346 17526 raft_consensus.cc:2955] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.666429 17448 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:55.668244 18201 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:55.670630 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet 36043ed9ab7c47e9882fa33c5c135545 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:17:55.682538 18314 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:55.685364 18314 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:55.690709 17447 consensus_queue.cc:237] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:55.695506 18201 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:55.697564 18069 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:55.700345 17528 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:55.701736 18069 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:55.713833 18302 raft_consensus.cc:2955] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.715969 17529 raft_consensus.cc:2955] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.719686 18201 raft_consensus.cc:2955] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.721918 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 545b345ea8d04e8daea29d4a4f6477a9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:55.736858 17352 catalog_manager.cc:5697] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.749023 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet 545b345ea8d04e8daea29d4a4f6477a9 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49550
I20260709 13:17:55.749987 18301 tablet_replica.cc:333] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:17:55.751101 18301 raft_consensus.cc:2243] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:55.751964 18301 raft_consensus.cc:2272] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:55.758104 18301 ts_tablet_manager.cc:1916] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:55.765594 18315 raft_consensus.cc:2955] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.780498 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 777822978f904e159194479932f1936f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:55.795564 17447 raft_consensus.cc:2955] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.798731 18200 raft_consensus.cc:2955] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:55.802111 17352 catalog_manager.cc:5697] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index 4 to 5, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 2 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.824687 18301 ts_tablet_manager.cc:1929] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:55.825176 18301 log.cc:1199] T 545b345ea8d04e8daea29d4a4f6477a9 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/545b345ea8d04e8daea29d4a4f6477a9
I20260709 13:17:55.828167 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet 545b345ea8d04e8daea29d4a4f6477a9 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:17:55.831923 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet 777822978f904e159194479932f1936f with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54542
I20260709 13:17:55.839047 18317 tablet_replica.cc:333] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:17:55.840071 18317 raft_consensus.cc:2243] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:55.840642 18317 raft_consensus.cc:2272] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:55.844831 18317 ts_tablet_manager.cc:1916] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:55.862005 18317 ts_tablet_manager.cc:1929] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:17:55.862458 18317 log.cc:1199] T 777822978f904e159194479932f1936f P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/777822978f904e159194479932f1936f
I20260709 13:17:55.863804 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet 777822978f904e159194479932f1936f (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:17:56.954836 17594 consensus_queue.cc:237] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:56.961585 17529 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:56.962833 17569 consensus_peers.cc:597] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea190a19aed74ffea2c29fa8c13edeac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:56.963145 17448 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:56.963413 18313 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:56.964884 18278 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.977949 18313 raft_consensus.cc:2955] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:56.979655 17528 raft_consensus.cc:2955] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:56.983610 17448 raft_consensus.cc:2955] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:56.997952 17594 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:57.002560 17352 catalog_manager.cc:5697] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:57.028972 17569 consensus_peers.cc:597] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd986037a248442489c77e1aed466117. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:57.029708 17448 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:57.031014 17529 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:57.032639 18313 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.033706 18323 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:57.054281 18313 raft_consensus.cc:2955] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:57.056013 17448 raft_consensus.cc:2955] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:57.065085 17528 raft_consensus.cc:2955] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:57.086288 17448 consensus_queue.cc:237] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:57.106282 17349 catalog_manager.cc:5697] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:57.143270 17420 consensus_peers.cc:597] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c159f64326b74a248a65dc1dae5c79a0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:57.146063 17603 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:57.147682 17528 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:57.149770 18302 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:57.155519 18302 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:57.164490 18069 raft_consensus.cc:2955] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:57.165508 17528 raft_consensus.cc:2955] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:57.167580 17603 raft_consensus.cc:2955] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:57.195837 17350 catalog_manager.cc:5697] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:57.215896 17594 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:57.236552 17528 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:57.238178 18313 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.239075 17448 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:57.238178 17569 consensus_peers.cc:597] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 916155438d0e450f9fdbbb449eee2721. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:57.240731 18323 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:57.261711 18278 raft_consensus.cc:2955] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:57.276130 17529 raft_consensus.cc:2955] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:57.277817 17448 raft_consensus.cc:2955] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:17:57.286664 17350 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.434885 18344 ts_tablet_manager.cc:933] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:57.445995 18344 tablet_copy_client.cc:323] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:17:57.448467 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet ea190a19aed74ffea2c29fa8c13edeac from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:17:57.449088 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet ea190a19aed74ffea2c29fa8c13edeac from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-ea190a19aed74ffea2c29fa8c13edeac
I20260709 13:17:57.472824 17613 tablet_copy_source_session.cc:215] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:57.477485 18344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea190a19aed74ffea2c29fa8c13edeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.522799 18344 tablet_copy_client.cc:806] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:57.523602 18344 tablet_copy_client.cc:670] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:57.523872 18346 ts_tablet_manager.cc:933] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:57.528033 18344 tablet_copy_client.cc:538] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:57.540527 18344 tablet_bootstrap.cc:492] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:17:57.542903 18346 tablet_copy_client.cc:323] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:17:57.544994 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet dd986037a248442489c77e1aed466117 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:17:57.545576 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet dd986037a248442489c77e1aed466117 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-dd986037a248442489c77e1aed466117
I20260709 13:17:57.557117 17613 tablet_copy_source_session.cc:215] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:57.564774 18346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd986037a248442489c77e1aed466117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.599323 18346 tablet_copy_client.cc:806] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:57.600034 18346 tablet_copy_client.cc:670] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:57.604043 18346 tablet_copy_client.cc:538] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:57.617769 18349 ts_tablet_manager.cc:933] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
I20260709 13:17:57.621212 18346 tablet_bootstrap.cc:492] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:17:57.624547 18344 tablet_bootstrap.cc:492] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:57.631472 18344 tablet_bootstrap.cc:492] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:17:57.633092 18344 ts_tablet_manager.cc:1403] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.013s
I20260709 13:17:57.639253 18349 tablet_copy_client.cc:323] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.65:36303
I20260709 13:17:57.641418 17463 tablet_copy_service.cc:140] P 0480cf54c3cc424ab94b963ef2ff5bf4: Received BeginTabletCopySession request for tablet c159f64326b74a248a65dc1dae5c79a0 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:47864)
I20260709 13:17:57.642074 17463 tablet_copy_service.cc:161] P 0480cf54c3cc424ab94b963ef2ff5bf4: Beginning new tablet copy session on tablet c159f64326b74a248a65dc1dae5c79a0 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:47864: session id = 2158c0f750fd4b21afe24135c52167b2-c159f64326b74a248a65dc1dae5c79a0
I20260709 13:17:57.637570 18344 raft_consensus.cc:359] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:57.649428 18344 raft_consensus.cc:740] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:17:57.650259 18344 consensus_queue.cc:260] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:57.668045 17463 tablet_copy_source_session.cc:215] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:57.667963 18344 ts_tablet_manager.cc:1434] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.034s	user 0.014s	sys 0.007s
I20260709 13:17:57.672291 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-ea190a19aed74ffea2c29fa8c13edeac received from {username='slave'} at 127.0.0.1:52572
I20260709 13:17:57.672828 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-ea190a19aed74ffea2c29fa8c13edeac on tablet ea190a19aed74ffea2c29fa8c13edeac with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:17:57.708923 18349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c159f64326b74a248a65dc1dae5c79a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.742439 18346 tablet_bootstrap.cc:492] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:57.744279 18346 tablet_bootstrap.cc:492] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:17:57.746462 18346 ts_tablet_manager.cc:1403] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.125s	user 0.020s	sys 0.004s
I20260709 13:17:57.745632 18349 tablet_copy_client.cc:806] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:57.749343 18349 tablet_copy_client.cc:670] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:57.756177 18346 raft_consensus.cc:359] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:57.757174 18346 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:17:57.757893 18346 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:57.760696 18346 ts_tablet_manager.cc:1434] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:17:57.766386 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-dd986037a248442489c77e1aed466117 received from {username='slave'} at 127.0.0.1:52572
I20260709 13:17:57.766857 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-dd986037a248442489c77e1aed466117 on tablet dd986037a248442489c77e1aed466117 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:17:57.770890 18349 tablet_copy_client.cc:538] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:57.780396 18349 tablet_bootstrap.cc:492] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:17:57.807730 18346 ts_tablet_manager.cc:933] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:17:57.841634 18346 tablet_copy_client.cc:323] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:17:57.843279 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet 916155438d0e450f9fdbbb449eee2721 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:17:57.843914 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet 916155438d0e450f9fdbbb449eee2721 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-916155438d0e450f9fdbbb449eee2721
I20260709 13:17:57.855014 18349 tablet_bootstrap.cc:492] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:57.855976 18349 tablet_bootstrap.cc:492] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:17:57.856684 18349 ts_tablet_manager.cc:1403] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.020s
I20260709 13:17:57.859758 18349 raft_consensus.cc:359] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:57.860607 18349 raft_consensus.cc:740] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:17:57.861714 18349 consensus_queue.cc:260] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:57.864562 18349 ts_tablet_manager.cc:1434] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:17:57.866842 17463 tablet_copy_service.cc:342] P 0480cf54c3cc424ab94b963ef2ff5bf4: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-c159f64326b74a248a65dc1dae5c79a0 received from {username='slave'} at 127.0.0.1:47864
I20260709 13:17:57.867334 17463 tablet_copy_service.cc:434] P 0480cf54c3cc424ab94b963ef2ff5bf4: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-c159f64326b74a248a65dc1dae5c79a0 on tablet c159f64326b74a248a65dc1dae5c79a0 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:17:57.877728 17613 tablet_copy_source_session.cc:215] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:57.882761 18346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916155438d0e450f9fdbbb449eee2721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.902129 18346 tablet_copy_client.cc:806] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:57.903765 18346 tablet_copy_client.cc:670] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:57.908878 18346 tablet_copy_client.cc:538] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:57.924196 18346 tablet_bootstrap.cc:492] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:17:57.944705 18346 tablet_bootstrap.cc:492] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:57.945461 18346 tablet_bootstrap.cc:492] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:17:57.946081 18346 ts_tablet_manager.cc:1403] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.013s
I20260709 13:17:57.948243 18346 raft_consensus.cc:359] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:57.948875 18346 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:17:57.949376 18346 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:17:57.951891 18346 ts_tablet_manager.cc:1434] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:57.953956 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-916155438d0e450f9fdbbb449eee2721 received from {username='slave'} at 127.0.0.1:52572
I20260709 13:17:57.954460 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-916155438d0e450f9fdbbb449eee2721 on tablet 916155438d0e450f9fdbbb449eee2721 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:17:58.013562 18201 raft_consensus.cc:1217] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:58.039036 18201 raft_consensus.cc:1217] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:58.071879 18201 raft_consensus.cc:1217] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:58.344014 18201 raft_consensus.cc:1217] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:58.511984 18278 raft_consensus.cc:1064] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:17:58.513688 18278 consensus_queue.cc:237] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:58.521112 17521 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:58.523772 18201 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:58.524315 17448 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:58.523069 18278 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:17:58.526401 18357 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:58.527366 18323 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:58.572011 18323 raft_consensus.cc:1064] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:17:58.574605 18323 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:58.590890 18338 raft_consensus.cc:1064] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:17:58.594348 18358 raft_consensus.cc:2955] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:58.593597 18338 consensus_queue.cc:237] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:58.599567 17521 raft_consensus.cc:2955] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:58.609622 18200 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:58.618098 18343 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:17:58.628784 18200 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:58.630690 18069 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:58.645810 17349 catalog_manager.cc:5697] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:58.651115 17529 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:58.655565 18336 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:58.668027 17529 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:58.687108 18357 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:58.656087 17594 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:58.695861 17449 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:17:58.710888 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 57942.8us
I20260709 13:17:58.763168 18367 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:17:58.764663 18278 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:58.777451 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 62707.8us
W20260709 13:17:58.817951 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 55179.7us
I20260709 13:17:58.799306 18338 raft_consensus.cc:2955] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:58.823988 18378 raft_consensus.cc:1064] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:17:58.827014 17447 raft_consensus.cc:2955] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:58.842862 18201 raft_consensus.cc:2955] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:17:58.869710 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 88846.3us
I20260709 13:17:58.829702 18378 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:58.897997 18358 raft_consensus.cc:2955] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:58.900655 17451 raft_consensus.cc:2955] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:17:58.940415 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 162486us
I20260709 13:17:58.979990 18200 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:17:58.983367 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 187125us
I20260709 13:17:58.983532 17521 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:58.994980 17451 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:58.995595 17529 raft_consensus.cc:2955] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:58.992156 18198 raft_consensus.cc:2955] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:58.999301 18357 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:17:59.015544 18381 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:59.015216 17526 raft_consensus.cc:2955] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.037794 18377 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:17:59.064312 17349 catalog_manager.cc:5697] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:59.080027 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45629.8us
I20260709 13:17:59.086139 18200 raft_consensus.cc:2955] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.126386 17449 consensus_queue.cc:237] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:59.107023 17351 catalog_manager.cc:5697] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.155927 17526 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:59.165302 18392 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:59.182984 18200 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:59.187820 18380 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:59.203016 17528 raft_consensus.cc:2955] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.206223 18380 raft_consensus.cc:2955] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.228015 18200 raft_consensus.cc:2955] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.235913 17595 consensus_queue.cc:237] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:59.265332 18198 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:59.266436 17449 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:59.268177 18377 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:59.279454 17349 catalog_manager.cc:5697] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.271631 17600 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:59.296725 18358 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:59.300467 18357 raft_consensus.cc:2955] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.304185 18378 raft_consensus.cc:2955] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.310828 18201 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:59.314908 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c159f64326b74a248a65dc1dae5c79a0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:59.323480 18200 raft_consensus.cc:2955] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.323504 18377 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:17:59.328707 18201 raft_consensus.cc:2955] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:17:59.350579 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 62039.7us
I20260709 13:17:59.353000 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet c159f64326b74a248a65dc1dae5c79a0 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49550
I20260709 13:17:59.363390 17529 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:59.364315 18397 tablet_replica.cc:333] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:17:59.365645 18397 raft_consensus.cc:2243] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:59.373168 17451 raft_consensus.cc:2955] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.368568 18397 pending_rounds.cc:70] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e: Trying to abort 1 pending ops.
I20260709 13:17:59.381004 18397 pending_rounds.cc:77] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305638209913397248 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "c159f64326b74a248a65dc1dae5c79a0" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } } }
I20260709 13:17:59.404462 18397 raft_consensus.cc:2917] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:17:59.405086 18397 raft_consensus.cc:2889] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:17:59.405704 18397 raft_consensus.cc:2272] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:59.391659 18371 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:59.391855 17349 catalog_manager.cc:5697] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.379973 17352 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.427778 18381 raft_consensus.cc:2955] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.430657 18397 ts_tablet_manager.cc:1916] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:59.440095 17522 raft_consensus.cc:2955] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.452493 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet ea190a19aed74ffea2c29fa8c13edeac with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54542
I20260709 13:17:59.471064 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ea190a19aed74ffea2c29fa8c13edeac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:59.476289 18397 ts_tablet_manager.cc:1929] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:59.476969 18397 log.cc:1199] T c159f64326b74a248a65dc1dae5c79a0 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/c159f64326b74a248a65dc1dae5c79a0
I20260709 13:17:59.485224 17529 raft_consensus.cc:2955] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.517386 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet c159f64326b74a248a65dc1dae5c79a0 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:17:59.523718 18200 raft_consensus.cc:2955] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.524542 17446 raft_consensus.cc:2955] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.545533 17352 catalog_manager.cc:5697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.572096 17436 tablet_service.cc:1558] Processing DeleteTablet for tablet dd986037a248442489c77e1aed466117 with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55872
I20260709 13:17:59.646409 17595 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:17:59.664111 18400 tablet_replica.cc:333] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:17:59.665234 18400 raft_consensus.cc:2243] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:59.673437 18400 raft_consensus.cc:2272] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:59.668642 18399 tablet_replica.cc:333] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:17:59.675287 18399 raft_consensus.cc:2243] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:59.675990 18399 raft_consensus.cc:2272] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:59.679392 18399 ts_tablet_manager.cc:1916] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:59.684412 18400 ts_tablet_manager.cc:1916] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:59.720738 18400 ts_tablet_manager.cc:1929] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:59.721167 18400 log.cc:1199] T dd986037a248442489c77e1aed466117 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/dd986037a248442489c77e1aed466117
I20260709 13:17:59.721918 18399 ts_tablet_manager.cc:1929] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:59.722463 18399 log.cc:1199] T ea190a19aed74ffea2c29fa8c13edeac P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/ea190a19aed74ffea2c29fa8c13edeac
I20260709 13:17:59.724471 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet ea190a19aed74ffea2c29fa8c13edeac (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:17:59.733382 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet dd986037a248442489c77e1aed466117 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:17:59.738004 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd986037a248442489c77e1aed466117 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:59.754830 18200 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:59.754935 17451 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:59.765611 18371 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:59.772009 18278 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:59.783455 18371 raft_consensus.cc:2955] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.794198 17446 raft_consensus.cc:2955] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.796563 18200 raft_consensus.cc:2955] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.813241 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 916155438d0e450f9fdbbb449eee2721 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:59.828544 17352 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:17:59.841332 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet 916155438d0e450f9fdbbb449eee2721 with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54542
I20260709 13:17:59.842720 18399 tablet_replica.cc:333] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:17:59.843818 18399 raft_consensus.cc:2243] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:59.844637 18399 raft_consensus.cc:2272] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:59.848223 18399 ts_tablet_manager.cc:1916] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:59.867113 18399 ts_tablet_manager.cc:1929] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:59.867539 18399 log.cc:1199] T 916155438d0e450f9fdbbb449eee2721 P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/916155438d0e450f9fdbbb449eee2721
I20260709 13:17:59.869268 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet 916155438d0e450f9fdbbb449eee2721 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:18:00.950827 17529 consensus_queue.cc:237] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:00.958036 17599 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:00.959792 17495 consensus_peers.cc:597] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b44f8d5d5454fb7af9630783cd02def. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.961884 17446 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:00.964042 18375 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:00.965003 18384 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.007141 17599 raft_consensus.cc:2955] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.002501 18403 raft_consensus.cc:2955] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.019577 17451 raft_consensus.cc:2955] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.027760 17349 catalog_manager.cc:5697] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.035259 17599 consensus_queue.cc:237] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:01.079123 17446 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:01.078092 17569 consensus_peers.cc:597] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37ab58b1d58a45d9ba339018260d1ee4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.080514 17529 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:01.082008 18411 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.087653 18411 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.109820 18378 raft_consensus.cc:2955] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.111107 17449 raft_consensus.cc:2955] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.110795 17521 raft_consensus.cc:2955] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.129889 17599 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:01.130251 17351 catalog_manager.cc:5697] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.169554 17449 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:01.170980 17569 consensus_peers.cc:597] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dcd29f6044f6485580736010a0122d2b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.166105 17529 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:01.175860 18378 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.177577 18371 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:01.189405 18378 raft_consensus.cc:2955] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.191298 17529 raft_consensus.cc:2955] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.203594 17449 raft_consensus.cc:2955] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.207839 17528 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:01.212417 17351 catalog_manager.cc:5697] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.232895 17600 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:01.236433 17495 consensus_peers.cc:597] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12ca126b355348958188e14e8b1c7470. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.240137 18403 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:01.290532 17449 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:01.294364 18403 raft_consensus.cc:2955] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.298858 18375 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:01.302942 17600 raft_consensus.cc:2955] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.315181 17349 catalog_manager.cc:5697] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.360524 17449 raft_consensus.cc:2955] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:01.505952 18422 ts_tablet_manager.cc:933] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:01.532042 18422 tablet_copy_client.cc:323] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:18:01.533987 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet 37ab58b1d58a45d9ba339018260d1ee4 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:18:01.534763 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet 37ab58b1d58a45d9ba339018260d1ee4 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-37ab58b1d58a45d9ba339018260d1ee4
I20260709 13:18:01.542922 17613 tablet_copy_source_session.cc:215] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:01.546813 18422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37ab58b1d58a45d9ba339018260d1ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:01.569902 18422 tablet_copy_client.cc:806] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:01.570739 18422 tablet_copy_client.cc:670] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:01.583297 18422 tablet_copy_client.cc:538] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:01.613301 18424 ts_tablet_manager.cc:933] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:01.619992 18422 tablet_bootstrap.cc:492] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:18:01.631392 18424 tablet_copy_client.cc:323] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:18:01.636584 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet 6b44f8d5d5454fb7af9630783cd02def from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:18:01.637259 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet 6b44f8d5d5454fb7af9630783cd02def from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-6b44f8d5d5454fb7af9630783cd02def
I20260709 13:18:01.662312 17539 tablet_copy_source_session.cc:215] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:01.698911 18422 tablet_bootstrap.cc:492] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:01.700079 18422 tablet_bootstrap.cc:492] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:18:01.700824 18422 ts_tablet_manager.cc:1403] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.008s
I20260709 13:18:01.690799 18427 ts_tablet_manager.cc:933] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:01.702425 18424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b44f8d5d5454fb7af9630783cd02def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:01.707085 18427 tablet_copy_client.cc:323] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:18:01.710364 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet dcd29f6044f6485580736010a0122d2b from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:18:01.710927 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet dcd29f6044f6485580736010a0122d2b from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-dcd29f6044f6485580736010a0122d2b
I20260709 13:18:01.728353 17613 tablet_copy_source_session.cc:215] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:01.733986 18422 raft_consensus.cc:359] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:01.735028 18422 raft_consensus.cc:740] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:18:01.735603 18427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd29f6044f6485580736010a0122d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:01.735879 18422 consensus_queue.cc:260] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:01.748627 18422 ts_tablet_manager.cc:1434] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:18:01.750449 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-37ab58b1d58a45d9ba339018260d1ee4 received from {username='slave'} at 127.0.0.1:52572
I20260709 13:18:01.750865 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-37ab58b1d58a45d9ba339018260d1ee4 on tablet 37ab58b1d58a45d9ba339018260d1ee4 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:01.753738 18424 tablet_copy_client.cc:806] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:01.758337 18424 tablet_copy_client.cc:670] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:01.759310 18427 tablet_copy_client.cc:806] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:01.759935 18427 tablet_copy_client.cc:670] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:01.763602 18427 tablet_copy_client.cc:538] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:01.778832 18427 tablet_bootstrap.cc:492] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:18:01.809437 18422 ts_tablet_manager.cc:933] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:01.813056 18424 tablet_copy_client.cc:538] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:01.824101 18422 tablet_copy_client.cc:323] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:18:01.826766 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet 12ca126b355348958188e14e8b1c7470 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:18:01.827426 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet 12ca126b355348958188e14e8b1c7470 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-12ca126b355348958188e14e8b1c7470
I20260709 13:18:01.845088 18427 tablet_bootstrap.cc:492] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:01.846305 18427 tablet_bootstrap.cc:492] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:18:01.847411 18427 ts_tablet_manager.cc:1403] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.005s
I20260709 13:18:01.849042 18424 tablet_bootstrap.cc:492] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:18:01.850811 18427 raft_consensus.cc:359] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:01.851799 18427 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:18:01.852537 18427 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:18:01.853117 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 75280.2us
I20260709 13:18:01.846262 17539 tablet_copy_source_session.cc:215] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:01.866750 18422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ca126b355348958188e14e8b1c7470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:01.870900 18427 ts_tablet_manager.cc:1434] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:18:01.913015 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-dcd29f6044f6485580736010a0122d2b received from {username='slave'} at 127.0.0.1:52572
I20260709 13:18:01.913573 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-dcd29f6044f6485580736010a0122d2b on tablet dcd29f6044f6485580736010a0122d2b with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:01.920162 18200 raft_consensus.cc:1217] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:01.949559 18422 tablet_copy_client.cc:806] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:01.950215 18422 tablet_copy_client.cc:670] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:01.954183 18422 tablet_copy_client.cc:538] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:01.980801 18422 tablet_bootstrap.cc:492] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:18:02.031435 18422 tablet_bootstrap.cc:492] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.032464 18422 tablet_bootstrap.cc:492] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:18:02.038990 18422 ts_tablet_manager.cc:1403] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.059s	user 0.023s	sys 0.008s
I20260709 13:18:02.042318 18422 raft_consensus.cc:359] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:02.043284 18422 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:18:02.044198 18422 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:02.054734 18422 ts_tablet_manager.cc:1434] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:18:02.062794 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-12ca126b355348958188e14e8b1c7470 received from {username='slave'} at 127.0.0.1:35586
I20260709 13:18:02.063349 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-12ca126b355348958188e14e8b1c7470 on tablet 12ca126b355348958188e14e8b1c7470 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:02.085791 18424 tablet_bootstrap.cc:492] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.086805 18424 tablet_bootstrap.cc:492] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:18:02.087571 18424 ts_tablet_manager.cc:1403] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.239s	user 0.046s	sys 0.045s
I20260709 13:18:02.091745 18424 raft_consensus.cc:359] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:02.092852 18424 raft_consensus.cc:740] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:18:02.093804 18424 consensus_queue.cc:260] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:02.096364 18424 ts_tablet_manager.cc:1434] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:02.098245 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-6b44f8d5d5454fb7af9630783cd02def received from {username='slave'} at 127.0.0.1:35586
I20260709 13:18:02.098677 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-6b44f8d5d5454fb7af9630783cd02def on tablet 6b44f8d5d5454fb7af9630783cd02def with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:02.120302 18200 raft_consensus.cc:1217] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:02.180405 18200 raft_consensus.cc:1217] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:02.223764 18200 raft_consensus.cc:1217] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:02.505640 18411 raft_consensus.cc:1064] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:02.508587 18411 consensus_queue.cc:237] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:02.518324 18418 raft_consensus.cc:1064] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:02.521153 18418 consensus_queue.cc:237] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:02.539806 18200 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:02.542465 18375 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:18:02.543097 18200 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:02.557367 17599 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:02.541983 17521 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:02.563122 18403 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:02.571615 18371 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:02.586199 17451 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:02.588984 18371 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:02.591950 17451 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:02.597363 18441 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:02.601190 18378 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:02.604974 18443 raft_consensus.cc:1064] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:02.608105 18443 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:02.634501 18378 raft_consensus.cc:1064] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:02.636876 18378 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:02.651789 18375 raft_consensus.cc:2955] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.654786 17600 raft_consensus.cc:2955] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.658259 18201 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:02.660540 18371 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:02.668928 17521 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:02.673261 18378 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:02.677774 17599 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:02.686483 17448 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:02.679296 18199 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:02.681427 17451 raft_consensus.cc:2955] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.681591 18198 raft_consensus.cc:2955] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.702471 18371 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:02.708720 17349 catalog_manager.cc:5697] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:02.710850 17450 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:18:02.723755 18447 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:18:02.730250 18418 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:02.732461 18418 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:02.736023 18371 raft_consensus.cc:2955] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.748116 17448 raft_consensus.cc:2955] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.760665 18418 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:02.765403 17521 raft_consensus.cc:2955] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.765537 17528 raft_consensus.cc:2955] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.760313 18411 raft_consensus.cc:2955] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.794133 18201 raft_consensus.cc:2955] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.818487 17352 catalog_manager.cc:5697] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.820104 18375 raft_consensus.cc:2955] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.826529 17450 raft_consensus.cc:2955] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.830530 18200 raft_consensus.cc:2955] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.843595 17599 raft_consensus.cc:2955] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.843595 18198 raft_consensus.cc:2955] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.860553 17521 consensus_queue.cc:237] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:02.868160 17450 raft_consensus.cc:2955] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.885638 17349 catalog_manager.cc:5697] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.891458 17599 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:02.894343 18201 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:02.894977 18418 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:02.900913 18418 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:18:02.905645 17352 catalog_manager.cc:5697] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:02.916893 18443 raft_consensus.cc:2955] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.919484 18201 raft_consensus.cc:2955] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.922746 17599 raft_consensus.cc:2955] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.931792 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b44f8d5d5454fb7af9630783cd02def with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:02.935981 17594 consensus_queue.cc:237] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:02.941620 17595 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:02.950330 18198 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:02.952423 18465 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:02.958623 17529 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:02.963588 18371 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:02.969568 17451 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:02.969511 18456 raft_consensus.cc:2955] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.972922 18198 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:02.973461 18464 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:02.982589 18371 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:02.973255 18201 raft_consensus.cc:2955] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.985002 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 37ab58b1d58a45d9ba339018260d1ee4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:02.986148 17529 raft_consensus.cc:2955] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:02.990561 17352 catalog_manager.cc:5697] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:03.003422 18371 raft_consensus.cc:2955] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:03.008497 17451 raft_consensus.cc:2955] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:03.014559 17521 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:03.015828 17349 catalog_manager.cc:5697] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.016995 17436 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b44f8d5d5454fb7af9630783cd02def with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55872
I20260709 13:18:03.028394 17450 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:03.035841 17440 tablet_service.cc:1558] Processing DeleteTablet for tablet 37ab58b1d58a45d9ba339018260d1ee4 with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55872
I20260709 13:18:03.039310 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dcd29f6044f6485580736010a0122d2b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:03.040935 18418 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:03.050544 18198 raft_consensus.cc:2955] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:03.048941 17350 catalog_manager.cc:5697] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:03.059803 18201 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:03.061190 18443 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:03.075407 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet dcd29f6044f6485580736010a0122d2b with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54542
I20260709 13:18:03.074864 18443 raft_consensus.cc:2955] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:03.095932 18198 raft_consensus.cc:2955] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:03.099978 17450 raft_consensus.cc:2955] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:03.105090 18468 tablet_replica.cc:333] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:18:03.103927 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 12ca126b355348958188e14e8b1c7470 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:03.102898 18469 tablet_replica.cc:333] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:18:03.113509 18469 raft_consensus.cc:2243] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.115922 18469 raft_consensus.cc:2272] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.120582 18469 ts_tablet_manager.cc:1916] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:03.133466 17350 catalog_manager.cc:5697] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:03.144520 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet 12ca126b355348958188e14e8b1c7470 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49550
I20260709 13:18:03.146504 18469 ts_tablet_manager.cc:1929] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:03.147259 18469 log.cc:1199] T dcd29f6044f6485580736010a0122d2b P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/dcd29f6044f6485580736010a0122d2b
I20260709 13:18:03.163497 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet dcd29f6044f6485580736010a0122d2b (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:18:03.163856 18470 tablet_replica.cc:333] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:18:03.165035 18470 raft_consensus.cc:2243] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.165817 18470 raft_consensus.cc:2272] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.169443 18470 ts_tablet_manager.cc:1916] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:03.175593 18468 raft_consensus.cc:2243] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.176457 18468 raft_consensus.cc:2272] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.179638 18468 ts_tablet_manager.cc:1916] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:03.187325 18470 ts_tablet_manager.cc:1929] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:03.187851 18470 log.cc:1199] T 12ca126b355348958188e14e8b1c7470 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/12ca126b355348958188e14e8b1c7470
I20260709 13:18:03.189499 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet 12ca126b355348958188e14e8b1c7470 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:18:03.195503 18468 ts_tablet_manager.cc:1929] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:03.195964 18468 log.cc:1199] T 6b44f8d5d5454fb7af9630783cd02def P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/6b44f8d5d5454fb7af9630783cd02def
I20260709 13:18:03.197391 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet 6b44f8d5d5454fb7af9630783cd02def (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:18:03.198179 18468 tablet_replica.cc:333] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:18:03.198983 18468 raft_consensus.cc:2243] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.199517 18468 raft_consensus.cc:2272] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.202553 18468 ts_tablet_manager.cc:1916] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:03.215494 18468 ts_tablet_manager.cc:1929] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:03.215791 18468 log.cc:1199] T 37ab58b1d58a45d9ba339018260d1ee4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/37ab58b1d58a45d9ba339018260d1ee4
I20260709 13:18:03.216943 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet 37ab58b1d58a45d9ba339018260d1ee4 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:18:04.244755 17448 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:04.251957 17529 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:04.253458 18474 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:04.254248 17595 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:04.254530 17420 consensus_peers.cc:597] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 42a91336a4f94e5db0ce4fa334e9bd37. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.256385 18433 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:04.266727 18474 raft_consensus.cc:2955] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.271245 17599 raft_consensus.cc:2955] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.280983 17529 raft_consensus.cc:2955] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.283095 17528 consensus_queue.cc:237] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:04.294804 17348 catalog_manager.cc:5697] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:18:04.297709 17495 consensus_peers.cc:597] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 92cfff7457484bd5b062ad3bc520549e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.300310 17448 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:04.301990 18472 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:04.301476 17595 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:04.305114 18418 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:04.317618 18472 raft_consensus.cc:2955] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.319538 17599 raft_consensus.cc:2955] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.342188 17448 consensus_queue.cc:237] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:04.343298 17451 raft_consensus.cc:2955] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:18:04.351229 17420 consensus_peers.cc:597] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a372191e02cc468bbc747310e2818f07. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.352032 17529 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:04.353358 18477 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:04.353834 17594 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:04.368010 18430 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:04.373221 17348 catalog_manager.cc:5697] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.391520 18477 raft_consensus.cc:2955] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.394232 17529 raft_consensus.cc:2955] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.395629 17594 raft_consensus.cc:2955] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.409732 17599 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:04.417148 17529 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:04.413201 17352 catalog_manager.cc:5697] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.419057 18464 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:04.421391 17451 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:04.422921 18471 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:04.423903 17569 consensus_peers.cc:597] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 262981f7c32f49709e3a56b85e75ffcf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.433142 18471 raft_consensus.cc:2955] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.437686 17451 raft_consensus.cc:2955] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.450227 17529 raft_consensus.cc:2955] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.458446 17348 catalog_manager.cc:5697] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:04.798848 18491 ts_tablet_manager.cc:933] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
I20260709 13:18:04.799609 18492 ts_tablet_manager.cc:933] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
I20260709 13:18:04.808400 18491 tablet_copy_client.cc:323] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.65:36303
I20260709 13:18:04.811375 17463 tablet_copy_service.cc:140] P 0480cf54c3cc424ab94b963ef2ff5bf4: Received BeginTabletCopySession request for tablet 42a91336a4f94e5db0ce4fa334e9bd37 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:47864)
I20260709 13:18:04.812131 17463 tablet_copy_service.cc:161] P 0480cf54c3cc424ab94b963ef2ff5bf4: Beginning new tablet copy session on tablet 42a91336a4f94e5db0ce4fa334e9bd37 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:47864: session id = 2158c0f750fd4b21afe24135c52167b2-42a91336a4f94e5db0ce4fa334e9bd37
I20260709 13:18:04.816443 18492 tablet_copy_client.cc:323] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.65:36303
I20260709 13:18:04.818784 18495 ts_tablet_manager.cc:933] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:04.818971 17464 tablet_copy_service.cc:140] P 0480cf54c3cc424ab94b963ef2ff5bf4: Received BeginTabletCopySession request for tablet a372191e02cc468bbc747310e2818f07 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:47864)
I20260709 13:18:04.819546 17464 tablet_copy_service.cc:161] P 0480cf54c3cc424ab94b963ef2ff5bf4: Beginning new tablet copy session on tablet a372191e02cc468bbc747310e2818f07 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:47864: session id = 2158c0f750fd4b21afe24135c52167b2-a372191e02cc468bbc747310e2818f07
I20260709 13:18:04.823071 17463 tablet_copy_source_session.cc:215] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:04.831827 17464 tablet_copy_source_session.cc:215] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:04.835125 18492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a372191e02cc468bbc747310e2818f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.858137 18492 tablet_copy_client.cc:806] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:04.858752 18492 tablet_copy_client.cc:670] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:04.863981 18492 tablet_copy_client.cc:538] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:04.867091 18491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a91336a4f94e5db0ce4fa334e9bd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.885299 18492 tablet_bootstrap.cc:492] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:18:04.893064 18491 tablet_copy_client.cc:806] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:04.893143 18495 tablet_copy_client.cc:323] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:18:04.893713 18491 tablet_copy_client.cc:670] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:04.895211 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet 262981f7c32f49709e3a56b85e75ffcf from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:18:04.895787 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet 262981f7c32f49709e3a56b85e75ffcf from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-262981f7c32f49709e3a56b85e75ffcf
I20260709 13:18:04.898353 18491 tablet_copy_client.cc:538] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:04.914757 18491 tablet_bootstrap.cc:492] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:18:04.917423 18498 ts_tablet_manager.cc:933] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:04.922268 17613 tablet_copy_source_session.cc:215] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:04.924257 18498 tablet_copy_client.cc:323] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:18:04.926066 18495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262981f7c32f49709e3a56b85e75ffcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.932745 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet 92cfff7457484bd5b062ad3bc520549e from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:18:04.933338 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet 92cfff7457484bd5b062ad3bc520549e from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-92cfff7457484bd5b062ad3bc520549e
I20260709 13:18:04.935842 18492 tablet_bootstrap.cc:492] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:04.937079 18492 tablet_bootstrap.cc:492] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:18:04.937971 18492 ts_tablet_manager.cc:1403] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.053s	user 0.025s	sys 0.007s
I20260709 13:18:04.942162 18492 raft_consensus.cc:359] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:04.943001 18492 raft_consensus.cc:740] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:18:04.943652 18492 consensus_queue.cc:260] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:04.965390 18492 ts_tablet_manager.cc:1434] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.008s
I20260709 13:18:04.968292 17463 tablet_copy_service.cc:342] P 0480cf54c3cc424ab94b963ef2ff5bf4: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-a372191e02cc468bbc747310e2818f07 received from {username='slave'} at 127.0.0.1:47864
I20260709 13:18:04.968806 17463 tablet_copy_service.cc:434] P 0480cf54c3cc424ab94b963ef2ff5bf4: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-a372191e02cc468bbc747310e2818f07 on tablet a372191e02cc468bbc747310e2818f07 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:04.979092 17539 tablet_copy_source_session.cc:215] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:04.982743 18498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cfff7457484bd5b062ad3bc520549e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.996836 18495 tablet_copy_client.cc:806] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:04.997409 18495 tablet_copy_client.cc:670] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:05.001040 18498 tablet_copy_client.cc:806] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:05.001686 18498 tablet_copy_client.cc:670] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:05.003261 18491 tablet_bootstrap.cc:492] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:05.004364 18491 tablet_bootstrap.cc:492] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:18:05.005157 18491 ts_tablet_manager.cc:1403] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.091s	user 0.025s	sys 0.017s
I20260709 13:18:05.008972 18498 tablet_copy_client.cc:538] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:05.008781 18491 raft_consensus.cc:359] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:05.009864 18491 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:18:05.012734 18495 tablet_copy_client.cc:538] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:05.010671 18491 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:05.026803 18495 tablet_bootstrap.cc:492] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:18:05.026803 18498 tablet_bootstrap.cc:492] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:18:05.038136 18491 ts_tablet_manager.cc:1434] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 13:18:05.041694 17463 tablet_copy_service.cc:342] P 0480cf54c3cc424ab94b963ef2ff5bf4: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-42a91336a4f94e5db0ce4fa334e9bd37 received from {username='slave'} at 127.0.0.1:47864
I20260709 13:18:05.042224 17463 tablet_copy_service.cc:434] P 0480cf54c3cc424ab94b963ef2ff5bf4: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-42a91336a4f94e5db0ce4fa334e9bd37 on tablet 42a91336a4f94e5db0ce4fa334e9bd37 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:05.062690 18498 tablet_bootstrap.cc:492] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:05.063782 18498 tablet_bootstrap.cc:492] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:18:05.064613 18498 ts_tablet_manager.cc:1403] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.011s
I20260709 13:18:05.070830 18498 raft_consensus.cc:359] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:05.071702 18498 raft_consensus.cc:740] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:18:05.072499 18498 consensus_queue.cc:260] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:05.075160 18498 ts_tablet_manager.cc:1434] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:18:05.077210 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-92cfff7457484bd5b062ad3bc520549e received from {username='slave'} at 127.0.0.1:35586
I20260709 13:18:05.077803 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-92cfff7457484bd5b062ad3bc520549e on tablet 92cfff7457484bd5b062ad3bc520549e with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:05.082202 18495 tablet_bootstrap.cc:492] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:05.083583 18495 tablet_bootstrap.cc:492] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:18:05.084277 18495 ts_tablet_manager.cc:1403] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.058s	user 0.028s	sys 0.010s
I20260709 13:18:05.087311 18495 raft_consensus.cc:359] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:05.088121 18495 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:18:05.088708 18495 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:05.091593 18495 ts_tablet_manager.cc:1434] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:05.093961 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-262981f7c32f49709e3a56b85e75ffcf received from {username='slave'} at 127.0.0.1:52572
I20260709 13:18:05.094430 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-262981f7c32f49709e3a56b85e75ffcf on tablet 262981f7c32f49709e3a56b85e75ffcf with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:05.223842 18201 raft_consensus.cc:1217] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:05.346747 18198 raft_consensus.cc:1217] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:05.375976 18198 raft_consensus.cc:1217] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:05.394860 18198 raft_consensus.cc:1217] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:05.670126 18477 raft_consensus.cc:1064] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:05.672125 18477 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:05.683096 18198 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:05.684062 17599 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:05.685199 18505 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:05.686641 18430 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:05.698215 18430 raft_consensus.cc:2955] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:05.700340 17599 raft_consensus.cc:2955] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:05.702602 17528 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:05.704052 18504 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:05.712723 17528 raft_consensus.cc:2955] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:05.749368 17350 catalog_manager.cc:5697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.750064 18198 raft_consensus.cc:2955] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:05.757121 18443 raft_consensus.cc:1064] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:05.761600 18443 consensus_queue.cc:237] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:05.789588 17594 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:05.793493 18418 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:05.795068 18198 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:05.803258 18514 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:05.804613 17451 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:05.820230 18514 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:05.862134 18464 raft_consensus.cc:1064] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:05.873848 18464 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:05.875965 18418 raft_consensus.cc:2955] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:05.885960 17528 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:05.886946 18198 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:05.887508 18506 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:05.888497 18521 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:05.910477 17450 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:05.921805 18506 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:05.907469 17451 raft_consensus.cc:2955] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:05.927728 18201 raft_consensus.cc:2955] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:05.936357 18371 raft_consensus.cc:2955] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:05.950079 17528 raft_consensus.cc:2955] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:05.952127 17447 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:05.962478 18200 raft_consensus.cc:2955] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:05.968796 17594 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:05.970227 18477 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:05.980273 18201 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:05.982875 17350 catalog_manager.cc:5697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:05.984189 18477 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:05.988754 17351 catalog_manager.cc:5697] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.989616 17595 raft_consensus.cc:2955] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.006821 18477 raft_consensus.cc:1064] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:06.007877 18474 raft_consensus.cc:2955] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.013051 17521 consensus_queue.cc:237] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:06.018535 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 42a91336a4f94e5db0ce4fa334e9bd37 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:06.009346 18477 consensus_queue.cc:237] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:06.026362 18200 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:06.028409 18201 raft_consensus.cc:2955] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.036010 17448 raft_consensus.cc:2955] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.041520 17594 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:06.044374 18514 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:06.042663 17595 raft_consensus.cc:2955] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.046670 18418 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:06.052639 17349 catalog_manager.cc:5697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 3 to 4, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.057435 18443 raft_consensus.cc:2955] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.058466 17594 raft_consensus.cc:2955] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.066254 18200 raft_consensus.cc:2955] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.073271 18198 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:06.075295 18477 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:06.076172 17521 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:06.084589 18430 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:06.098331 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet 42a91336a4f94e5db0ce4fa334e9bd37 with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54542
I20260709 13:18:06.098912 17595 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:06.102571 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 92cfff7457484bd5b062ad3bc520549e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:06.108518 17350 catalog_manager.cc:5697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 1 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.114598 18505 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:06.121483 18528 tablet_replica.cc:333] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:18:06.122860 18528 raft_consensus.cc:2243] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.123644 18528 raft_consensus.cc:2272] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.124909 17436 tablet_service.cc:1558] Processing DeleteTablet for tablet 92cfff7457484bd5b062ad3bc520549e with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55872
I20260709 13:18:06.140830 18528 ts_tablet_manager.cc:1916] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:06.146806 18477 raft_consensus.cc:2955] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.151876 17594 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:06.161259 17529 raft_consensus.cc:2955] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.167423 18201 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:06.170729 17528 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:06.171945 18371 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:06.179082 18371 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:06.190059 18201 raft_consensus.cc:2955] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.197005 17352 catalog_manager.cc:5697] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 2 to 3, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.201413 18371 raft_consensus.cc:2955] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.216105 17528 raft_consensus.cc:2955] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.233557 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 262981f7c32f49709e3a56b85e75ffcf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:06.233235 17451 consensus_queue.cc:237] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:06.244596 17521 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:06.246543 18477 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:06.253746 18430 raft_consensus.cc:2955] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.256969 17350 catalog_manager.cc:5697] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.262044 17521 raft_consensus.cc:2955] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.266637 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a372191e02cc468bbc747310e2818f07 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:06.268275 18528 ts_tablet_manager.cc:1929] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:06.268738 18528 log.cc:1199] T 42a91336a4f94e5db0ce4fa334e9bd37 P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/42a91336a4f94e5db0ce4fa334e9bd37
I20260709 13:18:06.268805 17440 tablet_service.cc:1558] Processing DeleteTablet for tablet 262981f7c32f49709e3a56b85e75ffcf with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55872
I20260709 13:18:06.275209 17352 catalog_manager.cc:5697] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 1 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.278795 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet 42a91336a4f94e5db0ce4fa334e9bd37 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:18:06.281689 18197 raft_consensus.cc:2955] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.298473 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet a372191e02cc468bbc747310e2818f07 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49550
I20260709 13:18:06.309798 18200 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:06.313012 18430 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:06.332031 18534 tablet_replica.cc:333] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:18:06.348213 18534 raft_consensus.cc:2243] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.348981 18534 pending_rounds.cc:70] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e: Trying to abort 1 pending ops.
I20260709 13:18:06.349826 18534 pending_rounds.cc:77] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305638240288313344 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "a372191e02cc468bbc747310e2818f07" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } } }
I20260709 13:18:06.348616 18200 raft_consensus.cc:2955] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:06.351884 18534 raft_consensus.cc:2917] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:18:06.353799 18534 raft_consensus.cc:2889] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:18:06.354365 18534 raft_consensus.cc:2272] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.353243 18530 tablet_replica.cc:333] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:18:06.356151 18530 raft_consensus.cc:2243] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.356756 18530 raft_consensus.cc:2272] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.361725 18530 ts_tablet_manager.cc:1916] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:06.362718 18534 ts_tablet_manager.cc:1916] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:06.498975 18530 ts_tablet_manager.cc:1929] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:06.493711 18534 ts_tablet_manager.cc:1929] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:06.500006 18530 log.cc:1199] T 92cfff7457484bd5b062ad3bc520549e P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/92cfff7457484bd5b062ad3bc520549e
I20260709 13:18:06.500288 18534 log.cc:1199] T a372191e02cc468bbc747310e2818f07 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/a372191e02cc468bbc747310e2818f07
I20260709 13:18:06.503149 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet 92cfff7457484bd5b062ad3bc520549e (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:18:06.503477 18530 tablet_replica.cc:333] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:18:06.504457 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet a372191e02cc468bbc747310e2818f07 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:18:06.524247 18530 raft_consensus.cc:2243] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.526712 18530 raft_consensus.cc:2272] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.531487 18530 ts_tablet_manager.cc:1916] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:06.546182 18530 ts_tablet_manager.cc:1929] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:06.546813 18530 log.cc:1199] T 262981f7c32f49709e3a56b85e75ffcf P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/262981f7c32f49709e3a56b85e75ffcf
I20260709 13:18:06.549453 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet 262981f7c32f49709e3a56b85e75ffcf (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:18:07.505069 17594 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:18:07.522733 17569 consensus_peers.cc:597] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2edee9f2356c4e878f2e11af63e46ab9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:07.682569 18537 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:07.683595 18537 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:07.729223 18537 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:07.877285 18538 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:07.878187 18538 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.006417 18538 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.009327 18538 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:07.885406 18537 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.236533 18537 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.239704 18537 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.241528 18537 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.049594 18540 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.242494 18540 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.245234 18540 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.246999 18540 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.247740 18540 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.250195 18540 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.151690 18544 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.404699 18544 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.407845 18544 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.166577 18546 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.048290 18541 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.408838 18541 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.412216 18541 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.415170 18546 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:08.418936 18546 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:08.260344 18537 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.421591 18537 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.422416 18541 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.423087 18541 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.425565 18541 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.292482 18547 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.426765 18547 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.429862 18547 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.298983 18549 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.432943 18549 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.436151 18549 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.330516 18550 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.437067 18550 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:08.440263 18550 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:08.352612 18551 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.446005 18551 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.448799 18551 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.200178 18542 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.466547 18542 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.255627 18538 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.472034 18538 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.472996 18542 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.295656 18548 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.473969 18548 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.476897 18548 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.368700 18543 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.478098 18543 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.143857 18545 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.482544 18545 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:08.485450 18545 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:08.510007 18544 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.514930 18537 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.518361 18544 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.518370 18537 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:08.510190 18541 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.520394 18540 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.520712 18543 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.520840 18544 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.525098 18538 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.520859 18549 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.525300 18540 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:08.525668 18538 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.525780 18549 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.522506 18537 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:08.527808 18538 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.527951 18540 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:08.527825 18549 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.529543 18541 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.533020 18541 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.534760 18550 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.536276 18555 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.536681 18550 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.536823 18555 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.553172 18547 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.556375 18541 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.557173 18555 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.557585 18547 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.559700 18547 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.560240 18541 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.561088 18549 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.561623 18549 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.562337 18541 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.563463 18549 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.566664 17447 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:08.569978 18550 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.570338 18552 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:08.570921 18552 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.578403 18552 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.858199 18552 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.858870 18552 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.859364 18550 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:08.859946 18550 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:08.861172 18552 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:08.862571 18550 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:09.016755 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe860 after lost signal to thread 16332
W20260709 13:18:09.018193 17550 debug-util.cc:398] Leaking SignalData structure 0x7b0800192ba0 after lost signal to thread 17386
W20260709 13:18:09.020087 17550 debug-util.cc:398] Leaking SignalData structure 0x7b080008c560 after lost signal to thread 17478
I20260709 13:18:09.098343 18557 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.099025 18562 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.098356 18558 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:18:09.100414 17550 debug-util.cc:398] Leaking SignalData structure 0x7b080008f0e0 after lost signal to thread 17479
I20260709 13:18:09.099943 18562 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.098567 18559 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.086634 18371 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.101527 18559 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.102281 18371 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
W20260709 13:18:09.098987 17383 debug-util.cc:398] Leaking SignalData structure 0x7b0800089c80 after lost signal to thread 16332
I20260709 13:18:09.105445 18562 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:09.105607 17383 debug-util.cc:398] Leaking SignalData structure 0x7b08000d07e0 after lost signal to thread 17386
I20260709 13:18:09.094502 18563 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.106314 18563 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:09.107220 17383 debug-util.cc:398] Leaking SignalData structure 0x7b0800332cc0 after lost signal to thread 17478
I20260709 13:18:09.107231 18471 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.108063 18471 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:09.098557 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 2.28716e+06us
I20260709 13:18:09.109504 18563 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.074406 18556 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.116608 18556 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.100034 18558 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.119325 18556 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.119681 18558 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.099355 18557 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:09.098109 17569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.006s
W20260709 13:18:09.120653 17569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.000s	sys 0.007s
I20260709 13:18:09.110924 18562 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.113428 18371 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.121779 18558 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.122392 18371 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.122347 18558 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.122887 18371 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.124351 18558 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.124503 18371 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.124853 18558 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.125335 18562 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.121779 18557 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.119689 18561 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.126868 18561 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.124933 18371 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.125340 18558 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:09.114240 17566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.012s	sys 0.025s
I20260709 13:18:09.115808 18560 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.127728 18562 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.130842 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.145635 18561 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.146164 17451 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:09.146194 18561 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.146492 18506 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.146916 18561 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.147951 18557 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.131312 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 652) took 1636 ms. Trace:
I20260709 13:18:09.148710 18557 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.149168 18561 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.149083 17595 rpcz_store.cc:276] 0709 13:18:07.494652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.130388 (+1635736us) service_pool.cc:224] Handling call
0709 13:18:09.130648 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.130831 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.130854 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:09.130894 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:09.130937 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.131000 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.131127 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:09.150686 18557 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:09.142959 17566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.013s	sys 0.025s
I20260709 13:18:09.151214 18557 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.151639 18557 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.133551 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.152837 18521 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.153097 17450 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:09.153506 18521 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.155639 18521 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:09.156113 18521 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.156733 18556 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.156584 18521 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.157260 18556 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.159363 18556 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.159708 18443 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.159811 18556 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.160261 18443 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.160386 18556 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.161056 18516 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.161334 18371 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:09.163997 17550 debug-util.cc:398] Leaking SignalData structure 0x7b080016ea60 after lost signal to thread 17553
W20260709 13:18:09.165302 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08001f80c0 after lost signal to thread 17627
I20260709 13:18:09.130362 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.134855 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.133088 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.134181 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.175333 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 656) took 1651 ms. Trace:
I20260709 13:18:09.180728 18471 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:09.181627 17550 debug-util.cc:398] Leaking SignalData structure 0x7b080032a220 after lost signal to thread 18225
W20260709 13:18:09.188756 17383 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8ae0 after lost signal to thread 17553
I20260709 13:18:09.161617 18516 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:09.190182 17383 debug-util.cc:398] Leaking SignalData structure 0x7b080027c340 after lost signal to thread 17627
W20260709 13:18:09.190574 17383 debug-util.cc:398] Leaking SignalData structure 0x7b08000ebf40 after lost signal to thread 17628
W20260709 13:18:09.199158 17383 debug-util.cc:398] Leaking SignalData structure 0x7b080029b220 after lost signal to thread 18225
W20260709 13:18:09.199631 17383 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5bc0 after lost signal to thread 18226
W20260709 13:18:09.207412 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 97875.1us
I20260709 13:18:09.214162 18443 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.214854 18471 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.215291 18371 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:09.214964 18565 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.147012 18506 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.216257 18516 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:09.216485 18565 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.216938 17448 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:09.217109 18561 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.217690 18561 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.218338 17447 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:09.218492 18506 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.097015 18564 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.219470 18564 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.220973 18521 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.215811 18371 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.221483 18564 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.222136 18564 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.222575 18561 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.221953 18371 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.225070 18371 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.227931 18559 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:09.229256 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.230480 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.176059 17598 rpcz_store.cc:276] 0709 13:18:07.498258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.148387 (+1650129us) service_pool.cc:224] Handling call
0709 13:18:09.149038 (+   651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.149225 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.149251 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:09.149482 (+   231us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:09.149538 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.149623 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.149850 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:09.232652 18557 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.233222 18566 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.233251 18561 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.234067 18566 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.234848 18561 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.237007 18561 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.233372 18521 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.237917 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.240253 18521 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.229254 17446 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:09.221051 17350 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40508 (request call id 177) took 1724 ms. Trace:
I20260709 13:18:09.244462 17350 rpcz_store.cc:276] 0709 13:18:07.496981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.497126 (+   145us) service_pool.cc:224] Handling call
0709 13:18:09.220850 (+1723724us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260709 13:18:09.246083 18562 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.215590 18471 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.246698 18562 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.249032 18471 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.249225 18562 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.249917 18562 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.145388 18558 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.250355 18566 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.142835 18560 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.242884 18521 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.252072 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 653) took 1757 ms. Trace:
I20260709 13:18:09.252527 17600 rpcz_store.cc:276] 0709 13:18:07.494898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.234128 (+1739230us) service_pool.cc:224] Handling call
0709 13:18:09.234444 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.244262 (+  9818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.244295 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:09.244354 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:09.244388 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.246559 (+  2171us) spinlock_profiling.cc:243] Waited 9.54 ms on lock 0x7b5400327b54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:09.246592 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.251879 (+  5287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21947136}
I20260709 13:18:09.252919 18560 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.256283 18556 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.254153 18563 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.260074 18563 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.262686 18563 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.263080 18562 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.267488 18565 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.268537 18514 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.269292 18443 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.269721 18514 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.272627 18514 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.268738 18516 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.222631 18564 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.274742 18516 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.276872 18564 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.277392 18516 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.269927 18443 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.280095 18443 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.282140 18562 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:09.295226 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 78550.7us
I20260709 13:18:09.296541 18516 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.307264 18516 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.315097 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.308914 18564 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.315896 18564 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.316052 18569 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.316511 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.317148 18569 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.320407 18418 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.320844 18564 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.321141 18418 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.326296 18443 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.324307 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.298991 18571 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.310322 18562 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.327346 18418 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.336103 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.311650 18573 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.322609 18521 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.324899 18572 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.341921 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.346202 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.339316 18443 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.348238 18568 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.355962 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.355304 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.357812 18418 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.333037 18506 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.334865 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.360940 18371 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.355103 18521 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.334158 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.362869 18371 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.366411 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.366357 18418 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.358608 18516 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.373005 18443 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.373107 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.356199 18569 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.359946 18568 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.358790 18576 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.351154 18562 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.362426 18561 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.378702 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.378916 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.360095 18573 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.380744 18418 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.381985 18443 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.382283 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.382545 18443 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.384475 18418 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.338953 18571 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.381336 18474 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.383038 18198 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:09.373772 18574 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.392949 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.393611 18201 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:09.371829 18506 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.394853 18371 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.393652 18571 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.386794 18418 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.382140 18576 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.377209 18516 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.400151 18521 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.404409 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.358590 18572 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.402932 18516 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.407037 18201 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:09.386174 18474 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.418838 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.419337 18443 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.413548 18562 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.414461 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.394358 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.424078 18418 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:09.425014 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.427053 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:09.428251 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:09.428259 18430 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.427002 18474 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.429292 18430 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.429682 18430 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.429817 18477 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.430413 18477 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.430858 18477 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.435631 18576 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:09.436965 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.381469 18561 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.438362 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.439756 18561 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.439867 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.440760 17599 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 1.
I20260709 13:18:09.440779 18196 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:09.404556 18574 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.448235 18573 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:09.449689 18574 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:09.452493 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 91216.2us
I20260709 13:18:09.455415 18572 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.455762 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.457154 18516 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.458544 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.459708 18570 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.459785 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.460722 17599 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 1.
I20260709 13:18:09.462060 18430 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.464257 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:09.466557 18430 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:09.467628 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.468007 18557 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.468542 18557 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.469022 18557 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.461246 18568 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:09.463480 18371 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:18:09.471792 18477 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.457753 18506 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:09.460311 18570 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.473544 17569 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:09.475136 18477 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:09.475626 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 121504us
I20260709 13:18:09.453588 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.476930 18574 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.477586 18167 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:09.477973 18574 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.479323 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:09.480161 18562 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.480537 18562 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.480887 18562 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.482975 18572 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.483693 18572 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.483127 18569 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.484163 18572 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:09.486235 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 57018.5us
I20260709 13:18:09.481585 18574 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.478176 18573 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.482743 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:09.489177 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:09.489344 17569 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:09.490471 18581 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.490727 18576 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.493129 18418 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.484663 18569 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.492966 17569 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:09.488351 18573 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.494199 18418 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.491528 18578 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.494979 18579 ts_tablet_manager.cc:933] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.483879 18570 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.498294 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.492604 18561 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.504076 18561 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.504503 18561 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.497289 18573 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.498131 18506 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.503685 18418 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.491882 18576 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.506801 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:09.497515 18516 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.508122 18569 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.491493 18581 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.511166 18477 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.508796 18474 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:09.498996 18574 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.510756 18516 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.517562 18580 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.512344 18477 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.519495 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.519866 18477 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.508883 18506 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.509904 18535 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.512076 18474 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.528066 18418 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.528855 18418 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.526247 18474 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.524003 18506 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.541460 18575 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.518222 18580 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.499148 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:09.508903 18578 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.532070 18516 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.516726 18574 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.561503 18477 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.564320 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.542186 18575 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.546422 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:09.543579 18570 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.576385 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.577785 17600 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:09.579191 18576 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.562987 18569 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:09.579766 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.569324 18571 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:09.583580 18443 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.585502 18578 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:09.577459 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 82035.2us
I20260709 13:18:09.585723 18443 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.579459 18582 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.586917 18582 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:09.587350 18582 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.587852 18443 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.577651 18195 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.592666 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.595569 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.555938 18535 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.581876 18575 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:09.590286 18569 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.599888 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.597357 18578 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.603586 18418 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.605227 18477 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:09.605443 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.607290 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.583246 18572 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.611168 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.613077 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.613705 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.582252 18570 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.615100 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.617434 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.586944 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:09.618902 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.595755 18562 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.623008 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.615554 18535 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.624507 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:09.624840 18562 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.625670 18564 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:09.609036 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.620558 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.627090 17603 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:09.622002 18569 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.607070 18557 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.620887 17602 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:09.602344 18578 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.616050 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:09.618741 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.628548 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.797046 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.725538 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.686923 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.799554 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.733029 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:09.800645 18569 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:09.800904 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:09.801514 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 68605.2us
I20260709 13:18:09.802282 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:09.802983 18569 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:09.803079 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.804471 18580 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.806231 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.806196 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.808627 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.733633 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.688985 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.810314 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.811523 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.811568 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.812703 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.812841 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.724995 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.813654 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.702534 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.815631 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.707749 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.632449 18201 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:09.662145 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.672574 18579 tablet_copy_client.cc:323] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:18:09.841938 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.625964 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:09.836127 17528 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 1.
I20260709 13:18:09.843443 18564 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:09.666316 18581 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:09.844666 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 218762us
I20260709 13:18:09.845839 18166 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:09.841393 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.818673 18506 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.846791 18564 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.847236 18564 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.847679 18564 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.841425 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.849483 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.734972 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.833492 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.853266 17599 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:09.851141 18474 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:09.854961 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.856776 18474 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:09.856961 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.854053 17529 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:09.865911 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.866568 17528 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:09.866986 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.680959 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.782238 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.873829 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.677546 18572 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.732023 18195 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:09.706239 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.707634 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.876235 18562 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:09.837798 18578 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:09.835661 18582 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.877878 17594 raft_consensus.cc:1240] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:09.815557 18196 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.681667 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.874377 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.816797 18574 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.877009 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:09.702171 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.734434 18570 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:09.874614 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.880455 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.882107 18166 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:09.788764 18573 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:09.882635 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.882637 17603 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:09.883072 17524 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:09.883172 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.883823 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.893780 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.894917 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.884641 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:09.877408 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.887333 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.889743 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:09.850414 18197 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
W20260709 13:18:09.890867 17492 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54544 dropped due to backpressure: service queue is full with 50 items
I20260709 13:18:09.895933 17599 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.897265 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.898175 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.899446 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.899987 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.896888 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet 2edee9f2356c4e878f2e11af63e46ab9 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:18:09.901700 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.901897 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:09.901963 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet 2edee9f2356c4e878f2e11af63e46ab9 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-2edee9f2356c4e878f2e11af63e46ab9
I20260709 13:18:09.903360 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.903390 18201 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:09.900599 17449 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:09.904975 17598 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:09.905504 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.903120 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.907073 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.907238 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.907766 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.908325 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.908401 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.908834 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.909509 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.909744 17597 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:09.909840 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.909488 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.911907 17526 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:09.912128 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:09.913233 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.897939 18562 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:09.914438 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.915728 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.916289 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.913233 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.918406 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.911024 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.919775 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.920718 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.919064 17598 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 1.
I20260709 13:18:09.923694 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:09.924187 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.925192 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.898749 17492 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54544 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 14)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1087)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 20)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1088)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1083)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1080)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 737)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 17)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 755)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1082)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1077)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1084)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 18)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 754)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1065)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1066)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1067)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1068)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1069)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1070)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1071)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1072)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1073)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1074)
I20260709 13:18:09.938262 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.083194 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.004490 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.047633 18430 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:09.967901 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.959858 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.085193 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.028944 17599 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:10.086887 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.088845 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.089764 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.087811 17603 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:10.091284 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.091869 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:10.092360 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.947606 18201 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:09.945004 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:10.093837 18430 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.094527 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:10.095268 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.095160 18570 consensus_queue.cc:1059] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:09.926445 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.934598 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.096575 18430 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.097237 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:09.927465 18166 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:10.101120 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 178208us
I20260709 13:18:10.098248 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.098897 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:09.941672 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.093477 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.949489 17613 tablet_copy_source_session.cc:215] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:18:10.106762 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 179424us
I20260709 13:18:10.107071 18578 raft_consensus.cc:3055] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.107506 18578 raft_consensus.cc:740] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:10.107687 18166 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.107924 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.107103 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.108685 17454 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:10.108562 18578 consensus_queue.cc:260] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:10.109534 18562 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.095748 18569 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.110240 18569 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:10.099722 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.100638 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:09.945845 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:10.105643 17419 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:10.104166 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.113296 18430 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.113499 17419 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:10.113698 18430 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:10.114169 18430 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.104607 17448 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:10.103477 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.110327 18562 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:09.947304 18564 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:10.110771 18569 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.118180 17527 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:09.940644 18561 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:09.925580 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.120040 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.128165 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.128793 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:10.129619 17419 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54544 dropped due to backpressure: service queue is full with 50 items [suppressed 1 similar messages]
I20260709 13:18:10.111629 18578 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.111649 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.123821 18589 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.133342 18200 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.133304 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.133890 17598 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.135963 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.136175 17595 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.139011 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.119481 17452 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:10.140597 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.131088 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.141976 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.132635 18573 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:10.146381 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.144588 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.144902 17601 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.134584 18589 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:10.149900 18589 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.151997 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.152381 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.134249 18506 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:10.144416 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.147091 17448 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:10.155202 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.130636 18166 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.162247 18562 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.162528 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.163724 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.164139 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.165488 18562 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.166332 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.168200 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.169376 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.170488 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:10.171015 18564 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.172179 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.173565 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:10.175432 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.176931 18166 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.177939 18564 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.178272 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.180032 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:10.181516 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.178535 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.181880 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.185379 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.190189 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.185817 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:10.188659 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.203245 17454 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:10.205497 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.206282 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:10.206745 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.207362 18569 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:10.182160 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.208345 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.209355 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.212486 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.201064 17522 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.215415 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:10.216581 17602 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:10.211580 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 81982.7us
I20260709 13:18:10.219198 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.222877 17419 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:10.222309 18430 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.223623 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.224491 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.208671 17525 raft_consensus.cc:2393] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:10.225747 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:10.225807 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.209916 18589 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.228444 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.229143 17453 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:10.207995 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.254211 17529 raft_consensus.cc:1240] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.232668 17495 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:10.233816 18477 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.234427 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:10.234758 17445 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.215940 18574 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.236502 18589 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.237366 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.237762 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.238395 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.238466 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.239758 18474 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:10.240200 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:10.241291 18557 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:10.241675 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.184412 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.242677 18582 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:10.244701 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.245600 18196 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:10.209442 18569 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:10.245802 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.246521 18167 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:10.247865 18430 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.247908 18570 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.248844 18166 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.240200 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.251191 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:10.253005 17448 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.253222 17527 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:10.253954 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.254983 18477 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:10.292086 17449 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:10.292297 18477 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.293069 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.276994 18580 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:10.294092 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45343.6us
I20260709 13:18:10.294514 18580 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:10.294813 18562 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.294978 18580 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.255580 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:10.296684 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:10.233124 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:10.275315 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.284411 18198 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.285122 17419 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:10.293248 18564 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.180048 18561 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:10.298448 18430 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.301796 18430 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:10.302189 18430 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.303000 18477 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.303938 17447 raft_consensus.cc:1240] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.306299 18477 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.299358 18574 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:10.293097 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 46668.8us
I20260709 13:18:10.283599 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:10.307600 18167 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.308789 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.309724 18562 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.310357 18572 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:10.310737 18562 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.299998 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:10.310896 18572 raft_consensus.cc:697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:10.311672 18574 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.311745 18564 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:10.301225 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.312032 18572 consensus_queue.cc:237] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:10.300383 18569 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.312183 18574 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:10.313627 18574 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.312343 18564 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.313165 18569 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:10.314878 17419 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:10.320962 18477 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.316419 17495 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.321859 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.321440 18477 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:10.322940 18477 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.322986 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:10.323731 18430 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.327044 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.278343 18474 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:10.328513 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 53188.3us
I20260709 13:18:10.329691 18418 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.330238 18418 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:10.330663 18418 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.326217 18570 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.321972 18569 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.334604 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.334580 18371 consensus_queue.cc:1059] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:10.327929 18166 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.347990 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.344152 17522 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:10.340134 18570 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.347047 18371 consensus_queue.cc:1059] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:10.355022 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.355763 18430 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.360486 18574 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.361330 18477 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.362138 18582 raft_consensus.cc:3055] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.362449 18577 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.363123 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:10.363692 17525 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:10.364692 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45476.9us
I20260709 13:18:10.362536 18582 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:10.371981 17449 raft_consensus.cc:1240] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.373099 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:10.373711 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:10.373028 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:10.377092 18580 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.378103 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.378818 17445 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.378157 18562 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.370242 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:10.379941 17448 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:10.380354 17454 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.381057 17451 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.381649 17452 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.372898 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:10.386642 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.347702 18506 consensus_queue.cc:1059] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:18:10.388644 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:10.346463 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:10.391146 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:10.392484 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.346612 18474 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.394088 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:10.395273 18166 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:10.396238 18562 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:10.396714 18562 raft_consensus.cc:697] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:10.396586 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:10.397692 18562 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:10.398662 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:10.400151 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:10.363196 18477 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.403816 18418 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.407219 18582 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:10.408444 18582 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.408890 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:10.410540 18595 raft_consensus.cc:3055] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.410944 18595 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:10.411777 18595 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:10.413009 18595 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.414983 17529 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:10.417096 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 62169.5us
I20260709 13:18:10.416706 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:10.417836 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.424144 17420 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.425958 18430 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.430752 18418 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.428887 17569 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:10.432029 18573 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.432572 18573 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:10.433068 18573 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.442111 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.443225 18602 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.420189 18581 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.420485 18570 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.425375 18590 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.450156 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:10.451922 18418 consensus_queue.cc:1059] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:18:10.427275 18557 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.474622 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:10.467530 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45676.2us
I20260709 13:18:10.425185 18569 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.480010 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:10.448132 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 139396us
I20260709 13:18:10.460130 18590 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:18:10.488201 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 53976.9us
I20260709 13:18:10.480114 18578 raft_consensus.cc:3055] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.485005 18574 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.513222 18561 raft_consensus.cc:3055] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.513638 18561 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:10.514539 18561 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:10.515321 18579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2edee9f2356c4e878f2e11af63e46ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:10.490974 18590 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.463246 18603 consensus_queue.cc:1059] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:18:10.522573 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:10.508922 18578 raft_consensus.cc:740] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:10.515856 18561 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.533792 18602 raft_consensus.cc:3055] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.523146 18569 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.523645 18564 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:10.526917 18573 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.511371 18580 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.534524 18477 consensus_queue.cc:1059] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:10.538383 18584 raft_consensus.cc:3055] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.538558 18564 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.534188 18602 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:10.538816 18584 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:10.539633 18602 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.539676 18584 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.541009 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:10.544546 18573 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:10.541146 18602 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.546749 17350 catalog_manager.cc:5697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 1 to 2, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 2 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.549772 17350 catalog_manager.cc:5697] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 1 to 2, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 2 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:10.555593 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 104098us
I20260709 13:18:10.556416 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.557412 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.558107 18581 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.565661 18580 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.570300 18578 consensus_queue.cc:260] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.571583 18578 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.572511 18590 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.575639 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.577103 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.577566 18580 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.578222 18418 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.579766 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.581118 18418 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:10.582094 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 93077us
I20260709 13:18:10.582681 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.583364 18418 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.584818 18506 consensus_queue.cc:1059] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:10.582890 18590 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:10.585536 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.586973 18418 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.587687 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.591454 18418 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.587973 18590 raft_consensus.cc:3055] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.595872 18590 raft_consensus.cc:740] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:10.596721 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.596827 18590 consensus_queue.cc:260] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.597715 18418 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.598152 18590 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.601661 18579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42548 (request call id 162) took 1293 ms. Trace:
I20260709 13:18:10.602510 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.602202 18579 rpcz_store.cc:276] 0709 13:18:09.308376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.323069 (+ 14693us) service_pool.cc:224] Handling call
0709 13:18:09.506211 (+183142us) ts_tablet_manager.cc:934] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
0709 13:18:10.513662 (+1007451us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:10.592145 (+ 78483us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:10.592271 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:10.600865 (+  8594us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:10.601185 (+   320us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:10.601515 (+   330us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:10.601579 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":62401,"tablet-copy.queue_time_us":117687,"thread_start_us":82475,"threads_started":2}
I20260709 13:18:10.607038 18580 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:10.608686 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 140954us
I20260709 13:18:10.609310 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.609906 18430 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.610184 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.612128 18580 consensus_queue.cc:1059] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:18:10.613093 17420 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.615595 18477 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.614615 18584 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.617445 17420 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.614459 18595 consensus_queue.cc:1059] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:18:10.619776 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 88105.1us
I20260709 13:18:10.619197 18580 consensus_queue.cc:1059] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:10.620477 18595 consensus_queue.cc:1059] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:10.626416 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:10.623857 18601 raft_consensus.cc:2955] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:10.627068 17452 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.613262 18506 consensus_queue.cc:1059] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:18:10.614106 18474 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.627673 18474 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:10.618002 18561 consensus_queue.cc:1059] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:18:10.623314 18582 raft_consensus.cc:3055] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:10.628072 18474 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.630280 18582 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:10.629848 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.632169 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:10.632755 17446 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.631712 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.620275 18606 consensus_queue.cc:1059] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:10.635627 18582 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:10.630692 18592 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.648042 18582 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.636644 18578 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.621243 18607 consensus_queue.cc:1059] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:18:10.661126 18607 raft_consensus.cc:3055] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.638676 18506 raft_consensus.cc:3055] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.664036 18506 raft_consensus.cc:740] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:10.639798 17450 raft_consensus.cc:2955] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:10.638893 18557 raft_consensus.cc:3055] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.665274 18557 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:10.621588 18579 tablet_copy_client.cc:806] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:10.642190 18594 raft_consensus.cc:3055] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.658967 18602 raft_consensus.cc:3055] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.659720 17446 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:10.666440 18602 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:10.666200 18557 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.667502 18557 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.667719 18602 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:10.665092 17452 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:10.669111 18602 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.635845 18605 raft_consensus.cc:3055] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.637806 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.641310 18474 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.654152 18608 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.637181 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.641449 18581 raft_consensus.cc:3055] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.666249 18594 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:10.683651 18581 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:10.666234 18579 tablet_copy_client.cc:670] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:10.684438 18594 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.684602 18581 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.685081 18474 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:10.686730 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 49644.1us
W20260709 13:18:10.682312 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46004.2us
I20260709 13:18:10.687037 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:10.685678 18594 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.683246 18592 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.703451 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:10.665117 18506 consensus_queue.cc:260] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.704315 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:10.704658 18506 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.704741 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:10.688360 18578 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.693791 17568 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:10.687734 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 49994.4us
I20260709 13:18:10.702791 18194 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.703634 18592 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:10.670135 18607 raft_consensus.cc:740] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:10.681406 18605 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:10.708333 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:10.709688 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 72783.9us
I20260709 13:18:10.703804 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:10.712050 18592 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.706321 18581 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.737097 17420 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:10.737649 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 43948.2us
I20260709 13:18:10.739812 18418 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:10.741467 17568 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.743234 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.743463 17568 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.745160 18371 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.745446 18601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52562 (request call id 7) took 3242 ms. Trace:
I20260709 13:18:10.745889 18601 rpcz_store.cc:276] 0709 13:18:07.502805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.502915 (+   110us) service_pool.cc:224] Handling call
0709 13:18:07.510703 (+  7788us) log.cc:844] Serialized 506 byte log entry
0709 13:18:10.745339 (+3234636us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1210,"raft.queue_time_us":2020,"raft.run_cpu_time_us":1661,"raft.run_wall_time_us":1663,"thread_start_us":7690,"threads_started":1,"wal-append.queue_time_us":1195,"wal-append.run_cpu_time_us":2282,"wal-append.run_wall_time_us":1002750}
I20260709 13:18:10.747207 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.747660 17568 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.748010 18477 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.744500 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:10.748468 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.749248 17569 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:10.749405 18430 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.749465 18371 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:10.750123 17420 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:10.750471 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.751447 17420 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.755220 17420 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.756343 18430 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.756371 17568 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.756760 17420 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.757719 18600 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.758821 18600 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.759308 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.759610 18557 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:10.760208 18557 raft_consensus.cc:697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:18:10.760633 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.761366 18557 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.761884 18587 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.757731 18599 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.741096 18608 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.739753 18582 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.764948 17420 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.748446 18601 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.748816 18584 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.766541 17420 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.767184 18430 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.754287 18589 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.764230 18603 raft_consensus.cc:3055] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.776722 17420 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.781817 18430 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.779395 18587 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.781376 18603 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:10.783025 18582 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:10.799594 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.791893 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:10.802496 18603 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:10.803103 18599 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.803471 17420 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.804025 18603 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.805580 18599 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.806142 17420 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.808234 18599 raft_consensus.cc:2764] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:18:10.826757 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:10.831910 18371 raft_consensus.cc:697] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:10.794605 18604 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.855727 18371 consensus_queue.cc:237] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.784456 18607 consensus_queue.cc:260] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.788172 18605 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.855954 18589 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:10.886610 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.877144 18600 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:10.898744 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.903565 17351 catalog_manager.cc:5697] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 1 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:18:10.906540 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.908124 18592 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:10.917651 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:10.918490 18592 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:10.922540 18607 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.937119 17529 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:18:10.966310 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.975015 18589 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.977293 18605 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.949604 18564 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:18:10.998725 17528 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:11.001042 18564 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:11.004958 18587 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.008150 18581 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:11.008769 18581 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.011521 18581 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:11.014910 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:11.041193 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 284846us
I20260709 13:18:11.043905 17600 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:11.043566 17568 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.047109 17568 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.048751 17568 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.051345 17596 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:11.054093 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.053990 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 227310us
I20260709 13:18:11.053120 18371 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.052379 18557 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.055076 17420 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.056236 18587 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.055186 17568 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.056643 17420 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.057602 18371 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.052359 18620 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.053758 18603 consensus_queue.cc:1059] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:18:11.061879 18621 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.065919 18605 consensus_queue.cc:1059] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:11.066516 18603 consensus_queue.cc:1243] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:11.067098 18581 raft_consensus.cc:3055] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:11.067188 18605 consensus_queue.cc:1243] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:11.069602 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.067581 18581 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:11.059180 17568 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.070708 18581 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.072576 18621 consensus_queue.cc:1059] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:11.073066 18581 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.079612 17568 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.079763 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.082098 17568 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.083179 18371 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.084777 18477 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.085150 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.086205 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.086303 18621 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:11.086876 18430 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:11.087327 18430 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:11.088117 18430 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:11.088999 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.089279 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:11.092222 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.092528 17568 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:11.093142 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet f83c31b52fc7479896f1f02ab870dc3b: Illegal state: Replica ddfe9cca0741489b994f8b0178c54fe7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:11.093528 18371 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.094895 17568 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.095546 18371 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.079373 18620 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.100029 17495 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.079495 18587 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:11.080359 18577 raft_consensus.cc:3055] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:11.102519 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.102881 18618 raft_consensus.cc:3055] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:11.083228 18557 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.105245 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:11.110248 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:11.110828 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:11.110292 17568 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.108546 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:11.114637 18371 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.113445 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:11.116966 18606 consensus_queue.cc:1059] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:11.104058 18603 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.104981 18602 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:11.121969 18602 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:11.124181 18602 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.125967 17446 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:11.122453 18620 consensus_queue.cc:1059] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:18:11.127305 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:11.127635 17452 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:11.130568 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:11.126573 17450 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:11.130681 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:11.101047 18605 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:11.133033 18605 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:11.133498 18605 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.133711 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:11.127501 18620 raft_consensus.cc:3055] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:11.121716 18574 raft_consensus.cc:3055] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:11.141098 18620 raft_consensus.cc:740] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:11.146867 18620 consensus_queue.cc:260] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:11.148175 17597 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:11.136914 17594 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:11.115878 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.136842 17595 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:11.137900 17568 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.139060 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:11.152550 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.105549 18577 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:11.111065 18618 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:11.152880 18371 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.109705 18587 raft_consensus.cc:697] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:11.159240 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.153429 17568 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.140239 17600 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:11.155407 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:11.157146 18569 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:11.166792 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:11.169577 18477 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.165683 17568 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:11.168764 18625 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
I20260709 13:18:11.170785 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.148211 18620 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.143246 18574 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:11.175586 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.178499 17568 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.173992 18430 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.177707 18371 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.159229 18580 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.181795 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.183652 18582 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.171676 18578 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.170145 18569 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:11.171880 18607 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.181558 18418 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.180981 17568 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.180394 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:11.173770 18577 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.192090 17446 raft_consensus.cc:2393] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:11.192593 18577 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.198143 18587 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:11.200584 18418 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.211747 17451 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:11.174964 18570 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:18:11.188535 18569 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.232407 18574 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:11.243889 18574 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.246814 18618 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:11.183292 18611 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:18:11.249015 18618 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.232942 17596 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
W20260709 13:18:11.265645 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.282074 18418 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:11.282768 18418 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:11.300621 18418 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.319903 18371 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:11.320880 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 139170us
W20260709 13:18:11.321161 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 102723us
I20260709 13:18:11.330768 18418 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:11.320047 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 139129us
I20260709 13:18:11.334758 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.336369 18477 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.337370 17568 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.338634 17568 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.339978 18371 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.336581 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.344511 18430 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:11.344987 17420 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.345639 18430 raft_consensus.cc:697] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:11.350042 17420 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.352043 18477 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:11.352581 18477 raft_consensus.cc:697] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:11.354462 18477 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.358608 17420 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.356982 18430 consensus_queue.cc:237] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.367282 18592 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:11.366736 17420 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.365365 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.353562 18589 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:11.374310 18592 raft_consensus.cc:697] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:11.352389 18557 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.374790 18474 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:11.374753 17446 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:11.386678 17568 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.388759 18371 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.396442 18371 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.398415 17568 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.408185 18589 raft_consensus.cc:697] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:11.409458 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:11.409969 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:11.416519 18633 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:11.417186 18633 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:11.419638 18633 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:11.421108 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:11.421978 17448 raft_consensus.cc:2393] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:11.421754 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.424050 17495 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.424808 17528 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:11.424824 18634 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.425474 18636 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.425208 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.426237 18604 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.426556 17521 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:11.446174 18578 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:11.449165 17446 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:11.450299 17596 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:11.428325 18592 consensus_queue.cc:237] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.453153 18594 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:11.428591 18602 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.466684 18604 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:11.427608 18605 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.476943 17520 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:11.477341 18605 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:11.479177 18582 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:11.457115 18578 raft_consensus.cc:697] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:11.481174 18578 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.467312 18604 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.487012 17595 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:11.487640 17527 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:11.487769 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:11.488112 17603 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:11.488030 17529 raft_consensus.cc:2955] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:11.475059 18474 raft_consensus.cc:697] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:11.508320 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:11.514424 17602 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:11.409483 18589 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.520545 18614 consensus_queue.cc:1059] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:11.521968 18614 raft_consensus.cc:3055] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:11.522416 18614 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:11.523413 18614 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.524519 18607 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:11.524997 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:11.525934 18474 consensus_queue.cc:237] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.553351 18557 consensus_queue.cc:1059] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:11.554235 18595 raft_consensus.cc:3055] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:11.557281 18595 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:11.557487 18557 raft_consensus.cc:3055] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:11.557938 18557 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:11.558307 18595 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.558907 18557 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.560950 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:11.535915 18579 tablet_copy_client.cc:538] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:11.528705 18602 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:11.566840 18557 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.560001 18595 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.572940 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:11.572814 18627 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:11.585717 18627 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:11.585669 18167 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:11.586400 18627 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:11.565070 18633 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:18:11.586867 18627 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:11.591058 18564 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.599936 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:11.579280 18614 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:11.210163 18606 consensus_queue.cc:1175] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:11.626339 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:11.675292 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.626044 18604 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:11.674750 18569 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.686196 18194 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:11.687543 17522 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:11.687927 18569 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:11.689347 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:11.690991 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:11.693341 17450 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:11.694804 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:11.694743 18627 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:11.700348 17603 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:11.701581 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:11.720741 18477 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:11.696062 18633 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.694913 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:11.714596 18605 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.729938 18569 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:18:11.751303 18605 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.730723 18633 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:11.805235 18605 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:11.918059 18652 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:18:11.924342 17521 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:11.963521 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.936177 18606 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.982375 18610 consensus_queue.cc:1059] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:18:11.983989 18607 raft_consensus.cc:3055] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:11.984373 18607 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:18:11.984681 18639 log.cc:927] Time spent T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:18:11.988863 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 451782us
I20260709 13:18:11.985836 18606 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:11.953637 18627 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:12.027312 17448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.018s	sys 0.055s
W20260709 13:18:12.028347 17448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.018s	sys 0.055s
I20260709 13:18:12.004055 18581 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:11.985287 18607 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:12.044258 17529 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.048782 18606 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.049467 18602 raft_consensus.cc:3055] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:12.050460 18602 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:12.050635 18605 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.054416 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.055070 17600 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:12.056088 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.057011 17595 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:12.062500 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:12.071906 18649 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:18:12.060698 18633 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.070308 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:12.036212 18581 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.051800 18602 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.084694 18578 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.049693 17523 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:12.088595 18578 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.090296 18570 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.090840 18570 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.076918 18636 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.093600 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:12.103976 18648 log.cc:927] Time spent T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:18:12.103785 18589 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:12.104522 17453 raft_consensus.cc:2393] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:12.101776 18636 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.105647 18636 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.091285 18570 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.122216 17595 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.119179 17524 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:12.133251 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 207253us
I20260709 13:18:12.103427 18602 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.140138 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.140895 17594 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:12.093278 18579 tablet_bootstrap.cc:492] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
W20260709 13:18:12.113854 18595 consensus_meta.cc:287] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 13:18:12.114682 18580 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.134725 18606 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:12.154759 17521 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.162236 17522 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.165709 18655 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.166281 18655 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.168332 18655 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.174753 18614 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.175523 18614 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.184047 18606 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.154572 18620 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.187134 18620 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.154644 17595 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.181571 17520 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.192483 18371 consensus_queue.cc:1059] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:12.193292 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:12.194293 18620 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:12.196388 18557 consensus_meta.cc:287] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
I20260709 13:18:12.198760 17524 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.204835 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:12.208336 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:12.207957 17447 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.210686 17525 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.210922 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:12.211903 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.212546 17601 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:12.213599 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:12.214304 17453 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:12.149804 18580 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:12.215816 18194 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:12.216920 18580 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.218333 18581 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.219580 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.220044 17522 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.220225 17601 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:12.220485 17602 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:12.209466 18574 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:12.221611 18474 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:12.224200 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.224393 17594 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:12.224838 17595 raft_consensus.cc:2393] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:12.202648 18607 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.239877 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:12.228111 18614 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:12.228991 18371 raft_consensus.cc:3055] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:12.254884 18371 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:12.229019 18606 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.230156 18637 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:12.275492 18605 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:12.276059 18605 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.277586 17569 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:12.236941 18617 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:18:12.277334 17349 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 1 to 2, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:12.279743 18605 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.241348 17352 catalog_manager.cc:5697] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 2, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 2 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.244236 18578 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:12.244922 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.245325 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:12.247840 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:12.281893 17352 catalog_manager.cc:5697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 2, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 2 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.250566 17595 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.251349 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:12.253697 17446 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:12.257174 17594 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:12.281795 17596 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:12.222229 18636 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.255743 18371 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.292104 18636 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.260876 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:12.292519 18371 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.262707 17350 catalog_manager.cc:5697] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 2, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.300585 18589 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:12.306438 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:12.308204 18614 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:12.268458 18570 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.258273 18662 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.258154 17600 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.273069 17527 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.309717 18662 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:12.198797 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 47872.2us
I20260709 13:18:12.258209 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:12.288571 18610 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:12.313021 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 55051.9us
I20260709 13:18:12.310200 18662 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.317646 18570 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.320119 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:12.322602 17495 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:12.325392 18430 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:12.327072 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:12.327735 18198 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:12.329341 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:12.329949 17448 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:12.321445 18602 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:18:12.326112 18634 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.325008 18606 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.333446 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:12.333623 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.327971 18636 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:12.336678 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.338322 17448 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:12.324709 18196 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:12.341439 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:12.324288 18595 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:18:12.342191 17595 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.336678 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:12.337267 18606 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.368281 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:12.368975 17594 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.374121 18477 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:12.374585 17495 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:12.373046 18574 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.364758 18636 raft_consensus.cc:697] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:12.380240 18570 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:12.360772 17596 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:12.373878 18606 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.379218 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:12.406584 17595 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:12.409279 17594 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:12.411957 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:12.377413 18600 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:18:12.341918 18634 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.388455 18592 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:18:12.395769 18574 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.391646 18605 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:18:12.416870 17597 raft_consensus.cc:1275] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:12.454286 18663 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 13:18:12.454941 18577 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.461319 18579 tablet_bootstrap.cc:492] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:18:12.435218 18607 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.474988 17603 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.484465 18636 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.488129 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:12.515291 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:12.434536 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:12.498885 18607 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.504925 18569 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.548041 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 132063us
I20260709 13:18:12.571079 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:12.573077 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:12.574008 18564 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:12.580487 18633 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.581148 18633 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.581624 18633 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.517131 18570 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:12.503780 18658 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:12.504092 18655 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.531433 18605 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:12.590108 18579 tablet_bootstrap.cc:492] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:18:12.578085 18607 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.592370 18570 raft_consensus.cc:697] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:12.609320 18602 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.592012 18655 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.607767 18605 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:12.584618 18569 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.625871 18577 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:12.623227 18579 ts_tablet_manager.cc:1403] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.554s	user 0.021s	sys 0.018s
I20260709 13:18:12.643785 18477 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:12.551254 17527 raft_consensus.cc:1275] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.644508 18477 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.634367 18574 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.634606 18577 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.628707 18602 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.676379 18477 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:12.590090 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 214938us
I20260709 13:18:12.677103 18605 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.596580 18658 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.686122 18570 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.694679 18602 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:12.699644 18633 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.727641 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:12.733162 17603 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.735183 18658 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:12.738358 18606 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:12.726213 18610 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.727896 18634 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.740567 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:12.746943 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:12.749832 18655 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.755730 18633 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.760937 18579 raft_consensus.cc:359] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.825474 18595 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.837469 17446 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.838492 18579 raft_consensus.cc:740] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:18:12.807017 18592 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.779881 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.837968 18595 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.840246 18592 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.840756 17603 raft_consensus.cc:2368] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:12.839290 18579 consensus_queue.cc:260] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:12.811661 18584 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:12.842167 18592 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:12.780552 18569 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:12.783241 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.784564 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:12.777155 18577 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.729115 18662 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.834896 17453 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.842595 18614 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.825898 18610 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.856351 17597 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:12.861670 18606 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.901046 18595 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:12.910929 17417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.019s
I20260709 13:18:12.900897 17453 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:12.904505 18371 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:12.943193 18371 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.858729 18607 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:12.939227 18579 ts_tablet_manager.cc:1434] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.304s	user 0.008s	sys 0.004s
I20260709 13:18:12.860195 18614 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.900493 18657 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:12.887327 18477 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.892771 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:12.948364 17527 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:12.949914 17568 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:12.856690 18604 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.890609 18643 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 13:18:12.927959 18200 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.001s	sys 0.023s
W20260709 13:18:12.961305 18200 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.001s	sys 0.023s
W20260709 13:18:12.961665 18198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.015s	sys 0.013s
W20260709 13:18:12.945830 17417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.009s	sys 0.022s
I20260709 13:18:12.955663 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.962517 17602 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:12.938735 18564 raft_consensus.cc:697] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:12.947412 18477 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.963550 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:12.964233 17602 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:12.962007 18198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.015s	sys 0.013s
I20260709 13:18:12.961858 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.961091 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:12.966342 17603 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:12.842556 18584 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.971524 17595 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:12.966657 17598 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:12.980803 18371 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:12.982960 18371 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.942665 18670 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:18:12.995412 18569 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.026062 18569 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.028080 18371 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.967300 18679 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:18:12.971805 18627 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.072050 18595 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.072839 18595 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:12.960924 18604 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.004899 18610 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:13.007920 18614 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:13.008247 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.090519 18595 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:13.093186 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.093466 18607 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:13.094148 17523 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:13.095930 17568 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:13.093266 18614 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:13.011225 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.012017 18167 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:18:13.098014 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 112429us
I20260709 13:18:13.012391 18584 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.981076 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:13.021620 18592 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:13.029121 18569 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:12.997654 18662 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:13.031996 18371 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.099907 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-2edee9f2356c4e878f2e11af63e46ab9 received from {username='slave'} at 127.0.0.1:52572
I20260709 13:18:13.100023 18655 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.118945 18655 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.118548 18592 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.119534 18655 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.121731 18592 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:13.132479 18604 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:13.084538 18627 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:13.133364 18627 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.010560 17446 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:13.118067 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-2edee9f2356c4e878f2e11af63e46ab9 on tablet 2edee9f2356c4e878f2e11af63e46ab9 with peer 2158c0f750fd4b21afe24135c52167b2
W20260709 13:18:13.143545 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 162606us
I20260709 13:18:13.146698 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:13.146564 18564 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:13.147634 17599 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.151904 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:13.152552 18574 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:13.155875 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:13.157308 17596 raft_consensus.cc:2410] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:13.117707 18614 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:13.161284 18614 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:13.164767 17494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.023s	sys 0.021s
W20260709 13:18:13.165177 17494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.023s	sys 0.022s
I20260709 13:18:13.167310 17599 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:12.950201 18657 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.003953 18577 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:13.063730 18477 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:13.138198 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.173676 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:13.179342 17527 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:13.179910 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:13.180411 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.181118 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:13.181298 17527 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:13.126685 18607 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.142427 18595 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:13.175249 17602 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:13.191541 18371 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.197928 18577 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.198555 18577 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.198977 18577 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:13.203578 17524 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.019s	sys 0.029s
W20260709 13:18:13.204209 17524 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.019s	sys 0.029s
I20260709 13:18:13.183017 17568 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:13.183806 18602 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.187062 18605 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.185612 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.189121 18634 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:13.171645 17525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.025s	sys 0.024s
I20260709 13:18:13.204095 18607 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:13.217242 17493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.022s	sys 0.054s
W20260709 13:18:13.218883 17493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.022s	sys 0.054s
I20260709 13:18:13.206686 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:13.213277 17525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.025s	sys 0.025s
I20260709 13:18:13.220185 18477 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:13.220343 18371 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:13.221431 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:13.221686 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.210644 18605 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.225601 17527 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.212685 18634 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:13.207126 18646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.023s	sys 0.024s
I20260709 13:18:13.256911 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.273084 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.275051 17529 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:13.219926 18607 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.204828 18595 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.255797 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.216631 17522 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:13.319543 17524 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:13.210180 18602 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.300455 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:13.322103 18646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.024s	sys 0.024s
I20260709 13:18:13.322620 18699 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.222800 18657 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:13.332643 18165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.004s	sys 0.050s
I20260709 13:18:13.250773 18605 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.289994 18634 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.334200 18371 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:13.333230 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 52373.3us
W20260709 13:18:13.279560 18668 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:13.349644 18371 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:13.338173 17527 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:13.279700 18604 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.342242 17521 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
W20260709 13:18:13.338517 18165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.004s	sys 0.050s
W20260709 13:18:13.335990 17601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.028s	sys 0.082s
I20260709 13:18:13.358626 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:13.273098 18627 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:13.381294 17526 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.029s	sys 0.022s
I20260709 13:18:13.345245 18699 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:13.386938 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 205892us
I20260709 13:18:13.396857 18371 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:13.350435 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 826) took 1036 ms. Trace:
I20260709 13:18:13.341580 18602 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:13.359822 17601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.028s	sys 0.082s
W20260709 13:18:13.423756 18690 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:18:13.424726 18643 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.428323 18201 raft_consensus.cc:1217] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:13.431370 17521 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:13.433112 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:13.433244 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:13.435438 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:13.437875 18198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42538 (request call id 144) took 1080 ms. Trace:
I20260709 13:18:13.441212 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:18:13.386108 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 422759us
I20260709 13:18:13.420893 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:13.381701 17526 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.029s	sys 0.022s
I20260709 13:18:13.550056 18198 rpcz_store.cc:276] 0709 13:18:12.357993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.358172 (+   179us) service_pool.cc:224] Handling call
0709 13:18:12.358510 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.358894 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.358920 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.365894 (+  6974us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.965016 (+599122us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:12.965077 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.965176 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.437511 (+472335us) raft_consensus.cc:1685] finished
0709 13:18:13.437546 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.437754 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2657,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3423,"thread_start_us":577280,"threads_started":1,"wal-append.queue_time_us":1029881}
W20260709 13:18:13.528017 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 197417us
W20260709 13:18:13.515318 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 78967.7us
I20260709 13:18:13.381772 18604 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.457242 18595 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:13.397502 18636 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.041s	sys 0.079s
I20260709 13:18:13.398268 18699 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.536260 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:13.650718 17420 leader_election.cc:400] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
W20260709 13:18:13.650877 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 114685us
I20260709 13:18:13.477221 17523 raft_consensus.cc:1240] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:13.536350 18201 raft_consensus.cc:2955] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:13.451509 18166 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:13.531396 18657 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:13.636629 18570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.064s	sys 0.072s
I20260709 13:18:13.664024 17568 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:13.606902 18655 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:13.637593 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.608801 18196 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.647308 18477 consensus_queue.cc:1059] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.648571 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1137) took 1218 ms. Trace:
I20260709 13:18:13.647356 18197 raft_consensus.cc:2368] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3.
W20260709 13:18:13.646764 18636 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.042s	sys 0.079s
I20260709 13:18:13.651041 17420 leader_election.cc:403] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:13.624147 18194 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:13.651553 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:13.651393 18662 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:13.638449 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.684621 17524 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:13.670197 17526 rpcz_store.cc:276] 0709 13:18:12.425445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.425630 (+   185us) service_pool.cc:224] Handling call
0709 13:18:12.426104 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.436561 (+ 10457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.436612 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.452088 (+ 15476us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.843137 (+391049us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.610448 (+767311us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.643814 (+ 33366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.643914 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.643980 (+    66us) raft_consensus.cc:1685] finished
0709 13:18:13.643998 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.644138 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42145,"prepare.queue_time_us":705913,"prepare.run_cpu_time_us":2735,"prepare.run_wall_time_us":7883,"raft.queue_time_us":42219,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":18810,"thread_start_us":1098204,"threads_started":2,"wal-append.queue_time_us":469752}
I20260709 13:18:13.685526 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:13.607836 18643 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.668476 17528 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:13.670315 18477 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:13.652957 18430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.017s	sys 0.028s
W20260709 13:18:13.692569 18430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.017s	sys 0.028s
I20260709 13:18:13.679169 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:13.693378 17602 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:13.680287 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:13.681560 17595 raft_consensus.cc:1240] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:13.660912 18684 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:13.682335 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:13.664763 18570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.064s	sys 0.073s
I20260709 13:18:13.694360 17600 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
W20260709 13:18:13.664463 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 242930us
W20260709 13:18:13.707507 18693 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:18:13.690404 18477 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.708411 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:13.711818 18691 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.289s	user 0.004s	sys 0.000s
I20260709 13:18:13.716434 18430 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:13.717386 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 55448.7us
I20260709 13:18:13.717725 18200 raft_consensus.cc:2393] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
W20260709 13:18:13.683440 18690 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:18:13.726004 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:13.733282 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:13.688827 18574 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:13.694721 18670 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:13.745138 17602 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:13.736887 18430 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.741580 17598 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:13.687321 18564 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:13.743394 17568 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:13.749661 17568 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:13.750994 18430 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:13.752372 18477 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:13.719959 18610 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:13.666823 18657 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.753309 18430 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:13.757905 18430 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.675002 18605 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.727144 18684 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:13.760525 18477 consensus_queue.cc:1059] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.724562 18474 consensus_queue.cc:1059] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:18:13.716363 18662 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.742468 18627 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:13.752712 18701 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:13.780295 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:13.757524 18614 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:13.757362 18574 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:13.761209 18595 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:13.789011 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 60606.5us
I20260709 13:18:13.754643 18709 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:13.790468 18430 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:13.801460 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.803438 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.804253 18721 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:13.752832 18634 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.807595 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:13.794001 18606 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.797881 18592 raft_consensus.cc:3055] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:13.528240 17525 rpcz_store.cc:276] 0709 13:18:12.311623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.316550 (+  4927us) service_pool.cc:224] Handling call
0709 13:18:12.316872 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.317258 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.317291 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.317836 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.272357 (+954521us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:13.279141 (+  6784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.331956 (+ 52815us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.336935 (+  4979us) raft_consensus.cc:1685] finished
0709 13:18:13.336975 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.347923 (+ 10948us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4538,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":1732,"thread_start_us":905386,"threads_started":1,"wal-append.queue_time_us":844951}
I20260709 13:18:13.806900 18595 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:13.852167 18477 raft_consensus.cc:3055] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:13.852368 17529 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:13.852727 18477 raft_consensus.cc:740] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:13.818410 18569 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.853703 18477 consensus_queue.cc:260] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.860800 18477 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:13.854765 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 47007.3us
I20260709 13:18:13.856957 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:13.863082 17450 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.815062 18614 raft_consensus.cc:697] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:13.797420 18701 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:13.848990 18704 log.cc:927] Time spent T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:18:13.842149 18592 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:13.857800 18474 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:13.865716 17520 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:13.853458 18595 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.870860 17523 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:13.866935 18569 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.931119 18430 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.865130 18604 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:13.814711 18709 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.864670 18707 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:13.869457 18679 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:13.847158 18606 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.841094 18721 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:13.815129 18684 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:14.086349 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 747) took 1332 ms. Trace:
W20260709 13:18:14.180801 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 368950us
I20260709 13:18:14.192890 18430 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:14.193470 17594 rpcz_store.cc:276] 0709 13:18:12.739635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.740003 (+   368us) service_pool.cc:224] Handling call
0709 13:18:12.740314 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.164040 (+423726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.164074 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.164614 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.522344 (+357730us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:13.522409 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.625589 (+103180us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540033aed4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:13.625660 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.071682 (+446022us) raft_consensus.cc:1685] finished
0709 13:18:14.071705 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.071941 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26857,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":11429,"spinlock_wait_cycles":413285760,"thread_start_us":560566,"threads_started":2,"wal-append.queue_time_us":490157}
I20260709 13:18:14.028049 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:14.113711 17450 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:14.031443 17451 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:14.221017 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:13.916030 18655 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:14.055845 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 302075us
I20260709 13:18:14.231448 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:14.298933 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:14.082386 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 224847us
I20260709 13:18:14.300413 17450 raft_consensus.cc:2393] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:13.942868 18371 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:14.250875 18430 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:14.302631 18706 log.cc:927] Time spent T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.477s	user 0.000s	sys 0.001s
I20260709 13:18:14.219786 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.308539 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.309455 17453 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:14.254281 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:14.310532 17529 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:14.301641 18371 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.194926 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:14.317600 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 122754us
I20260709 13:18:14.071624 18643 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:13.869419 18700 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:14.320834 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:14.213551 18688 log.cc:927] Time spent T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.562s	user 0.003s	sys 0.000s
I20260709 13:18:14.195477 18569 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.086702 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:14.267982 18696 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 13:18:14.187882 18662 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.259873 18718 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:14.328562 18702 log.cc:927] Time spent T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260709 13:18:14.219406 18707 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:13.963399 18670 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:14.329459 18584 raft_consensus.cc:3055] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:14.075075 18592 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.187775 18196 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:14.160365 18657 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:14.221822 18711 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:18:14.332629 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.363716 17453 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:14.364732 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:14.365280 17453 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.339601 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:14.019057 18570 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:14.342955 17451 raft_consensus.cc:2410] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:14.367239 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:14.127318 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:14.182415 18595 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:14.248801 18703 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
I20260709 13:18:13.951244 18610 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:14.259754 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:14.360069 17597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.008s	sys 0.023s
I20260709 13:18:14.050101 18614 consensus_queue.cc:237] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.357266 18584 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:14.346506 18371 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:14.133409 18602 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:14.320544 18577 consensus_meta.cc:287] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.121s	user 0.014s	sys 0.001s
I20260709 13:18:14.348095 18477 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:14.395334 18477 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:14.349123 17492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.015s
W20260709 13:18:14.396798 17492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.007s	sys 0.015s
I20260709 13:18:13.965698 18712 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:13.931836 18474 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:14.368220 18201 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:14.372958 18714 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:13.916905 18574 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:14.129432 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.219077 18679 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.349442 18643 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:14.327214 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.500591 17450 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:14.393500 17453 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
W20260709 13:18:14.425570 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 106149us
W20260709 13:18:14.432801 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 133775us
I20260709 13:18:14.375367 18196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42536 (request call id 102) took 1014 ms. Trace:
I20260709 13:18:14.394378 17446 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:18:14.388520 17597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.008s	sys 0.023s
I20260709 13:18:14.507927 18371 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:14.363477 18670 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.424999 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:14.362401 18662 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 13:18:14.502875 17568 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:14.345120 18700 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.379153 18570 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.472316 18657 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:14.372501 18718 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.545010 17568 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:14.527271 18371 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.510690 17445 raft_consensus.cc:2368] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3.
W20260709 13:18:14.526476 18731 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:18:14.394623 18610 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.595489 18698 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:14.596009 18698 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:14.596388 18698 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:14.541250 18699 consensus_meta.cc:287] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.880s	user 0.001s	sys 0.010s
I20260709 13:18:14.508462 18686 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:14.508620 18720 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:14.432507 18577 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:14.471064 18602 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.508205 18723 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:14.508510 18722 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:14.510421 18643 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.610394 18699 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.619647 18720 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.620193 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.620757 18694 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:14.543259 18701 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.504135 18196 rpcz_store.cc:276] 0709 13:18:13.360844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.382138 (+ 21294us) service_pool.cc:224] Handling call
0709 13:18:13.441027 (+ 58889us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b5800003c98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:14.363152 (+922125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66691968}
W20260709 13:18:14.628333 18728 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 13:18:14.608242 17452 raft_consensus.cc:2410] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:14.635456 18564 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:14.613529 18670 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.635860 18606 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.592253 18657 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.591091 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 748) took 1811 ms. Trace:
I20260709 13:18:14.540585 18737 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:14.499769 18712 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.528641 18714 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.630775 18371 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:14.678798 17603 raft_consensus.cc:2368] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:14.648787 18720 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.586375 18584 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:14.642210 18708 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:14.675345 18709 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.686234 18694 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:14.641830 18686 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.695356 18564 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:14.675161 17446 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:14.700536 17522 raft_consensus.cc:2393] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:14.726354 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.720184 18584 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.714118 18700 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.649855 18723 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.713461 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.736694 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.713231 18707 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:14.720978 18708 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.720389 18740 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:14.743180 17447 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:14.747628 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.727453 18595 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:14.749601 17447 raft_consensus.cc:2393] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:14.743325 18474 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.651984 18722 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:14.754524 18740 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.753933 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.756448 17447 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
W20260709 13:18:14.747624 18607 consensus_meta.cc:287] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.411s	user 0.012s	sys 0.001s
I20260709 13:18:14.762732 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.763552 17447 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:14.747089 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.746207 18708 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.713016 18737 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:14.768615 18698 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.783510 18698 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:14.783641 18694 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.775806 18602 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.748028 17445 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:14.784626 18577 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:14.784497 18738 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:14.757846 18712 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.793964 17452 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:14.791059 18570 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.775271 18607 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.794224 18600 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:14.801769 18610 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:14.813714 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 189926us
I20260709 13:18:14.814389 18699 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:14.830967 18679 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.843932 17599 raft_consensus.cc:2368] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:14.815894 18643 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:14.848946 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.858057 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 228079us
I20260709 13:18:14.812873 18738 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.829756 18714 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.825825 18745 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:14.886418 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:14.837118 18718 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:14.887177 17594 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:14.829250 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:14.893761 18694 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:14.894356 18694 raft_consensus.cc:697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:14.894948 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:14.895262 18694 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:14.888373 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:14.896971 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:14.889012 18686 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.895687 17596 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:14.877664 18738 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.829412 18600 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:14.898970 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 354013us
W20260709 13:18:14.897838 18569 consensus_meta.cc:287] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.000s
I20260709 13:18:14.900231 18748 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:14.908115 18748 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.908367 18737 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:14.908485 18748 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:14.699425 17601 rpcz_store.cc:276] 0709 13:18:12.774382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.774581 (+   199us) service_pool.cc:224] Handling call
0709 13:18:12.775002 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.775443 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.775483 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.776095 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.548520 (+772425us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:13.603268 (+ 54748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.607125 (+  3857us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.499525 (+892400us) raft_consensus.cc:1685] finished
0709 13:18:14.499544 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.586093 (+ 86549us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1288,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6018,"thread_start_us":754309,"threads_started":1,"wal-append.queue_time_us":837004}
I20260709 13:18:14.913532 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:14.904641 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 75485.9us
I20260709 13:18:14.916476 18723 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:14.920109 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:14.919942 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:14.920264 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:14.904102 18738 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:14.901263 18569 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:14.899295 18745 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:14.954502 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 761) took 1273 ms. Trace:
W20260709 13:18:14.933362 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.921234 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:14.984885 17521 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:14.953267 18600 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.955785 18718 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:14.983659 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:14.987434 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.007365 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:15.012084 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.012295 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.983999 17603 rpcz_store.cc:276] 0709 13:18:13.680692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.682112 (+  1420us) service_pool.cc:224] Handling call
0709 13:18:14.954257 (+1272145us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54000771d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:14.954407 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2196590336}
I20260709 13:18:15.014192 17524 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:14.948449 17419 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:15.023018 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:15.018005 17525 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:15.024003 18750 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.024116 18698 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.024565 17597 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:14.997948 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:15.020502 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:14.972455 18723 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:18:15.023145 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 74816.4us
I20260709 13:18:15.016723 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:14.982834 18721 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:15.031584 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:14.974814 18687 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:18:15.026914 17569 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:15.020458 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:15.030395 18196 raft_consensus.cc:2393] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:15.030527 18752 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.987696 18607 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:14.975028 18699 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.032353 17454 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.952265 18657 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.033294 18698 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.038964 18725 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:15.064298 18699 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:15.065145 18725 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.065542 18725 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.066807 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:15.067526 17447 raft_consensus.cc:2393] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:15.021377 18574 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:15.036597 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:15.008849 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:14.992785 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:14.987278 18738 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.034714 18753 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:15.039783 18592 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.040058 18684 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.041603 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:15.037576 18723 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:15.038089 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.024616 18750 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.081766 17568 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:15.085091 17568 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:15.049084 18685 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:15.038535 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:15.019223 18610 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.051335 18595 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.051795 18686 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.054780 18570 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.055260 18721 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.038542 17453 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:15.062675 18605 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.062566 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:15.058856 18646 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:15.063514 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:15.034282 17524 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.069299 17569 leader_election.cc:400] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3.
I20260709 13:18:15.071045 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:14.986901 18718 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.071887 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:15.073391 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:15.074182 17603 raft_consensus.cc:2393] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:14.917237 18722 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.075074 17454 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:15.077513 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:15.077663 18745 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:14.957146 18720 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.079523 18738 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.087149 18371 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:15.088289 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 49872.5us
I20260709 13:18:15.548857 17352 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40508 (request call id 181) took 4007 ms. Trace:
I20260709 13:18:15.655212 18371 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.543475 17349 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 87) took 3269 ms. Trace:
I20260709 13:18:15.089336 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:15.167956 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.391108 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.133783 18477 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.550050 17350 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40498 (request call id 183) took 3473 ms. Trace:
I20260709 13:18:15.215353 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:15.215903 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:15.632045 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 554580us
I20260709 13:18:15.192762 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:15.659991 17448 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.089016 18744 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.314610 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:15.553954 17351 catalog_manager.cc:5697] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 1 to 2, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:15.655903 18371 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.648742 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:15.657483 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.667593 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:15.663038 17351 catalog_manager.cc:5697] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 1 to 2, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:15.668582 17454 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.669634 17351 catalog_manager.cc:5697] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 1 to 2, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:15.628780 18725 consensus_meta.cc:287] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
W20260709 13:18:15.214089 17599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 756) took 1534 ms (client timeout 1774 ms). Trace:
I20260709 13:18:15.675202 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:15.632416 18614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.008s	sys 0.012s
W20260709 13:18:15.691470 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 59831.6us
I20260709 13:18:15.681324 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:15.112555 18735 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:15.624930 18694 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.155321 18707 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.411887 18740 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:15.665421 18592 consensus_meta.cc:287] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.577s	user 0.005s	sys 0.005s
I20260709 13:18:15.145854 18737 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:15.075045 18574 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.082947 18684 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.159628 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 38) took 1072 ms. Trace:
I20260709 13:18:15.712105 17528 raft_consensus.cc:2368] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3.
W20260709 13:18:15.695367 17599 rpcz_store.cc:269] 0709 13:18:13.679257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.679371 (+   114us) service_pool.cc:224] Handling call
0709 13:18:15.213827 (+1534456us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000767d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:15.213999 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2527466240}
I20260709 13:18:15.739944 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:15.542009 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 858) took 1177 ms. Trace:
I20260709 13:18:15.766469 17525 rpcz_store.cc:276] 0709 13:18:14.365010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.373750 (+  8740us) service_pool.cc:224] Handling call
0709 13:18:15.541749 (+1167999us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54002319d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:15.541934 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087679232}
I20260709 13:18:15.767792 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.769042 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.212721 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:15.730711 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:15.771026 18718 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.771273 18574 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.771589 18718 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.772018 18718 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.772305 18574 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.772460 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 955) took 1440 ms. Trace:
I20260709 13:18:15.772832 18574 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.772992 17449 rpcz_store.cc:276] 0709 13:18:14.332069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.771569 (+1439500us) service_pool.cc:224] Handling call
0709 13:18:15.771906 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.772099 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.772129 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.772174 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:15.772210 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.772271 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.772374 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.160543 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.250273 18604 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:15.289219 18748 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:15.754383 18707 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:15.177287 18685 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:15.195765 18708 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:15.665073 18646 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.656481 17352 rpcz_store.cc:276] 0709 13:18:11.541033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.541235 (+   202us) service_pool.cc:224] Handling call
0709 13:18:15.548758 (+4007523us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:13.127167 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:13.127997 (+   830us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:13.128048 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:18:13.128077 (+    29us) tablet.cc:662] Decoding operations
0709 13:18:13.129612 (+  1535us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:13.129678 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:13.129722 (+    44us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:13.160775 (+ 31053us) tablet.cc:701] Row locks acquired
0709 13:18:13.160807 (+    32us) write_op.cc:260] PREPARE: finished
0709 13:18:13.160979 (+   172us) write_op.cc:270] Start()
0709 13:18:13.161104 (+   125us) write_op.cc:276] Timestamp: P: 1783603093160934 usec, L: 0
0709 13:18:13.161134 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:18:13.186362 (+ 25228us) log.cc:844] Serialized 928 byte log entry
0709 13:18:14.973309 (+1786947us) op_driver.cc:464] REPLICATION: finished
0709 13:18:14.974849 (+  1540us) write_op.cc:301] APPLY: starting
0709 13:18:14.974931 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:14.975052 (+   121us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:14.975169 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:14.975572 (+   403us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:14.975723 (+   151us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:14.975768 (+    45us) write_op.cc:312] APPLY: finished
0709 13:18:14.975961 (+   193us) log.cc:844] Serialized 28 byte log entry
0709 13:18:14.976151 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:14.976226 (+    75us) write_op.cc:454] Released schema lock
0709 13:18:14.976265 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:14.976608 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:14.976637 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":569457,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":451,"apply.run_cpu_time_us":1733,"apply.run_wall_time_us":1733,"num_ops":2,"prepare.queue_time_us":696032,"prepare.run_cpu_time_us":3714,"prepare.run_wall_time_us":144695,"replication_time_us":1812049}]]}
I20260709 13:18:15.739408 18735 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.732389 18739 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:15.661106 18705 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:15.657601 18699 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.083122 18753 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.335819 18657 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:15.312331 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:15.762241 18737 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.158296 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.081759 18752 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:15.249964 18726 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:15.108310 18610 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.672473 18584 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:15.643640 18723 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:15.192847 18698 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.801949 18737 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.802299 18698 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.788066 18753 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.086767 18687 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.645s
I20260709 13:18:15.776528 18748 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:15.788403 17446 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:15.778810 18707 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:15.671396 18570 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.757467 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:15.694432 18745 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.694590 18679 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:15.714300 18725 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:15.732774 18614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.011s	sys 0.012s
I20260709 13:18:15.702062 18714 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:15.764950 17453 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:15.765805 17454 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:15.816524 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:15.797845 18600 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.541249 18634 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.818542 17529 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:15.816385 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:15.817752 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:15.804731 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 957) took 1472 ms. Trace:
I20260709 13:18:15.786939 17526 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:15.793212 18371 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.205439 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:15.791253 17594 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:15.790575 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 956) took 1458 ms. Trace:
I20260709 13:18:15.159601 18564 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:15.733963 18733 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:15.786770 18657 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.658913 17350 rpcz_store.cc:276] 0709 13:18:12.076950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.077116 (+   166us) service_pool.cc:224] Handling call
0709 13:18:15.549948 (+3472832us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:13.186771 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:13.187355 (+   584us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:13.187386 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:18:13.187406 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:13.187765 (+   359us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:13.187813 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:13.187844 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:13.188033 (+   189us) tablet.cc:701] Row locks acquired
0709 13:18:13.188061 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:18:13.188188 (+   127us) write_op.cc:270] Start()
0709 13:18:13.188308 (+   120us) write_op.cc:276] Timestamp: P: 1783603093188150 usec, L: 0
0709 13:18:13.188324 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:18:13.188919 (+   595us) log.cc:844] Serialized 540 byte log entry
0709 13:18:14.974284 (+1785365us) op_driver.cc:464] REPLICATION: finished
0709 13:18:14.981743 (+  7459us) write_op.cc:301] APPLY: starting
0709 13:18:14.981810 (+    67us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:14.981906 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:14.981986 (+    80us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:14.982230 (+   244us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:14.982381 (+   151us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:14.982423 (+    42us) write_op.cc:312] APPLY: finished
0709 13:18:15.011354 (+ 28931us) log.cc:844] Serialized 22 byte log entry
0709 13:18:15.020152 (+  8798us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:15.028596 (+  8444us) write_op.cc:454] Released schema lock
0709 13:18:15.032327 (+  3731us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":500000,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":7239,"apply.run_cpu_time_us":1836,"apply.run_wall_time_us":77681,"num_ops":1,"prepare.queue_time_us":891192,"prepare.run_cpu_time_us":2357,"prepare.run_wall_time_us":2357,"replication_time_us":1785390,"thread_start_us":94386,"threads_started":1}]]}
I20260709 13:18:15.783069 18739 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:15.827224 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 130328us
I20260709 13:18:15.773969 18718 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.782231 18646 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.865447 18748 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.813997 18679 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.775097 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.774634 18604 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:15.874675 18634 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.875375 18634 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.876957 18604 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:15.802603 18737 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:15.877621 18634 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.656404 17349 rpcz_store.cc:276] 0709 13:18:12.274104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.274998 (+   894us) service_pool.cc:224] Handling call
0709 13:18:15.543355 (+3268357us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:12.336815 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:12.364390 (+ 27575us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:12.364429 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:18:12.364451 (+    22us) tablet.cc:662] Decoding operations
0709 13:18:12.397146 (+ 32695us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:12.401719 (+  4573us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:12.405334 (+  3615us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:12.427142 (+ 21808us) tablet.cc:701] Row locks acquired
0709 13:18:12.434656 (+  7514us) write_op.cc:260] PREPARE: finished
0709 13:18:12.440426 (+  5770us) write_op.cc:270] Start()
0709 13:18:12.440549 (+   123us) write_op.cc:276] Timestamp: P: 1783603092440378 usec, L: 0
0709 13:18:12.440572 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:12.555567 (+114995us) log.cc:844] Serialized 535 byte log entry
0709 13:18:14.085533 (+1529966us) op_driver.cc:464] REPLICATION: finished
0709 13:18:14.424400 (+338867us) write_op.cc:301] APPLY: starting
0709 13:18:14.432457 (+  8057us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:14.505420 (+ 72963us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:14.547332 (+ 41912us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:14.629921 (+ 82589us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:14.644390 (+ 14469us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:14.651958 (+  7568us) write_op.cc:312] APPLY: finished
0709 13:18:14.700823 (+ 48865us) log.cc:844] Serialized 22 byte log entry
0709 13:18:14.723212 (+ 22389us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:14.725821 (+  2609us) write_op.cc:454] Released schema lock
0709 13:18:14.729097 (+  3276us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:14.735690 (+  6593us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:14.735725 (+    35us) write_op.cc:454] Released schema lock
0709 13:18:14.973050 (+237325us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b54000eb8a0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5ae4343 00007f5ab5ae7d75 00007f5ab5ae7d09 00007f5ab5ae7c99 00007f5ab5ae7c61 00007f5ab5ae6f5d 000000000038f354 000000000038f199 00007f5ab2a79475 00007f5ab2a7b7c1
0709 13:18:15.074424 (+101374us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:15.074934 (+   510us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":289272,"apply.run_cpu_time_us":2789,"apply.run_wall_time_us":348962,"num_ops":1,"prepare.queue_time_us":55502,"prepare.run_cpu_time_us":19373,"prepare.run_wall_time_us":624824,"raft.queue_time_us":842284,"raft.run_cpu_time_us":106366,"raft.run_wall_time_us":988696,"replication_time_us":1644770,"spinlock_wait_cycles":87857408,"thread_start_us":670584,"threads_started":4,"wal-append.queue_time_us":716681}]]}
I20260709 13:18:15.671212 18686 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.806738 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1215) took 1449 ms. Trace:
W20260709 13:18:15.626988 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 545604us
W20260709 13:18:15.737589 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45985.7us
I20260709 13:18:15.692154 17351 catalog_manager.cc:5697] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 1 to 2, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:15.809696 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:15.786403 18699 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.776882 18595 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.786105 18705 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.789804 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.782817 18735 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:15.712827 18744 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.779577 18685 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:15.780408 18708 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.708990 18721 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:15.736388 18694 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:15.818122 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1217) took 1346 ms. Trace:
I20260709 13:18:15.886183 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:15.887133 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.896384 17526 raft_consensus.cc:2393] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:15.887554 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.901232 17351 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 1 to 2, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:15.901525 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:15.906948 18686 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.907608 17527 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:15.818361 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:15.779314 17524 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:15.909425 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.910476 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:15.910948 17524 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.818740 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:15.903578 17450 rpcz_store.cc:276] 0709 13:18:14.357793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.805793 (+1448000us) service_pool.cc:224] Handling call
0709 13:18:15.806303 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.806458 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.806482 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.806521 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:15.806548 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.806597 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.806690 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.822137 17595 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:15.157946 18569 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:15.808038 18698 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.798904 17521 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:15.925055 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.925597 17521 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:15.898996 17453 rpcz_store.cc:276] 0709 13:18:14.491813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.817426 (+1325613us) service_pool.cc:224] Handling call
0709 13:18:15.817681 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.817835 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.817857 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.817894 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:15.817922 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.817970 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.818076 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.926610 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.927794 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.828243 17447 raft_consensus.cc:2368] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3.
I20260709 13:18:15.826854 18371 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.826910 17449 rpcz_store.cc:276] 0709 13:18:14.332297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.775328 (+1443031us) service_pool.cc:224] Handling call
0709 13:18:15.775657 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.790228 (+ 14571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.790260 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.790308 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:15.790338 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.790400 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.790522 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14217,"raft.queue_time_us":14784,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":9086}
I20260709 13:18:15.835525 17451 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:15.853823 18720 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.853989 17569 leader_election.cc:403] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:15.936550 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 878092us
I20260709 13:18:15.854712 18570 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.938782 17524 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:15.764357 17522 rpcz_store.cc:276] 0709 13:18:14.087686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.094316 (+  6630us) service_pool.cc:224] Handling call
0709 13:18:15.159381 (+1065065us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400088c54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:15.159541 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608451328}
I20260709 13:18:15.855223 18725 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.810144 18745 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.856732 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.856875 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1219) took 1258 ms. Trace:
I20260709 13:18:15.857128 18739 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.857364 18763 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:15.858098 18614 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.849596 18733 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.940058 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:15.940661 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.943095 17522 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:15.943361 18733 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.859880 18657 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.823382 17597 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.943862 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:15.944147 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.944721 18733 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:15.942296 18745 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.945219 18733 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.941845 18763 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.946310 18733 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:15.948096 18763 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.942251 18614 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.799811 18726 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.863600 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:15.814188 18723 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.950989 18723 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.952775 18614 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.952976 17520 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:15.953440 18723 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.825531 18714 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.954803 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.938333 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:15.873800 18679 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.825389 18600 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.911828 17598 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:15.785851 17448 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:15.956962 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 959) took 1011 ms. Trace:
I20260709 13:18:15.957315 17448 rpcz_store.cc:276] 0709 13:18:14.945389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.215628 (+270239us) service_pool.cc:224] Handling call
0709 13:18:15.956897 (+741269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.950991 17601 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:15.957973 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:15.959144 18723 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.903080 17351 catalog_manager.cc:5697] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 1 to 2, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:15.944773 17522 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:15.961560 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:15.962219 18745 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.922751 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.963204 17526 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:15.963292 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:15.964061 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:15.923799 17454 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:15.853034 18564 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.866082 18584 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.926350 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:15.852972 18610 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:15.853416 18574 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.929077 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:15.866005 18748 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:15.991587 17521 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.904619 18705 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.938205 18762 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.941319 17528 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:15.941450 17445 rpcz_store.cc:276] 0709 13:18:14.598485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.856025 (+1257540us) service_pool.cc:224] Handling call
0709 13:18:15.856351 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.856530 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.856560 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.856602 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:15.856646 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.856709 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.856820 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.908380 18764 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:15.934682 17420 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.774s (SENT) [suppressed 4 similar messages]
I20260709 13:18:15.968344 18763 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:15.966449 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:15.911744 18699 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:15.969017 17529 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:15.969967 18196 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:15.969755 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
W20260709 13:18:16.025693 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 56046us
I20260709 13:18:15.972579 17525 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:15.943107 17524 raft_consensus.cc:2368] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for earlier term 2. Current term is 3.
I20260709 13:18:15.998584 18606 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:15.952802 18726 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:15.990471 17454 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:16.046267 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 960) took 1100 ms. Trace:
I20260709 13:18:16.046823 17454 rpcz_store.cc:276] 0709 13:18:14.945710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.923412 (+977702us) service_pool.cc:224] Handling call
0709 13:18:15.923686 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.046000 (+122314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.046217 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:15.992736 17451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 949) took 1665 ms (client timeout 1626 ms). Trace:
W20260709 13:18:16.047842 17451 rpcz_store.cc:269] 0709 13:18:14.327086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.366958 (+ 39872us) service_pool.cc:224] Handling call
0709 13:18:15.992486 (+1625528us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400185bd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:15.992613 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3198560512}
I20260709 13:18:15.936826 18686 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.048940 18686 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.049461 18686 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:15.825443 17446 rpcz_store.cc:276] 0709 13:18:14.332528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.787686 (+1455158us) service_pool.cc:224] Handling call
0709 13:18:15.788048 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.804422 (+ 16374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.804669 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.880411 18737 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:16.000326 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.002933 18684 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.012928 17521 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:15.972991 18584 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.925683 17450 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:15.919229 18595 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:16.017685 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 51326.4us
I20260709 13:18:16.074626 17569 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:15.888358 17596 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 1.
I20260709 13:18:15.918817 18636 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.990216 18720 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:16.082371 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 147732us
I20260709 13:18:15.967527 17419 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.030601 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:15.993171 18733 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:16.083882 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 116418us
I20260709 13:18:16.084549 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.085148 17598 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:16.085528 18733 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.020110 18610 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.085983 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.034864 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:16.038057 17594 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:16.087062 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 40) took 1033 ms. Trace:
I20260709 13:18:16.087188 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:16.087926 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.088056 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.088549 17594 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:16.088629 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.089128 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.089298 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.089690 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.089799 17594 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:16.090150 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:16.090440 17449 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:16.086766 17598 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:16.090637 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:16.038949 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1227) took 1071 ms. Trace:
I20260709 13:18:16.090937 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.091236 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.091531 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.091373 17447 rpcz_store.cc:276] 0709 13:18:14.967778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.073157 (+105379us) service_pool.cc:224] Handling call
0709 13:18:16.038698 (+965541us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400192b54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:16.038876 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451052800}
I20260709 13:18:16.092052 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:16.092221 17598 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:16.092559 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.092686 17445 raft_consensus.cc:2376] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3. Re-sending same reply.
I20260709 13:18:16.093055 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.093542 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:15.975277 17568 leader_election.cc:400] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3.
I20260709 13:18:16.040308 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.044872 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1179) took 1056 ms. Trace:
I20260709 13:18:16.016147 18764 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.064085 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:16.094851 17595 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.094713 18764 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.075531 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.094913 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.095696 17521 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:16.033569 18685 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.094161 17568 leader_election.cc:403] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:16.097877 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.080787 17569 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:16.039726 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.082006 18720 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.071455 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 36) took 1024 ms. Trace:
I20260709 13:18:16.100163 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.094393 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:16.096613 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.100629 17450 rpcz_store.cc:276] 0709 13:18:15.047444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.925195 (+877751us) service_pool.cc:224] Handling call
0709 13:18:15.925473 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.071219 (+145746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.071403 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.025759 18738 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.085170 17419 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:16.077279 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.103291 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 135383us
I20260709 13:18:16.093622 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.109153 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.101060 17528 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:16.090667 17454 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.094234 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.101205 17448 raft_consensus.cc:2376] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3. Re-sending same reply.
I20260709 13:18:16.101409 17521 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:16.091212 17594 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.087062 18198 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.103479 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 864) took 1043 ms. Trace:
I20260709 13:18:16.104404 17568 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:16.117854 18371 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.118630 17568 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.094725 18740 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:16.094465 17527 rpcz_store.cc:276] 0709 13:18:14.988891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.037773 (+ 48882us) service_pool.cc:224] Handling call
0709 13:18:16.044654 (+1006881us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54001def54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:16.044793 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1895004928}
I20260709 13:18:16.076504 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:16.039992 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:16.096508 18166 leader_election.cc:400] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for earlier term 2. Current term is 3.
I20260709 13:18:16.116858 17419 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.111452 18592 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.120019 17568 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:16.170760 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 50804.7us
I20260709 13:18:16.171449 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 867) took 1110 ms. Trace:
I20260709 13:18:16.121732 18371 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.172725 18371 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.117503 17524 rpcz_store.cc:276] 0709 13:18:15.060248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.102493 (+1042245us) service_pool.cc:224] Handling call
0709 13:18:16.102867 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.103089 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.103125 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.103181 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:16.103223 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.103292 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.103414 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.124374 17454 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:16.125195 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.097772 18614 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:16.188830 18614 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:16.189859 18614 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.097903 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:16.069177 18606 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:16.134738 18198 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:16.140244 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.152284 17594 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:16.087544 17520 rpcz_store.cc:276] 0709 13:18:15.054094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.955963 (+901869us) service_pool.cc:224] Handling call
0709 13:18:15.970847 (+ 14884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.998672 (+ 27825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.003743 (+  5071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.013918 (+ 10175us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:16.020031 (+  6113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.028392 (+  8361us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.086883 (+ 58491us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b540014d2d0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:16.087007 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15876992}
I20260709 13:18:16.131884 18723 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:16.091624 17446 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:16.102711 18752 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:16.160403 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 43639.5us
I20260709 13:18:16.105809 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:16.162123 18717 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.162707 18737 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:16.160003 18166 leader_election.cc:403] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:18:16.219750 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 148734us
I20260709 13:18:16.220532 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:16.210942 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 105216us
I20260709 13:18:16.205281 18744 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.207862 18606 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:16.163040 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 141060us
I20260709 13:18:16.158355 17601 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.226596 18699 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:16.194944 18592 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:16.227496 18592 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.165458 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.166052 18738 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.115990 18763 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:16.177405 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.098891 18636 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.172019 17568 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:16.233443 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 61527.3us
I20260709 13:18:16.234117 17568 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:16.126539 18740 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:16.187423 18657 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.171986 17528 rpcz_store.cc:276] 0709 13:18:15.061186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.161379 (+1100193us) service_pool.cc:224] Handling call
0709 13:18:16.161814 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.170982 (+  9168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.171033 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.171096 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:16.171148 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.171229 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.171379 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.188150 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.195696 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.198486 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:16.209139 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 68972.9us
I20260709 13:18:16.141426 18705 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.209506 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.212913 17452 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:16.213011 18766 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:16.213948 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.214409 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 872) took 1145 ms. Trace:
I20260709 13:18:16.209760 18723 raft_consensus.cc:697] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:16.216118 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 869) took 1154 ms. Trace:
I20260709 13:18:16.298108 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.283766 18740 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.126140 18724 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:16.198374 18721 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:16.218858 18717 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:16.283433 18657 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.298049 18737 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:18:16.303382 18717 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.303457 18657 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.162861 18760 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.222967 17569 leader_election.cc:400] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3.
I20260709 13:18:16.210548 17419 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.222950 18687 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for earlier term 2. Current term is 3.
W20260709 13:18:16.304672 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 81876.6us
I20260709 13:18:16.294793 18698 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.209432 18371 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.207397 18714 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.230610 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.320299 17603 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:16.232496 17454 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:16.282294 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 48284.6us
I20260709 13:18:16.322383 17568 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.322906 17595 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:16.218714 18708 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.286391 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.327538 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.218674 18748 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:16.211380 18694 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:16.227541 18735 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.330909 18371 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:16.282851 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:16.197721 18610 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3.
I20260709 13:18:16.333606 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.298135 17526 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:16.224597 18686 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.283562 18761 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:16.281766 18763 raft_consensus.cc:697] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:16.223744 18762 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3.
I20260709 13:18:16.324632 17568 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:16.296639 18634 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:16.298606 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:16.331588 18371 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.342065 18371 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.342520 18371 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.218719 17597 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:16.207194 18764 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.364146 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.298092 18766 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:16.336447 17599 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:16.398072 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 99628.8us
I20260709 13:18:16.319032 18698 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.296429 17520 rpcz_store.cc:276] 0709 13:18:15.069245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.209446 (+1140201us) service_pool.cc:224] Handling call
0709 13:18:16.213847 (+  4401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.214064 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.214093 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.214141 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:16.214174 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.214239 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.214349 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.401165 18698 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.302954 18724 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:16.401933 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.403128 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.403508 18724 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:16.403919 18737 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:16.404103 18634 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.404443 18737 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:16.404551 18634 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:16.404963 18634 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.405335 18737 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.348189 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 873) took 1276 ms. Trace:
I20260709 13:18:16.335059 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.338462 18761 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:18:16.341771 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 109045us
I20260709 13:18:16.401660 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.347358 18708 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.363991 18595 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:16.417434 17522 raft_consensus.cc:2393] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:16.297911 17523 rpcz_store.cc:276] 0709 13:18:15.066078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.211503 (+1145425us) service_pool.cc:224] Handling call
0709 13:18:16.215565 (+  4062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.215755 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.215787 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.215839 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:16.215876 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.215940 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.216058 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.390352 18705 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.337438 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.378396 18750 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.407655 17528 rpcz_store.cc:276] 0709 13:18:15.072008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.334521 (+1262513us) service_pool.cc:224] Handling call
0709 13:18:16.347681 (+ 13160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.347849 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.347877 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.347921 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:16.347953 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.348017 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.348137 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.409080 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:16.407090 18765 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:16.411347 18744 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:16.413223 17452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 961) took 1467 ms (client timeout 1954 ms). Trace:
I20260709 13:18:16.414276 18729 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.414216 18721 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:16.347872 18694 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:16.415303 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.423364 18714 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:16.419049 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.419155 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:16.420194 17453 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:16.326134 18723 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.423429 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.423785 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:16.425127 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.417779 18679 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.427001 17495 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:16.427807 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.446753 17529 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:16.428519 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:16.447499 17524 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.447837 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:16.430480 18574 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:16.408529 18699 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:16.408468 18762 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:16.418834 18708 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.419080 18604 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:18:16.418337 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 207852us
I20260709 13:18:16.433238 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:16.408972 18761 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.448480 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.460424 17419 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.433632 18765 raft_consensus.cc:697] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:16.446070 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.455055 18371 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.459746 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.467171 17595 raft_consensus.cc:2368] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:16.467177 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.469027 17599 raft_consensus.cc:2368] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:16.469345 17524 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:16.456497 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:16.470352 17528 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:16.471553 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:16.471875 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1182) took 1398 ms. Trace:
I20260709 13:18:16.443374 18694 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.443967 18714 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:16.473946 17419 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.474805 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:16.475642 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1181) took 1402 ms. Trace:
I20260709 13:18:16.453619 18595 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.477195 17529 rpcz_store.cc:276] 0709 13:18:15.073172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.458085 (+1384913us) service_pool.cc:224] Handling call
0709 13:18:16.475200 (+ 17115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.475347 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.475376 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.475414 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:16.475441 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.475498 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.475592 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.453881 18705 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:16.448093 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.480265 18371 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:16.464099 17594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:18:16.482209 17594 raft_consensus.cc:606] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:16.454355 18574 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.458163 18708 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.445838 18721 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:16.443621 18729 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:16.432678 17452 rpcz_store.cc:269] 0709 13:18:15.021541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.212361 (+190820us) service_pool.cc:224] Handling call
0709 13:18:16.413045 (+1200684us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54000d84d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:16.413172 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820598144}
I20260709 13:18:16.459089 18750 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.475832 18569 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.482836 18724 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:16.484326 18196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42536 (request call id 105) took 1412 ms (client timeout 1677 ms). Trace:
I20260709 13:18:16.490187 18564 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:16.483345 18705 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.495386 18721 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:16.510768 18705 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.510551 18564 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:16.510250 18196 rpcz_store.cc:269] 0709 13:18:15.062095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.063225 (+  1130us) service_pool.cc:224] Handling call
0709 13:18:16.472590 (+1409365us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b540045a1d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:16.474899 (+  2309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642716416}
I20260709 13:18:16.512419 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.512718 18564 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.513082 17522 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:16.490281 18595 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:16.481644 18687 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.514124 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:16.491925 18570 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.514292 18687 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:16.515237 18595 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:16.515619 17522 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:16.515868 18569 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.516336 18569 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.459797 18699 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.454010 18679 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.463704 18604 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.459847 18762 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.482582 17594 raft_consensus.cc:614] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:16.500748 17526 raft_consensus.cc:1240] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:16.497010 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 42) took 1335 ms. Trace:
I20260709 13:18:16.492143 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.472357 17524 rpcz_store.cc:276] 0709 13:18:15.073485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.471173 (+1397688us) service_pool.cc:224] Handling call
0709 13:18:16.471419 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.471615 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.471636 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.471672 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:16.471697 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.471743 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.471827 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.463352 18733 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:18:16.509025 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 880) took 1433 ms. Trace:
I20260709 13:18:16.430634 18763 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.644063 18570 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.645134 18686 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.516592 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.644773 18570 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.478823 18725 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.475927 18694 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.587908 17419 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.636334 18371 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.479195 18714 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.597190 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.664139 17524 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:16.651634 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.668937 17568 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.489547 18574 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.489948 17523 raft_consensus.cc:2393] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:18:16.495553 17525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 875) took 1422 ms (client timeout 1882 ms). Trace:
I20260709 13:18:16.692328 17599 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:16.456032 18766 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.670764 18371 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:16.483265 18745 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.516794 18750 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.674597 17529 rpcz_store.cc:276] 0709 13:18:15.076039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.478165 (+1402126us) service_pool.cc:224] Handling call
0709 13:18:16.508530 (+ 30365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.508694 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.508715 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.508759 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:16.508787 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.508847 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.508952 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.675860 17527 rpcz_store.cc:276] 0709 13:18:15.161570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.496230 (+1334660us) service_pool.cc:224] Handling call
0709 13:18:16.496563 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.496726 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.496750 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.496789 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:16.496819 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.496867 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.496958 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.557651 18564 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:16.551865 18760 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:16.520306 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.678788 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:16.685168 17568 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:16.699090 18745 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.682998 18600 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:16.689213 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 101434us
I20260709 13:18:16.683830 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:16.643870 18657 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.690902 17603 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:16.706238 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:16.717032 18718 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:16.722157 18729 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:16.723021 18718 raft_consensus.cc:697] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:16.723569 18764 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.723958 18718 consensus_queue.cc:237] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.693892 18748 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.729012 18748 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:16.729517 18748 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.697587 18752 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.732842 18752 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:16.733259 18752 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:16.596609 18584 consensus_meta.cc:287] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.003s
W20260709 13:18:16.490705 17596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52572 (request call id 56) took 1431 ms (client timeout 1756 ms). Trace:
I20260709 13:18:16.696249 17595 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:16.571813 18735 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:16.644793 18687 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:16.616829 18636 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.510272 18724 raft_consensus.cc:697] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:16.692185 17601 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:16.547305 18595 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:16.598395 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 874) took 1525 ms. Trace:
I20260709 13:18:16.744994 17528 rpcz_store.cc:276] 0709 13:18:15.072631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.448336 (+1375705us) service_pool.cc:224] Handling call
0709 13:18:16.470196 (+ 21860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.470727 (+   531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.598130 (+127403us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b54000fee50. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:16.598320 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16703744}
I20260709 13:18:16.669582 18725 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:16.707891 18371 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:16.728405 18592 consensus_meta.cc:287] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.000s
I20260709 13:18:16.704561 18750 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.721329 18717 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.710522 18745 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.684332 18698 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.750133 17598 raft_consensus.cc:2393] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:16.619656 18765 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.771509 18679 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.772430 18679 consensus_queue.cc:1059] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:16.772583 18705 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.712221 18564 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:16.778276 18634 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.780380 18634 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.749683 18725 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.734263 18574 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.743040 18584 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:16.749549 18595 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:16.796665 18569 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.797406 18584 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:16.797843 18595 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:16.781363 18740 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.780987 18761 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:16.746711 18779 consensus_queue.cc:1059] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:18:16.749274 18687 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:18:16.759855 18592 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.737402 18760 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:16.798663 18569 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.861864 18724 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.863394 18570 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.948037 18657 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:16.703120 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 228402us
I20260709 13:18:16.950284 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:16.953050 18699 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:16.912257 17521 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.701201 17522 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:16.955006 18698 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:16.956677 18705 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.956750 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.866851 18740 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:16.912516 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 204834us
I20260709 13:18:16.876286 18760 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.916262 17529 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.974896 18761 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:16.976049 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:16.913308 17526 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:16.922554 17527 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:16.925117 17594 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:16.740007 17596 rpcz_store.cc:269] 0709 13:18:15.059813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.062220 (+  2407us) service_pool.cc:224] Handling call
0709 13:18:16.490488 (+1428268us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400062054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:16.490640 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501899520}
I20260709 13:18:16.928270 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.926882 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:16.793788 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 91428.9us
I20260709 13:18:16.864092 18720 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.944423 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:16.944829 18564 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.948179 18574 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.787863 18748 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.952936 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:16.958189 18705 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.912041 17449 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:16.874186 18762 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:16.876636 18752 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:16.696218 17525 rpcz_store.cc:269] 0709 13:18:15.073191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.769934 (+696743us) service_pool.cc:224] Handling call
0709 13:18:16.495371 (+725437us) spinlock_profiling.cc:243] Waited 90.7 ms on lock 0x7b54000ff854. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:16.495490 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208717184}
I20260709 13:18:16.913298 17451 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:18:16.911126 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 176895us
I20260709 13:18:16.941557 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52572 (request call id 53) took 1908 ms. Trace:
I20260709 13:18:16.867908 18779 raft_consensus.cc:3055] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:16.949620 18592 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:16.964362 18786 log.cc:927] Time spent T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:18:16.964304 18788 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:18:16.984440 18167 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:16.881194 18745 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:16.990161 18717 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:16.992580 17595 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:17.004519 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:17.022512 18708 consensus_meta.cc:287] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.531s	user 0.004s	sys 0.010s
I20260709 13:18:17.081444 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.087080 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.069161 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.080845 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:17.147966 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 195330us
I20260709 13:18:17.141768 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 886) took 1217 ms. Trace:
I20260709 13:18:17.135478 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:17.135218 18748 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:17.108373 18705 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:17.144797 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 884) took 1220 ms. Trace:
I20260709 13:18:17.062250 18474 raft_consensus.cc:3055] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.136072 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.155918 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:17.144129 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 987) took 1051 ms. Trace:
I20260709 13:18:17.147161 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 971) took 1060 ms. Trace:
I20260709 13:18:17.147248 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:17.149861 17569 leader_election.cc:400] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) with higher term. Message: Invalid argument: T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3.
I20260709 13:18:17.176633 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:17.170989 17521 rpcz_store.cc:276] 0709 13:18:15.924337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.596097 (+671760us) service_pool.cc:224] Handling call
0709 13:18:16.596348 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.954384 (+358036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.144514 (+190130us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54002f7e54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:17.144721 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725131648}
I20260709 13:18:17.134584 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.169304 17527 rpcz_store.cc:276] 0709 13:18:15.924765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.705013 (+780248us) service_pool.cc:224] Handling call
0709 13:18:16.705225 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.983053 (+277828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.141352 (+158299us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54001def54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:17.141692 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479894912}
I20260709 13:18:17.179009 17600 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:17.179584 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 47986.3us
I20260709 13:18:17.181190 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.181480 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:17.062000 18604 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:17.135543 18564 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.134824 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:17.089314 18750 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.173657 17449 rpcz_store.cc:276] 0709 13:18:16.092640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.127541 (+ 34901us) service_pool.cc:224] Handling call
0709 13:18:17.143809 (+1016268us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54000da7d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:17.143999 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1463983488}
I20260709 13:18:17.057368 18574 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:17.093638 18725 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:18:17.135586 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 151588us
I20260709 13:18:17.174139 17451 rpcz_store.cc:276] 0709 13:18:16.086857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.086967 (+   110us) service_pool.cc:224] Handling call
0709 13:18:17.146836 (+1059869us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400186ad4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:17.147073 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1896584960}
I20260709 13:18:17.187012 18200 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:17.181238 17602 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.184481 17603 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:17.139567 18745 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:17.175858 18705 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.189484 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:17.190481 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.190685 18646 consensus_queue.cc:1059] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:17.191931 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.193382 17528 raft_consensus.cc:2393] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:18:17.195009 18694 consensus_meta.cc:287] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.500s	user 0.014s	sys 0.002s
I20260709 13:18:17.195477 18694 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:17.195775 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.197232 18752 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:17.187175 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:17.197784 18694 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:17.198966 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.200124 17594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:18:17.201020 17594 raft_consensus.cc:606] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:17.133359 18708 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.203058 18196 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:17.204121 17601 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.209393 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1191) took 1274 ms. Trace:
I20260709 13:18:17.109145 17597 rpcz_store.cc:276] 0709 13:18:15.032660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.036339 (+  3679us) service_pool.cc:224] Handling call
0709 13:18:16.941103 (+1904764us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b5400077bd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:16.941350 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699831168}
I20260709 13:18:17.150205 18779 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:17.174085 18474 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:17.215569 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.214792 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.213694 18201 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:17.212672 18708 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:17.219187 18717 raft_consensus.cc:3055] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:17.220925 18714 consensus_meta.cc:287] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.010s
I20260709 13:18:17.221550 18761 consensus_queue.cc:1059] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.222713 17596 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:17.223737 17594 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.229061 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:17.228458 18717 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:17.224532 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:17.237648 18750 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:17.238126 18761 raft_consensus.cc:3055] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.238874 18725 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:17.231122 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.242146 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.242399 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.241926 18761 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:17.244613 18717 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.230547 17595 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:17.247998 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:17.238884 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.249959 18717 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.245620 18761 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.251581 17451 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 1.
I20260709 13:18:17.253335 17600 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:17.251950 18761 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.254634 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.261996 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.261633 17597 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:17.266974 18744 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.209959 17523 rpcz_store.cc:276] 0709 13:18:15.934900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.726971 (+792071us) service_pool.cc:224] Handling call
0709 13:18:17.132562 (+405591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.133414 (+   852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.133465 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.133564 (+    99us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:17.133641 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.133728 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.209035 (+ 75307us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54001f8950. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:17.209182 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12976,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":301,"spinlock_wait_cycles":869995264}
I20260709 13:18:17.270005 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.270964 17527 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:17.270571 18705 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.273020 18705 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:17.280965 17601 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:17.285845 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.261538 17599 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:17.286615 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.292397 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.297611 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:17.298346 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.299240 17449 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:17.300263 17596 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:17.238991 18474 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.304296 18474 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.247128 18714 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.309966 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.311223 17597 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:17.312624 18714 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:17.313444 17528 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.314283 17603 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:17.315173 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.317399 17598 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.320362 18779 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:17.331633 18748 consensus_queue.cc:1059] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:17.334149 18748 raft_consensus.cc:3055] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.333771 18740 consensus_queue.cc:1059] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:17.334573 18748 raft_consensus.cc:740] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:17.335230 18740 raft_consensus.cc:3055] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:17.335788 18740 raft_consensus.cc:740] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:17.336853 18748 consensus_queue.cc:260] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.339265 18748 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.329517 17419 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:17.343936 17419 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:17.344246 17527 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:17.345203 18679 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:17.345736 18679 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.346195 18679 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:17.353754 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 167332us
I20260709 13:18:17.357963 17599 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.337100 18740 consensus_queue.cc:260] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.359892 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.361822 18714 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:17.363754 18614 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:18:17.364037 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:17.356405 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 117202us
I20260709 13:18:17.369369 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:17.354773 18752 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:18:17.371621 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.372946 18600 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:17.373471 18600 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:17.375728 18740 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.375923 18600 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.380647 17449 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.380334 18725 consensus_queue.cc:1059] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:17.381578 18725 raft_consensus.cc:3055] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:17.381735 18592 raft_consensus.cc:3055] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.382059 18725 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:17.382265 18592 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:18:17.382803 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.383328 18725 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.385111 18725 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.386739 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:17.389456 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1205) took 1040 ms. Trace:
I20260709 13:18:17.389990 17520 rpcz_store.cc:276] 0709 13:18:16.349411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.401369 (+ 51958us) service_pool.cc:224] Handling call
0709 13:18:17.389148 (+987779us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b5400170054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:17.389307 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2148182400}
W20260709 13:18:17.401006 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.416625 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.417249 17450 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:17.402920 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.417702 17449 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:17.403599 18779 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.404381 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.431618 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.433169 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.433820 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.434350 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.434720 17453 raft_consensus.cc:2393] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:18:17.435361 18800 log.cc:927] Time spent T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:18:17.405946 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:17.407783 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.408835 17520 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.411283 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:17.413165 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.414192 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.415009 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.416133 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.418460 17526 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:17.403432 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.420462 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.421185 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.422140 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.422540 18600 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.424443 17351 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40488 (request call id 184) took 5193 ms. Trace:
I20260709 13:18:17.383437 18592 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:17.500268 18801 log.cc:927] Time spent T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:18:17.435953 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:17.529436 17523 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.497599 18167 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:17.563421 17529 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.563870 17449 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.560462 18200 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:17.433218 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.570088 17448 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:17.574717 17451 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:17.504226 17349 catalog_manager.cc:5697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 1 to 3, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 3 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.579885 17445 raft_consensus.cc:2393] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:17.582412 18791 consensus_queue.cc:1059] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:17.583643 18791 raft_consensus.cc:3055] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:17.584020 18791 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:17.584892 18791 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:17.587023 18791 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.565384 18750 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:17.590747 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:17.574481 17450 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:17.596464 18717 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:17.596999 18717 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.597440 18717 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.599007 17419 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:17.601912 18714 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:17.602685 18714 consensus_queue.cc:1059] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:17.603762 18748 raft_consensus.cc:3055] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.604229 18748 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:17.605300 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:17.607460 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:17.497301 18679 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.591560 18196 raft_consensus.cc:2393] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:17.620128 18765 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.620829 17447 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:17.624771 17454 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:17.625514 18564 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:17.626129 18564 raft_consensus.cc:697] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:18:17.626346 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 220525us
I20260709 13:18:17.626739 17445 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.627132 18564 consensus_queue.cc:237] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:17.628693 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.629221 18765 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.629645 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:17.630777 18684 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:17.629653 18194 raft_consensus.cc:2410] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:17.631275 18684 raft_consensus.cc:697] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:17.631645 18765 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:17.620281 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.632694 18199 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:17.632645 18684 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:17.571659 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 133294us
I20260709 13:18:17.634387 18592 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.634673 18694 consensus_queue.cc:1059] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:17.635423 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:17.636955 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.639304 18744 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.640877 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:17.547071 17351 rpcz_store.cc:276] 0709 13:18:12.231346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.231636 (+   290us) service_pool.cc:224] Handling call
0709 13:18:17.424202 (+5192566us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:16.363639 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:16.379270 (+ 15631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:16.379323 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:18:16.379351 (+    28us) tablet.cc:662] Decoding operations
0709 13:18:16.409807 (+ 30456us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:16.409885 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:16.409912 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:16.410450 (+   538us) tablet.cc:701] Row locks acquired
0709 13:18:16.410468 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:16.410605 (+   137us) write_op.cc:270] Start()
0709 13:18:16.410714 (+   109us) write_op.cc:276] Timestamp: P: 1783603096410561 usec, L: 0
0709 13:18:16.410738 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:16.454685 (+ 43947us) log.cc:844] Serialized 2476 byte log entry
0709 13:18:16.964190 (+509505us) op_driver.cc:464] REPLICATION: finished
0709 13:18:17.277720 (+313530us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b18002530c0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:17.277966 (+   246us) write_op.cc:301] APPLY: starting
0709 13:18:17.318683 (+ 40717us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:17.368459 (+ 49776us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:17.370735 (+  2276us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:17.409665 (+ 38930us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:17.409977 (+   312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:18:17.410064 (+    87us) write_op.cc:312] APPLY: finished
0709 13:18:17.410474 (+   410us) log.cc:844] Serialized 52 byte log entry
0709 13:18:17.411897 (+  1423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:17.412143 (+   246us) write_op.cc:454] Released schema lock
0709 13:18:17.412208 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:17.413101 (+   893us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:17.413146 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":245791,"apply.run_cpu_time_us":4058,"apply.run_wall_time_us":135077,"num_ops":6,"prepare.queue_time_us":362189,"prepare.run_cpu_time_us":14740,"prepare.run_wall_time_us":365310,"raft.queue_time_us":91382,"raft.run_cpu_time_us":21744,"raft.run_wall_time_us":304350,"replication_time_us":553032,"spinlock_wait_cycles":4878080,"thread_start_us":888188,"threads_started":4,"wal-append.queue_time_us":218158}]]}
I20260709 13:18:17.642398 18717 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:17.593600 17452 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.620798 17349 catalog_manager.cc:5697] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 2 to 3, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 3 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.647061 17451 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:17.651880 17450 raft_consensus.cc:1240] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:17.654696 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:17.655400 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.656375 18744 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:17.657117 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.658758 17447 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:17.605314 18748 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.685058 18808 raft_consensus.cc:3055] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:17.691399 18808 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:17.692619 18808 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:17.695102 17450 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:17.698176 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.700604 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.700152 17445 raft_consensus.cc:2393] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:17.706176 17529 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:17.706650 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.685041 18694 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:17.720244 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:18:17.705264 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 69221.4us
I20260709 13:18:17.670989 18740 consensus_queue.cc:1059] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:18:17.709410 18808 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:17.732209 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.710400 18748 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.705657 18705 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:18:17.744581 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.733820 18600 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:17.752825 18679 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:17.755473 18201 raft_consensus.cc:2410] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:17.746451 18167 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:17.757833 18811 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.759271 18167 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:17.761560 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.763192 18694 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:17.763695 18694 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.764145 18694 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.774426 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:17.775103 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:17.778429 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.779320 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:17.788166 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:17.786444 17446 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:17.790613 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.799299 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.800465 17599 raft_consensus.cc:2410] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:17.795140 17447 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:17.804291 17450 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:17.792560 18705 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.814402 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:17.815655 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.816612 17603 raft_consensus.cc:2368] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:17.802757 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:17.809438 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:17.819326 18803 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.244s	user 0.002s	sys 0.000s
I20260709 13:18:17.810238 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.810817 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:17.811997 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:17.809046 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.823673 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:17.822891 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.824102 17603 raft_consensus.cc:3055] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:17.826938 17603 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:17.797111 18717 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:17.829483 18679 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:17.831499 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:17.791039 18694 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:17.832684 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.819578 17522 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.831331 18679 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:17.838711 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.839110 18679 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.833789 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.840849 17602 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:17.841792 18740 consensus_queue.cc:1059] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:17.842063 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:17.843279 17595 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:17.843505 18600 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.844316 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.844980 17598 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:17.845378 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:17.801908 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:17.846511 18600 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.847219 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.848039 17420 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:17.848886 18600 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.849897 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:17.850853 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46367.6us
I20260709 13:18:17.853236 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.853330 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:17.854164 18804 log.cc:927] Time spent T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.258s	user 0.003s	sys 0.000s
I20260709 13:18:17.857052 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.857926 17602 raft_consensus.cc:2368] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:17.860030 17452 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:17.859833 18717 consensus_queue.cc:1059] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.860343 18600 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.860942 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:17.861735 18646 raft_consensus.cc:3055] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.852425 17603 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.862188 18646 raft_consensus.cc:740] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:17.862555 17603 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.863224 18646 consensus_queue.cc:260] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.864377 18646 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.864455 18474 consensus_queue.cc:1059] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.870543 18729 raft_consensus.cc:3055] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.870992 18729 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:17.871881 18729 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.872972 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.874936 17454 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:17.882848 17598 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:17.873397 18729 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.887290 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.886761 17603 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:17.889329 17603 pending_rounds.cc:85] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 1
I20260709 13:18:17.887015 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.891669 17448 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.896694 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:17.897066 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.889676 17603 pending_rounds.cc:107] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:17.897567 18592 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.897773 17603 raft_consensus.cc:2889] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:17.898238 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:17.898729 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.899019 18592 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.901789 18592 consensus_queue.cc:1059] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.902979 18592 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.903659 18717 raft_consensus.cc:3055] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.904238 18717 raft_consensus.cc:740] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:17.905746 18717 consensus_queue.cc:260] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.907807 18474 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.908249 18474 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:17.908967 18474 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.910837 18474 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.912223 18200 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:17.913870 18705 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.914662 17529 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.915521 18717 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.873375 18679 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.921290 17445 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:17.923350 18679 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:17.924742 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.925426 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:17.926154 17603 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:17.930987 18694 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:17.929764 17448 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:17.932245 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:17.933648 17448 raft_consensus.cc:1240] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.934741 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:17.935330 18679 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.935876 17452 raft_consensus.cc:1240] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:17.935823 18679 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.936484 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:17.937402 18564 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:17.938109 18564 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:17.938486 18564 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:17.938930 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:17.939018 18564 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.939996 18167 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:17.940860 18779 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.945010 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:17.956321 18813 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:18:17.963544 18474 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:17.964154 18474 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:17.964588 18474 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.960810 18752 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:17.968604 18752 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.971138 18752 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:17.975724 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:17.976503 18200 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:17.976909 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.978478 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:17.980036 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:17.981149 17595 raft_consensus.cc:2393] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:17.980826 18564 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:17.983255 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:17.994673 18474 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:17.960333 18679 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:17.999063 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 54197.2us
I20260709 13:18:17.998517 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:18.002300 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:18.003341 17598 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:18.003533 18474 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:18.009323 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.015702 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:18.016672 17603 raft_consensus.cc:2393] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:18.019198 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:18.021262 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:18.022295 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:18.023499 18200 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:18.024165 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:18.026818 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:18.027951 18817 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:18:18.030671 17603 raft_consensus.cc:2393] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:18.028307 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.031672 17602 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:18.034098 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:18.034729 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 91104.8us
I20260709 13:18:18.035396 17602 raft_consensus.cc:2393] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:18.038707 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:18.040647 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:18.045847 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.047610 18474 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.029722 18564 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:18.053288 17603 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:18.053392 17598 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:18.054293 18779 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.054931 18779 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:18.050853 17495 connection.cc:256] RPC call timeout handler was delayed by -1.2741596620001019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 13:18:18.057641 17495 connection.cc:256] RPC call timeout handler was delayed by -1.1999090130000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 13:18:18.058424 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:18.057152 18684 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:18.062299 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 56543.4us
I20260709 13:18:18.066474 18705 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.069082 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:18.069634 17602 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:18.072286 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:18.074489 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.075814 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:18.075886 18717 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:18.080116 18717 raft_consensus.cc:697] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:18.081646 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:18.081554 18717 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.082384 17524 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:18.083834 17420 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.084687 18166 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:18.084998 17420 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.085556 18694 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.086004 18694 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.086390 18694 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.088066 18729 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:18.088749 18729 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.083014 18748 consensus_queue.cc:1059] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:18.090610 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:18.093586 17420 leader_election.cc:400] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:18.063105 18167 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:18.104614 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 45464.3us
I20260709 13:18:18.102854 17420 leader_election.cc:403] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.091610 18592 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.062091 18684 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.079101 18779 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:18.105742 18564 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.109095 18705 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:18.112411 18705 raft_consensus.cc:697] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:18.113400 18705 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.117573 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:18.113723 18684 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:18.118863 18474 raft_consensus.cc:3055] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:18.125144 18474 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:18.111214 18729 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:18.136502 17420 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.139717 18474 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.128827 18744 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:18.145148 18646 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.146917 18646 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:18.147395 18646 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.147950 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:18.149021 17420 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.146911 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.148994 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:18.147854 18600 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.143749 18744 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:18.158754 17420 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.166599 18744 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.174787 18474 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.154770 18750 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:18.195576 18750 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:18.196156 18750 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.171558 17452 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:18.169548 18694 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.156042 18592 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:18.212954 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 59866.4us
I20260709 13:18:18.208158 18684 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:18:18.198740 18729 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.223456 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:18.223724 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:18.228175 17420 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.234165 17350 catalog_manager.cc:5697] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:18.235711 17350 catalog_manager.cc:5697] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.236904 18684 raft_consensus.cc:3055] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:18.237735 18684 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:18.239168 18684 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.240775 18684 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.241497 18646 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.242602 18729 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.235744 17529 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:18.237383 17350 catalog_manager.cc:5697] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 2 to 3, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 3 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.248591 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.250864 17350 catalog_manager.cc:5697] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:18.252293 17350 catalog_manager.cc:5697] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 2, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 2 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.256573 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.260126 17350 catalog_manager.cc:5697] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 2, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 2 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.261245 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.262166 18825 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:18.261333 18839 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.262732 18825 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.263106 17350 catalog_manager.cc:5697] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.264394 18694 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:18.264946 18825 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:18.265537 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:18.266427 18167 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.266808 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.267504 17452 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.267707 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:18.268535 18779 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:18.269181 18779 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.267023 18761 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:18.258170 17349 catalog_manager.cc:5697] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 1 to 3, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 3 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.270186 18761 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:18.270638 18761 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.269769 17529 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:18.271893 17350 catalog_manager.cc:5697] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 2, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:18.273252 18694 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:18.262766 18839 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:18.276400 18839 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.266829 17569 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.278345 18752 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:18.278810 18752 raft_consensus.cc:697] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:18.279753 18752 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:18.280524 17420 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.281322 18729 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.282050 18729 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:18.282421 18729 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:18.282807 18729 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.284093 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.285071 18823 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.285300 17569 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.287922 18744 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.289170 18839 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:18.291477 18839 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:18.298209 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:18.299844 17598 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:18:18.297501 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 53336.3us
I20260709 13:18:18.302834 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.302909 17420 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.304181 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:18.304872 18600 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:18.305382 17420 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.306057 18600 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:18.291803 17452 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:18.318622 18474 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.306880 18744 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:18.299054 18839 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.323204 18167 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.367290 18839 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:18.367884 18839 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:18.367936 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 44839.7us
I20260709 13:18:18.332042 17524 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:18.314296 18600 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.333608 17569 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.304492 18761 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.332053 18825 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:18.339659 18823 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.340574 18750 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.297847 18614 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:18:18.344550 18815 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.347476 18646 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:18.348738 17420 leader_election.cc:400] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:18.370177 18564 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:18.379362 17420 leader_election.cc:403] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.349079 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:18.350533 18729 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.321837 18694 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:18:18.380534 17351 catalog_manager.cc:5697] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.383895 18474 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:18.383747 17351 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 2 to 3, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 3 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.373809 18825 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:18.387203 17523 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:18.388991 18564 raft_consensus.cc:697] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:18:18.390895 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.391213 18815 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:18.395196 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 61741.3us
I20260709 13:18:18.405243 18600 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.406697 18761 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:18.382074 18838 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:18.413661 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 65130.8us
I20260709 13:18:18.394166 17452 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:18.396798 17351 catalog_manager.cc:5697] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.416850 17351 catalog_manager.cc:5697] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.397488 18825 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.418934 17569 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:18.419054 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 70092.2us
I20260709 13:18:18.421027 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:18.410988 18684 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.421793 17602 raft_consensus.cc:2393] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:18.422210 17351 catalog_manager.cc:5697] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.422724 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:18.423070 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:18.426651 17598 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:18.427250 18564 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.430398 18750 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:18.431957 18846 consensus_queue.cc:1059] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:18.432454 18729 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:18.432842 18846 raft_consensus.cc:3055] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:18.432953 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:18.433270 18846 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:18.433586 18197 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.434118 18846 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.435220 18815 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:18.435356 18846 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.436543 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:18.438730 18838 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.444423 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.444761 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:18.447635 18705 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.449155 18197 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:18.449918 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:18.450444 17569 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.450721 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:18.456110 17529 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:18.442268 18708 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:18:18.457172 18838 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.457398 18708 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:18.457777 18708 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:18.458657 18708 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.459858 18708 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.452095 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:18.453739 18825 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:18.461901 18843 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.004s
I20260709 13:18:18.464926 18825 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:18.456491 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.466208 18815 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.466581 18815 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:18.466965 18815 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.471472 18694 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.471958 18694 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.473317 17445 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:18.476074 18600 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:18.477324 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:18.479436 18614 consensus_queue.cc:1059] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.479691 18761 consensus_queue.cc:1059] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.480412 18845 consensus_queue.cc:1059] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:18.480633 18761 raft_consensus.cc:3055] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:18.480569 18614 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:18.481127 18761 raft_consensus.cc:740] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:18.481376 18845 raft_consensus.cc:3055] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:18.481761 18845 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:18.482200 18752 raft_consensus.cc:3055] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:18.482577 18752 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:18.482678 18845 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.483492 18752 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.484234 18845 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.484913 18752 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.486515 17454 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:18.486757 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:18.487353 17448 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:18.487950 17569 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.488046 18614 consensus_queue.cc:1059] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.489136 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.489357 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:18.489648 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:18.491830 18761 consensus_queue.cc:260] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:18.492285 17352 catalog_manager.cc:5697] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 2 to 3, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 3 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.494347 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:18.495070 17453 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:18.495160 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.496045 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.496826 17453 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:18.496932 17448 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:18.497625 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.498170 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.492583 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.501312 17454 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:18.506569 17453 raft_consensus.cc:2393] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:18.519397 17446 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:18.514463 18838 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.522040 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:18.523289 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:18.523891 17603 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:18.524268 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:18.525065 18600 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:18.525578 18600 raft_consensus.cc:697] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:18.526269 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.527148 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:18.527336 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.474009 18694 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:18.555405 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:18.550616 18838 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.559016 17529 raft_consensus.cc:1240] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:18.564817 18646 consensus_queue.cc:1059] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:18.565855 18646 raft_consensus.cc:3055] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:18.566241 18646 raft_consensus.cc:740] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:18.567250 18646 consensus_queue.cc:260] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.567934 18839 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.568840 18646 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.572320 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.572705 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.555701 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:18.575045 17447 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:18.576299 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:18.577013 17445 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:18.577977 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:18.579231 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.580912 18761 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.585207 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.526436 18600 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.590422 17454 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
W20260709 13:18:18.593674 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 72448.6us
W20260709 13:18:18.590891 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 101804us
I20260709 13:18:18.595322 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.592063 17453 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:18.553462 18684 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.597128 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:18.597278 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:18.599593 17569 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.608922 17451 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:18.610601 17454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "2158c0f750fd4b21afe24135c52167b2"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:18:18.611500 17454 raft_consensus.cc:606] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Received request to transfer leadership to TS 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:18.611955 17454 raft_consensus.cc:614] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:18.613544 17453 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:18.617362 18841 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:18.588541 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:18:18.618479 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 67268.7us
I20260709 13:18:18.618557 18694 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:18.619060 18694 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.619405 18694 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:18.620564 18823 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.621238 18823 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:18.621600 18823 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:18.621351 18199 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:18.637933 17452 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:18.639607 17452 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:18.639890 18815 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.622469 18835 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:18:18.597863 18744 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:18:18.641985 18815 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:18.649070 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.635310 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:18.607100 18839 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:18.625795 17448 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:18.657383 17448 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:18.660277 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:18.617970 18841 raft_consensus.cc:697] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:18.623127 18684 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.621985 18823 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.641045 17452 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:18.679075 17447 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:18.663304 18825 raft_consensus.cc:3055] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:18.664711 17446 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
W20260709 13:18:18.671291 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 74218.2us
W20260709 13:18:18.676743 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 77223.3us
I20260709 13:18:18.683502 17569 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.675948 18684 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:18.681614 18825 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:18.694980 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.698276 17351 catalog_manager.cc:5697] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 1 to 4, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 4 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.691112 18684 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.707427 18857 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:18.694206 18815 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:18.709071 18708 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:18.709668 18845 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:18.701050 18839 consensus_queue.cc:1059] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:18:18.711422 17569 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.712311 18854 consensus_queue.cc:1059] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:18.722589 18841 consensus_queue.cc:237] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.725581 18761 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:18.738572 18815 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:18.745561 18823 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.746567 18839 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:18.747056 17569 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.747246 18850 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:18.755004 18815 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.782166 18825 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.783883 18825 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.747059 18614 raft_consensus.cc:3055] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:18.784999 18614 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:18.786307 18614 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.788231 18614 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:18.797535 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 108003us
I20260709 13:18:18.800628 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:18.802852 17350 catalog_manager.cc:5697] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.812846 17602 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:18.805075 18646 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.819566 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:18.812369 18850 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:18.811753 18717 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:18.812271 18838 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.824374 18850 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.829221 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:18.846278 18197 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.846355 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:18.847674 18705 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:18.761641 18839 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.822386 17602 raft_consensus.cc:1240] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:18.845300 18857 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.836288 17450 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:18.832448 18646 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.842877 18823 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:18.855039 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 108075us
I20260709 13:18:18.917364 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:18.920171 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:18.921885 17529 raft_consensus.cc:2393] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:18.927870 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:18.848747 18717 raft_consensus.cc:697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:18.876718 18857 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:18:18.883051 18197 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:18.936359 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:18.900729 18708 raft_consensus.cc:3055] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:18.875556 18845 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:18.849295 18705 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:18.920431 18839 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:18.906337 18646 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:18.850528 18694 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.938794 17569 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:18.933138 18868 consensus_queue.cc:1059] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 13:18:18.942193 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 66337.5us
I20260709 13:18:18.937634 18750 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:18.937824 18856 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.948613 17495 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:18.941408 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:18.942518 18708 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:18.956696 18200 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:18.944583 18761 raft_consensus.cc:697] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:18.958981 18857 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.959466 18708 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.962404 17450 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:18.963284 18708 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.949602 18750 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:18.961961 18717 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:18.965243 18750 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.943982 18199 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:18.964497 18846 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:18.970674 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:18.971755 18729 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.972160 18729 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.954942 18868 consensus_queue.cc:1243] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:18.972656 18729 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.973516 18839 raft_consensus.cc:3055] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:18.973927 18839 raft_consensus.cc:740] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:18.961644 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:18.974956 18839 consensus_queue.cc:260] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.975582 18694 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:18.975780 18860 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.976514 18839 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.978067 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:18.978552 18705 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.980194 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:18.965384 18684 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.981853 17523 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:18.981844 18860 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.983100 18860 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:18.983474 18860 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.944979 18845 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.971998 18815 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.987032 18841 raft_consensus.cc:3055] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:18.987522 18841 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:18.988399 18841 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:18.989205 17601 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:18.991578 17529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "2158c0f750fd4b21afe24135c52167b2"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:18.992166 17529 raft_consensus.cc:606] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Received request to transfer leadership to TS 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:18.986119 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:18.994297 17603 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.000108 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:18.947429 18838 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:19.002725 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 64009.5us
I20260709 13:18:19.003767 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:19.015245 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:19.016404 17524 raft_consensus.cc:2393] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:18.995191 18841 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.998188 18850 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:19.021404 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:19.022554 17595 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:19.022323 18717 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.008496 18684 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:19.013725 18815 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:19.029879 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:19.022917 18761 consensus_queue.cc:237] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.031071 18717 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.024736 18705 consensus_queue.cc:1059] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:18:19.031903 18600 consensus_queue.cc:1059] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:19.032680 18750 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.019424 18850 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:19.033540 17569 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.044140 18600 consensus_queue.cc:1243] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer 2158c0f750fd4b21afe24135c52167b2 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:19.044657 18600 raft_consensus.cc:3055] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:19.044832 17569 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.028599 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:19.012465 17352 catalog_manager.cc:5697] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65), VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66), VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67), NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 3 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:19.046977 18717 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:19.047210 18863 raft_consensus.cc:3055] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:19.047667 18863 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.025456 18868 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.048578 18863 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.049669 18744 consensus_queue.cc:1059] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:19.049808 18863 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.050884 18705 raft_consensus.cc:3055] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:19.051246 18705 raft_consensus.cc:740] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.052157 18705 consensus_queue.cc:260] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.055387 18868 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:19.056047 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:19.057030 17569 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.057824 18865 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:19.057818 18705 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.058559 18865 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:19.056137 18868 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.043753 18684 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:19.037142 18845 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:19.037006 18646 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:19.020171 18857 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.038316 18835 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:19.040100 17601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:18:19.045001 18600 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:19.033798 17603 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:19.061957 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:19.064657 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:19.068358 17349 catalog_manager.cc:5697] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 4, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 4 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.097803 17349 catalog_manager.cc:5697] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.073648 18600 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:19.104292 18600 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.071415 18646 raft_consensus.cc:3055] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:19.065073 18868 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:18:19.110504 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 48637.3us
I20260709 13:18:19.111900 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:19.066876 18850 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.083717 18750 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:19.115316 18841 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:19.115840 18841 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:19.116310 18841 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.118155 18856 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.118789 18856 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.121027 18856 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:19.122843 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:19.104923 18845 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:19.124781 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:19.125383 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 60800.8us
I20260709 13:18:19.126345 18744 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:19.127187 17529 raft_consensus.cc:3055] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:19.127928 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:19.075460 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:18:19.135905 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 60672us
I20260709 13:18:19.122103 18876 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:19.138525 18876 raft_consensus.cc:697] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.139935 18808 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:19.139577 18876 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.140528 18808 raft_consensus.cc:697] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:19.130960 18846 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:19.141351 18808 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:19.142405 18846 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:19.143879 18729 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:19.108466 18646 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:19.146150 18846 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:19.134125 18744 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.146579 18646 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.147137 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:19.147447 18744 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.133093 17529 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.148118 17525 raft_consensus.cc:2393] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:19.148033 18646 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.148972 17529 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:19.146637 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:19.150725 17445 raft_consensus.cc:2393] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:19.110042 18868 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.152534 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:19.153067 18200 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.154242 18729 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:19.149996 17529 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.157199 17569 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.158636 18167 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.160171 18846 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.161903 17349 catalog_manager.cc:5697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 4, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 4 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.163777 18845 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:19.164564 18845 raft_consensus.cc:697] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:19.165664 18845 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:19.121984 18717 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.168960 18717 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.170423 17420 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.171265 18474 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:19.171648 18474 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:19.171995 18474 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.172757 18717 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:19.173746 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:19.176206 18199 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:19.177630 17445 raft_consensus.cc:1240] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:19.166126 18200 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:19.181529 18474 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.186487 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:19.184180 18846 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.193910 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:19.194168 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:19.194530 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:19.196139 17601 raft_consensus.cc:606] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.196797 17601 raft_consensus.cc:614] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:19.198391 17529 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:18:19.199122 17529 pending_rounds.cc:85] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 4
I20260709 13:18:19.199461 17529 pending_rounds.cc:107] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:18:19.199811 17529 raft_consensus.cc:2889] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:19.212036 18841 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.214862 18474 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:19.203038 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 78370.3us
I20260709 13:18:19.218107 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:19.222487 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:19.223224 17446 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:19.223915 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:19.210376 18717 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:19.216899 17445 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:19.126152 18860 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.245898 18860 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:19.222558 18856 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:19.246897 18200 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:19.246855 18856 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.249115 18856 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:19.230923 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.231281 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:19.232592 18708 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:19.213608 18875 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:19.234122 17598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:18:19.251330 17598 raft_consensus.cc:606] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:19.229859 18808 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:18:19.251883 17598 raft_consensus.cc:614] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:19.253271 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:19.236593 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:19.256316 18474 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:19.222323 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:19.236851 17529 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:19.238058 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.238718 18841 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:19.239063 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.239544 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:19.268520 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.240067 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.271571 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:19.272296 18875 raft_consensus.cc:697] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.273413 18875 consensus_queue.cc:237] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.240605 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:19.241070 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:19.274791 17599 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:19.275434 17525 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:19.269882 17595 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:19.241145 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:19.241437 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.227178 18863 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.242772 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.277789 17419 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:19.243391 18717 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:19.258741 17602 raft_consensus.cc:2410] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:19.280875 17601 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:19.256044 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:19.261029 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.273808 17349 catalog_manager.cc:5697] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 4 to 5, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 5 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.283906 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:19.284613 17602 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:19.285349 18474 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:19.285815 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:19.285933 18474 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.286537 18474 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.289884 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:19.289975 17600 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:19.299947 17446 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:19.309897 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.311126 17603 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:19.312357 17601 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.245785 18868 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:19.258265 18708 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.320719 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:19.324297 17603 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:19.325502 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:19.326455 17447 raft_consensus.cc:2393] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:19.322122 18474 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.329392 18474 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:19.331935 17452 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:19.280373 18839 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:18:19.337185 18717 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:19.346252 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.348801 17420 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.350242 17495 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:19.301834 18705 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:19.343662 17352 catalog_manager.cc:5697] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 2, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.294450 18841 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:18:19.296325 18744 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:18:19.365711 17352 catalog_manager.cc:5697] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 2, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.297755 18860 consensus_queue.cc:1059] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:18:19.394166 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:19.378683 18863 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:19.384871 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:19.394958 18860 raft_consensus.cc:3055] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:19.395401 18860 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.367547 18705 raft_consensus.cc:697] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.388729 18708 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:19.389947 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:19.399303 17601 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:19.390286 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:19.390735 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:19.399998 17447 raft_consensus.cc:2393] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:19.400395 17450 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:19.391451 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:19.323498 18857 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:18:19.378610 17420 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.382341 18868 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:19.394304 18684 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:19.403153 18600 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:19.403260 18684 raft_consensus.cc:697] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.404270 18684 consensus_queue.cc:237] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.386194 18850 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:19.396410 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 118703us
W20260709 13:18:19.406006 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.402645 17420 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:19.398365 17569 consensus_peers.cc:597] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e57fe371976a485bbdedfdaa4659dec3. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:19.407603 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 52373.5us
I20260709 13:18:19.408318 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.409519 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.409927 18474 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.410565 18474 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.410676 17420 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.412431 17420 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.412897 18474 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.413291 18474 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.413684 18474 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.364228 18729 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:19.423103 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.425911 17569 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.427670 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.421684 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:19.436568 17452 raft_consensus.cc:2393] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:19.440845 18474 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.420002 18708 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:19.434558 17525 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:19.431810 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:19.432829 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 115836us
I20260709 13:18:19.442652 17523 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.443704 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:19.443645 17568 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:19.446080 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.448843 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.433818 18839 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:19.451006 17569 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.455797 18474 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:19.453291 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:19.434361 18761 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.454690 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:19.446882 18708 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:19.457531 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 45183.1us
I20260709 13:18:19.450476 18815 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:19.422626 18856 consensus_queue.cc:1059] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:18:19.459026 17569 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.452980 18875 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:19.460672 17420 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.421201 18860 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.457916 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:19.455708 18865 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.457078 18838 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:19.455137 18850 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:19.463068 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:19.459271 18876 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:19.458159 18761 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:19.471865 18761 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.471807 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.473049 17594 raft_consensus.cc:2393] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:19.474434 18860 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.476181 17594 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:19.477797 17351 catalog_manager.cc:5697] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 2, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 2 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.465814 18200 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:19.483788 17598 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:19.484725 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.485891 18839 raft_consensus.cc:3055] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:19.465714 18474 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:19.468401 18888 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:18:19.469007 18885 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.469735 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.494825 17602 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.470770 17603 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:19.470999 18866 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.465584 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.496511 17351 catalog_manager.cc:5697] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.464670 18870 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:19.494174 18889 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:19.479580 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.465541 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.459522 18868 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:18:19.499589 17600 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:19.499907 17594 raft_consensus.cc:2393] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:19.498381 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.464851 18815 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:19.486378 18839 raft_consensus.cc:740] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:18:19.503754 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.487617 18876 raft_consensus.cc:697] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.504527 18891 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.505637 18885 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:19.505897 18845 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.502892 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.507999 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.510653 18744 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:19.536788 17569 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.537945 17569 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.539113 17569 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.511075 18835 consensus_queue.cc:1059] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:19.545368 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:19.514829 18863 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:19.514979 18815 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:19.480197 18875 raft_consensus.cc:697] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.518748 18808 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.541213 18474 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:19.459255 18705 consensus_queue.cc:237] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.540671 18870 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.572002 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:19.615199 18870 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:19.615744 18870 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.584129 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.618312 17594 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.584712 17603 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.587414 17602 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:19.569736 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:19.538925 18825 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.604573 17452 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:19.602973 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:19.608552 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:19.641752 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:19.642652 18200 raft_consensus.cc:2393] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
W20260709 13:18:19.609658 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 93328.2us
I20260709 13:18:19.610076 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:19.541095 18885 raft_consensus.cc:697] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:19.570221 18891 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:19.571102 18856 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:19.612866 17448 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:19.669159 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46721.9us
I20260709 13:18:19.674309 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:19.641328 18850 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.632702 17420 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:19.678253 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 45643.6us
I20260709 13:18:19.606771 18845 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.629156 17450 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:19.677098 17449 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:19.658618 18866 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.663415 18865 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.683529 18717 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.672024 18900 raft_consensus.cc:3055] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:19.686954 17603 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:19.671193 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:19.708091 17596 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.682682 18889 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.712862 18750 raft_consensus.cc:993] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: : Instructing follower 2158c0f750fd4b21afe24135c52167b2 to start an election
I20260709 13:18:19.713357 18889 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:19.713424 18750 raft_consensus.cc:1081] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Signalling peer 2158c0f750fd4b21afe24135c52167b2 to start an election
I20260709 13:18:19.631541 18808 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:19.719431 17529 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.705051 18875 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.697197 18900 raft_consensus.cc:740] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.694010 18866 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.723853 17603 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:19.629973 18839 consensus_queue.cc:260] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.657814 18876 consensus_queue.cc:237] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:19.761294 17529 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:18:19.769958 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 126504us
I20260709 13:18:19.777958 18474 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:19.778685 18474 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.748250 18897 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:19.785907 18839 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.763942 18750 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.797765 18897 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.804672 18474 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:19.806439 18897 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:19.807096 18899 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:18:19.806492 18893 log.cc:927] Time spent T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:18:19.809227 18870 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:19.809549 18750 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:19.853770 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 81728.2us
W20260709 13:18:19.864053 18895 log.cc:927] Time spent T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 13:18:19.864245 18894 log.cc:927] Time spent T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:18:19.879662 17451 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:19.885864 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:19.831036 18846 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:19.785375 18885 consensus_queue.cc:237] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:19.835791 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 92543.3us
I20260709 13:18:19.900604 18808 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:19.833211 18904 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:18:19.839594 18761 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.917148 17594 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:19.815506 18900 consensus_queue.cc:260] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.887146 18835 consensus_queue.cc:1059] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:18:19.919952 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:19.892436 18889 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:19.895936 18897 consensus_queue.cc:1059] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:18:19.932575 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 169041us
I20260709 13:18:19.911052 17523 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:19.938828 18474 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:19.938876 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.916318 18863 consensus_queue.cc:1059] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:18:19.939375 18474 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:19.941246 17419 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:19.947103 17524 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:19.950903 17602 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:19.951418 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:19.933261 18900 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.954907 17594 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:19.952312 17529 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:19.957864 17602 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:19.960711 17602 raft_consensus.cc:1240] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:19.949116 18860 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:19.948498 18708 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.948963 18752 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.968160 18926 raft_consensus.cc:3055] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:19.964493 18200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def"
dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
 from {username='slave'} at 127.0.0.1:42536
I20260709 13:18:19.969210 18200 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:19.992508 18200 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.968724 18926 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:19.999444 18474 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.003526 17601 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:20.004762 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.007133 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.007824 17521 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:20.008858 17594 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.005439 17524 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:19.965233 18866 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:20.012590 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.018997 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:20.012657 17419 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:20.022403 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.023167 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:20.026954 18474 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.028134 18474 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.032279 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.033017 17524 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:19.992820 18708 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.013962 18903 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:20.082826 17601 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:20.035363 17419 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.083958 18708 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:20.081113 18200 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:20.081569 18474 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.085058 18474 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.085407 18474 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.085752 18474 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:20.086441 18927 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:18:19.998231 18752 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:20.109462 17445 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:20.013059 18870 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.044389 17600 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:20.103039 18166 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:20.123485 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 80014.4us
I20260709 13:18:20.125260 18911 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.125752 18911 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.126145 18911 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.127852 18916 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.128379 18916 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:20.131433 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:20.132242 17524 raft_consensus.cc:3055] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:20.133108 18474 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.135324 18845 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:20.135744 18870 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:20.132627 17524 raft_consensus.cc:740] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:20.142086 18761 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:20.148972 17594 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:20.080685 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.028957 17523 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:20.007696 18926 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:20.110388 18808 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.028053 18891 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:20.113751 18200 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:20.114981 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 91906.3us
I20260709 13:18:20.172832 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:20.082772 18903 raft_consensus.cc:697] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:20.033910 18835 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:20.137831 18870 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:20.145015 17524 consensus_queue.cc:260] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:20.137939 18841 raft_consensus.cc:3055] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:20.175992 17568 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.178607 17529 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:20.180842 17524 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.188647 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:20.189147 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.152566 18825 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:20.176553 18841 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:18:20.215014 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 54974.3us
I20260709 13:18:20.181730 18808 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:20.221809 18928 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:18:20.230998 18808 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.232195 18750 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:20.175626 18889 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:20.184092 17596 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:20.176011 18891 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.235126 18200 raft_consensus.cc:1240] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:20.220149 18926 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.247030 17603 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:20.195016 18845 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:20.167514 18705 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:20.181123 18868 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.181005 18684 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:18:20.200169 18870 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:18:20.194715 18835 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.237274 17524 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:20.214983 18838 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.233484 18911 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:20.228466 18729 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.226627 18923 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.221537 18897 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:20.241225 18928 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:20.249727 18708 consensus_queue.cc:1059] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:18:20.258299 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:20.221094 18913 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:20.227980 18752 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:20.249500 18839 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.248739 18891 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.249572 18845 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:20.256078 18705 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:20.252306 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:20.247555 18841 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.282881 18845 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.261832 18868 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.283051 18839 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.286254 17569 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:20.289605 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.290510 17529 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:20.292179 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.285799 18199 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:20.280417 18897 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:20.282648 18752 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:20.283692 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:20.277030 18838 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.285624 18705 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.277793 18729 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:20.293906 18841 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.281633 18166 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.287518 18197 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:20.295961 18761 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.278669 18928 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.296190 18856 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:20.301684 18196 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:20.316396 18897 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.335916 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:20.336499 18916 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.318641 18932 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:20.228415 18903 consensus_queue.cc:237] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.277994 18923 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.295575 18913 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.347370 18888 consensus_queue.cc:1059] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:20.326050 18839 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:20.326629 18928 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:20.327144 18729 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.328444 18835 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.328739 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.329443 18911 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.330097 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:20.328440 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.309724 18705 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.344393 18750 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:20.325598 18866 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.344389 18932 raft_consensus.cc:697] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:20.349347 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:20.349725 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.324424 18761 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.306143 18708 consensus_queue.cc:1059] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:18:20.354218 18923 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.356016 17524 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:20.358582 17598 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:20.359109 17595 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:20.364315 17599 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:20.347884 18197 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:20.348335 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:18:20.373202 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 337885us
I20260709 13:18:20.372051 17528 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:20.420065 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:20.396355 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.420791 17529 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:20.421607 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.423645 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:20.424114 18708 raft_consensus.cc:3055] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:20.424364 17528 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.424634 18708 raft_consensus.cc:740] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:20.426647 17568 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.427831 18870 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.428417 18870 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.431156 18870 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:20.431934 18870 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:20.432518 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 84257us
I20260709 13:18:20.439009 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:20.435087 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:20.377034 18761 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.437590 17419 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.440857 17600 raft_consensus.cc:2393] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:20.444963 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:20.363031 18928 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.351505 18684 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
W20260709 13:18:20.457790 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.491743 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.492288 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.438372 18870 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:20.493449 18870 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.499048 17528 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:20.500572 17419 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.501928 18717 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:20.436285 18923 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.467783 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:20.510553 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:20.367219 18866 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.412811 18850 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:20.507773 17600 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:20.451499 18646 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:20.436123 18729 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.553078 18945 ts_tablet_manager.cc:933] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.449573 18856 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:20.518251 17597 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:20.505550 18926 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:20.420209 18888 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.129s
W20260709 13:18:20.543634 18876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.000s	sys 0.042s
I20260709 13:18:20.554772 18646 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.517494 18860 raft_consensus.cc:697] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:20.519659 18717 raft_consensus.cc:697] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:20.555402 18850 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.563943 18926 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:18:20.567724 18164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.002s	sys 0.033s
I20260709 13:18:20.557233 18839 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:20.560981 18729 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.569103 18904 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.557750 18923 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.570744 18932 consensus_queue.cc:237] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:20.571169 18708 consensus_queue.cc:260] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:20.576277 18838 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:20.503613 18928 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:20.561720 18913 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.369248 18845 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:20.579187 18876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.000s	sys 0.043s
I20260709 13:18:20.563678 18868 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:20.567459 18902 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.563290 18856 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.569139 18866 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:20.583833 18646 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.583657 18825 raft_consensus.cc:3055] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:20.561561 18166 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.598471 18839 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:20.600730 18900 consensus_meta.cc:287] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.000s
I20260709 13:18:20.613835 18729 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.614959 18902 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.615516 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.615370 18717 consensus_queue.cc:237] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.590653 18870 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.606281 18815 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.625801 17351 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.613822 18928 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:20.619431 18856 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:20.629299 17528 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:20.619881 18825 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:20.626251 18839 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.603559 18904 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.607625 18891 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.633059 18600 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.630069 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 75510us
W20260709 13:18:20.678762 17417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.008s	sys 0.014s
W20260709 13:18:20.681213 17417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.009s	sys 0.014s
I20260709 13:18:20.622843 18926 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.683228 18903 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:18:20.723615 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.723531 18926 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:20.724696 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.725411 18910 log.cc:927] Time spent T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.604s	user 0.003s	sys 0.000s
I20260709 13:18:20.730232 18903 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:20.684490 18885 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.657759 18815 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:20.739711 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 313184us
I20260709 13:18:20.644168 18860 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.746752 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:20.741734 18846 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.733841 18903 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:20.744089 18885 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.711066 18600 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.798913 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.803355 17529 raft_consensus.cc:2393] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:20.721730 18825 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.799497 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.806167 17524 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:20.766188 18928 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.805179 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.807935 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.811357 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.811661 17528 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:20.811970 17529 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:20.811420 17521 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
W20260709 13:18:20.803946 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 452819us
I20260709 13:18:20.774379 18923 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.817180 18940 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.817417 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.817633 18900 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:20.818699 18942 log.cc:927] Time spent T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:18:20.819052 18937 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.819478 18948 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.819932 18876 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:20.822813 18600 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.825438 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:20.828502 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:20.766480 18846 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:20.831851 17521 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:20.832458 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:20.835476 18646 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:18:20.839519 18944 log.cc:927] Time spent T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:18:20.840492 18904 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:20.840809 18914 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:18:20.842290 18891 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.782321 18845 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:20.868773 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.841863 18835 raft_consensus.cc:3055] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:20.890733 17524 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:20.887566 17419 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.815577 18870 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:20.900349 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 85407us
I20260709 13:18:20.844698 18868 raft_consensus.cc:2955] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:18:20.892189 18705 consensus_meta.cc:287] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.526s	user 0.003s	sys 0.007s
I20260709 13:18:20.803665 18945 tablet_copy_client.cc:323] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:18:20.916400 17526 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.871578 18916 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:20.913931 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.890324 18923 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.926968 17446 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:20.929005 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:20.929774 17446 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
I20260709 13:18:20.898382 18835 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:20.930720 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:20.897934 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 85203.3us
I20260709 13:18:20.895141 18600 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:20.935587 17419 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.945622 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:20.946127 17603 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:20.946396 17601 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:20.935976 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.894254 17596 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:20.931622 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:20.913825 18891 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.872732 18928 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:20.948320 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.949545 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:20.866230 18940 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:20.942271 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:20.957260 17452 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:20.920269 18902 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:20.958941 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:20.966318 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.924875 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:20.939438 18913 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:20.985126 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.986238 17568 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.988029 17568 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.885576 18937 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.990820 17568 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:20.991164 17603 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:20.993597 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:20.994357 17446 raft_consensus.cc:2393] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:20.911839 18914 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:18:20.953840 18841 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:20.891935 18948 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.954393 18891 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.975370 18903 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:20.939610 18926 consensus_queue.cc:1059] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:18:21.005021 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.009399 17529 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:21.011229 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.012116 17449 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:20.938716 18923 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:20.985105 18815 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:20.991885 18907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.012s	sys 0.032s
I20260709 13:18:20.931999 18916 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:21.017019 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.033118 17452 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:20.995908 18876 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:20.984107 18913 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:21.001094 18841 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:21.003875 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:21.025945 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.013404 17568 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:21.000706 18897 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.997431 18955 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:20.995064 18870 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:21.048193 18870 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.048736 18870 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.050333 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.051242 17452 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:21.039183 18708 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.999507 18935 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:21.029645 18907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.012s	sys 0.032s
I20260709 13:18:21.004456 18903 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.053331 18935 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.053930 18903 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.005460 18891 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.995249 18196 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:21.056227 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:21.042589 18761 consensus_meta.cc:287] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.004s
I20260709 13:18:21.039114 17445 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:21.041150 18913 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:21.019853 18954 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:18:21.033471 18956 log.cc:927] Time spent T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.100s	user 0.002s	sys 0.000s
I20260709 13:18:21.045357 18955 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.017077 18952 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:21.107594 17526 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:21.073688 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.155961 17526 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:21.078894 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 65595.9us
I20260709 13:18:21.063349 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:21.044773 18684 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:21.041419 18841 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.139077 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.172358 17449 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:20.955657 18600 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.158190 17528 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:21.094877 18946 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:18:21.061934 18845 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.162328 18963 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:21.056352 18897 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.154456 18952 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.155260 18955 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.165107 18966 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:18:21.165584 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.137029 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:21.093750 18846 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.167096 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.170415 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.171051 17568 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:21.199613 17452 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:21.088951 18953 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:21.096007 18947 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:18:21.149943 18646 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.191407 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:21.222581 17449 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:21.223412 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:21.225523 18839 consensus_meta.cc:287] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.002s
I20260709 13:18:21.225936 18839 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:21.227874 18839 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:21.228477 17600 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:21.213313 17451 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:21.205399 18928 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.233136 18923 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.236485 17451 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:21.238142 18897 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.238544 18916 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.203343 18953 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.239352 18953 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.239533 18940 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.178728 18684 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.053987 18850 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.200487 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:21.243333 17446 raft_consensus.cc:2393] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:21.243393 17528 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:21.139770 18761 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.182644 18935 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.055437 18960 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.278s
I20260709 13:18:21.193707 18963 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.252772 18963 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.195596 18952 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.204069 18937 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.206887 18838 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.258641 18838 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.260895 18838 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.207417 18815 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:21.262123 18600 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:21.218689 18950 log.cc:927] Time spent T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:18:21.217936 17452 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:21.212877 17447 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:21.244459 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.040275 18876 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.240309 17599 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:21.254621 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.262387 18948 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.266888 18646 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.268576 18646 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.268980 17446 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:21.254266 18923 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:21.270314 18825 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:21.264092 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 107870us
I20260709 13:18:21.192574 18845 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.272284 17451 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:21.275350 17447 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:21.276868 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 71556.8us
I20260709 13:18:21.276368 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.278775 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.279629 17525 raft_consensus.cc:2410] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:21.270474 18923 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.264401 18935 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.264468 18963 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:21.264572 18815 raft_consensus.cc:697] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:21.270603 18646 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.267117 18600 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.284189 17420 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:21.283176 18838 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.293188 18935 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.293533 18838 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:21.285707 18964 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.294394 18964 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.275930 18902 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:21.276207 18940 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:21.295560 18838 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.316237 18923 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.317265 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:21.285801 17597 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:21.277828 18937 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.323438 17520 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:21.295449 18935 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.281461 18717 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.283041 18948 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:21.324759 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.296257 17447 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:21.343355 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.346935 17520 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:21.316340 18943 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:18:21.291777 18963 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.348039 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.340937 18955 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.420948 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.455941 17568 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:21.364892 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 83) took 1045 ms. Trace:
I20260709 13:18:21.385327 18474 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.488502 17602 rpcz_store.cc:276] 0709 13:18:20.320021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.320405 (+   384us) service_pool.cc:224] Handling call
0709 13:18:20.320816 (+   411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:20.321220 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.321245 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:20.321853 (+   608us) log.cc:844] Serialized 52 byte log entry
0709 13:18:20.778532 (+456679us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:20.778590 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.778684 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.364666 (+585982us) raft_consensus.cc:1685] finished
0709 13:18:21.364689 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.364832 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":456181,"threads_started":1,"wal-append.queue_time_us":659532}
I20260709 13:18:21.329059 18923 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:21.362498 17528 raft_consensus.cc:2955] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:21.492729 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.491849 17568 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:21.325621 18902 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.495641 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.501430 17524 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:21.502698 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:21.499518 18474 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.505198 18474 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.348651 18948 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.345072 18684 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.301008 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.506510 17450 raft_consensus.cc:2955] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:21.345752 18935 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:18:21.373322 18856 consensus_meta.cc:287] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.002s
I20260709 13:18:21.361471 18761 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.360710 18845 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.367623 18850 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.363258 18876 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.341214 18870 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.364393 18868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52562 (request call id 8) took 10025 ms. Trace:
I20260709 13:18:21.326152 18940 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:21.511605 18885 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.490828 18932 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:21.360395 18891 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.505590 18966 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:21.500417 18928 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.300400 18600 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:21.504441 18752 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:21.526930 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:21.511061 18974 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.348765 18841 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.365728 18964 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.504381 17520 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:21.522744 18474 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.369710 18903 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.360461 18913 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.570012 18750 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.570549 18750 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:21.571203 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.571735 18913 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.571919 17526 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
W20260709 13:18:21.574141 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.573827 18903 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.574151 17449 raft_consensus.cc:2368] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3.
I20260709 13:18:21.491317 18937 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.541575 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.541694 17568 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:21.534993 18975 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.521867 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:21.528043 18935 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.531018 18845 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.547394 18940 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.522606 18923 raft_consensus.cc:697] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:21.548687 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet e57fe371976a485bbdedfdaa4659dec3 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:18:21.529002 18839 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.554729 18752 raft_consensus.cc:697] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:21.551509 18966 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.555411 18974 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:21.532092 18868 rpcz_store.cc:276] 0709 13:18:11.338870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.341520 (+  2650us) service_pool.cc:224] Handling call
0709 13:18:11.443592 (+102072us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b58001a1398. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab401c0 00007f5abab2c9d9 00007f5abab2cca2 00007f5ab40ab1d4
0709 13:18:11.568378 (+124786us) log.cc:844] Serialized 506 byte log entry
0709 13:18:12.089958 (+521580us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b5400244620. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5adf062 00007f5ab5abfeaa 00007f5ab5ac6d53 00007f5ab5ac6cd9 00007f5ab5ac6c69 00007f5ab5ac6c31 00007f5ab5ac5dfd 000000000038f354 000000000038f199 00007f5ab2a79475
0709 13:18:12.156892 (+ 66934us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5400244620. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5adbdbe 00007f5ab5ae6930 00007f5ab5ae68d8 00007f5ab5ae6858 00007f5ab5ae6813 00007f5ab5ae5a9c 00007f5abb9d1626 00007f5abb9cbdd8 00007f5ab5b227cb 00007f5ab5b252c0
0709 13:18:21.364294 (+9207402us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9119,"raft.queue_time_us":21679,"raft.run_cpu_time_us":1913,"raft.run_wall_time_us":134171,"spinlock_wait_cycles":228153216,"thread_start_us":306508,"threads_started":1,"wal-append.queue_time_us":460368,"wal-append.run_cpu_time_us":5995,"wal-append.run_wall_time_us":1119856}
W20260709 13:18:21.561002 18938 log.cc:927] Time spent T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.835s	user 0.000s	sys 0.002s
I20260709 13:18:21.395713 18835 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.366451 18815 consensus_queue.cc:237] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.565259 17446 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:21.566545 17451 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:21.567884 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.609495 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1130) took 1187 ms. Trace:
I20260709 13:18:21.610636 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1129) took 1235 ms. Trace:
I20260709 13:18:21.611114 17600 rpcz_store.cc:276] 0709 13:18:20.374991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.562798 (+187807us) service_pool.cc:224] Handling call
0709 13:18:20.581383 (+ 18585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.228859 (+647476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.610402 (+381543us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54003e9254. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:21.610556 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487751424}
I20260709 13:18:21.568451 18902 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.595963 18845 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.615235 17351 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40488 (request call id 188) took 1904 ms. Trace:
I20260709 13:18:21.616305 18845 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.598485 18940 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:21.619081 18974 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.596304 18975 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.568529 17527 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:21.569232 18196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42536 (request call id 120) took 1229 ms. Trace:
I20260709 13:18:21.349437 18717 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:21.575832 17454 raft_consensus.cc:2393] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:21.523384 18856 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:21.587105 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.587194 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45618.7us
I20260709 13:18:21.588384 17524 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.590219 17569 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:21.581435 18808 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:21.629388 18199 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:21.629855 18935 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.601071 18966 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.630141 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:21.630818 17526 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.573781 18750 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.601922 18923 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.602805 18925 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:21.603057 18841 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.587667 18866 consensus_queue.cc:1059] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:18:21.637319 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 47172.2us
I20260709 13:18:21.609884 17597 rpcz_store.cc:276] 0709 13:18:20.421838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.567989 (+146151us) service_pool.cc:224] Handling call
0709 13:18:20.568330 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.344704 (+776374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.609269 (+264565us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54003e9754. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:21.609428 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1617876352}
I20260709 13:18:21.640019 18868 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.640569 18868 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.641250 18975 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.599895 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet e57fe371976a485bbdedfdaa4659dec3 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-e57fe371976a485bbdedfdaa4659dec3
I20260709 13:18:21.603138 18752 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.642285 18850 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:21.642738 18850 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:21.643121 18850 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.603703 18839 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.604435 18937 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.604643 18835 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.587502 18952 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:21.551067 18932 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:21.607470 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:21.552085 18928 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.621191 18200 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:21.631837 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:21.615653 17351 rpcz_store.cc:276] 0709 13:18:19.710581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.724530 (+ 13949us) service_pool.cc:224] Handling call
0709 13:18:21.615143 (+1890613us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:21.030396 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:21.089512 (+ 59116us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:21.089555 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:18:21.089584 (+    29us) tablet.cc:662] Decoding operations
0709 13:18:21.101565 (+ 11981us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:21.101658 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:21.101691 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:21.101984 (+   293us) tablet.cc:701] Row locks acquired
0709 13:18:21.102005 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:21.102208 (+   203us) write_op.cc:270] Start()
0709 13:18:21.102343 (+   135us) write_op.cc:276] Timestamp: P: 1783603101102154 usec, L: 0
0709 13:18:21.102376 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:18:21.103169 (+   793us) log.cc:844] Serialized 535 byte log entry
0709 13:18:21.323042 (+219873us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b1800151a80. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:21.554384 (+231342us) op_driver.cc:464] REPLICATION: finished
0709 13:18:21.583222 (+ 28838us) write_op.cc:301] APPLY: starting
0709 13:18:21.583334 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:21.583467 (+   133us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:21.583505 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:21.583833 (+   328us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:21.584056 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:21.584126 (+    70us) write_op.cc:312] APPLY: finished
0709 13:18:21.584412 (+   286us) log.cc:844] Serialized 22 byte log entry
0709 13:18:21.584634 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:21.584744 (+   110us) write_op.cc:454] Released schema lock
0709 13:18:21.584805 (+    61us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":28562,"apply.run_cpu_time_us":2086,"apply.run_wall_time_us":7561,"num_ops":1,"prepare.queue_time_us":333985,"prepare.run_cpu_time_us":45355,"prepare.run_wall_time_us":193369,"raft.queue_time_us":229305,"raft.run_cpu_time_us":9596,"raft.run_wall_time_us":28842,"replication_time_us":451833,"spinlock_wait_cycles":11346688,"thread_start_us":515850,"threads_started":4,"wal-append.queue_time_us":136635}]]}
I20260709 13:18:21.629424 18808 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:21.667557 17528 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.633827 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:21.636830 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.599390 18825 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:18:21.648823 17524 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:21.651721 18838 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.654667 18839 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.654946 17568 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:21.634899 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 126118us
I20260709 13:18:21.656749 17569 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:21.630854 18856 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:21.605574 18948 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.661433 17526 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:21.636409 18935 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:18:21.627650 18196 rpcz_store.cc:276] 0709 13:18:20.339433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.341114 (+  1681us) service_pool.cc:224] Handling call
0709 13:18:20.354878 (+ 13764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.062707 (+707829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.568902 (+506195us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400487954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:21.569134 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434877184}
I20260709 13:18:21.656268 18925 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.675257 17568 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:21.677148 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.674732 18167 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:21.677276 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:21.688954 18167 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:21.689189 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:21.690568 18167 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:21.700412 17528 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:21.694190 17568 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:21.680349 18925 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.679838 18839 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:21.728196 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.673362 18838 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.673933 18953 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:21.752960 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 58852.1us
I20260709 13:18:21.681381 18856 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:21.756074 18928 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.714201 17569 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:21.692911 18968 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:21.725126 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.756322 18952 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.691922 18868 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.692047 18865 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.692063 18937 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.772817 18934 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:18:21.773620 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.773466 18937 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.774262 17600 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:21.687645 18974 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:21.762285 18839 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.769469 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.770606 17568 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:21.695310 18975 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:21.692328 18815 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:21.724056 18948 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.772339 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.694411 18846 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:21.776206 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 62135.4us
I20260709 13:18:21.757118 18761 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:21.785223 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.788893 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.789647 17594 raft_consensus.cc:2393] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:21.789947 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52572 (request call id 86) took 1044 ms. Trace:
I20260709 13:18:21.777868 17526 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:21.757627 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:21.779321 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.781174 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:21.725013 18916 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:18:21.785068 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.792382 17602 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:21.790386 17599 rpcz_store.cc:276] 0709 13:18:20.746261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.746399 (+   138us) service_pool.cc:224] Handling call
0709 13:18:21.789800 (+1043401us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54003eb054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:21.789893 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133060864}
I20260709 13:18:21.785723 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.775677 18717 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:21.791436 17528 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:21.798053 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.786047 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.793834 17601 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:21.791316 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.798769 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.776824 18838 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.793300 18856 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:18:21.796613 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.809738 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:21.788151 18952 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:21.796911 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:21.796967 18916 consensus_queue.cc:1243] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:21.813630 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.815025 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:21.800341 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.815698 17597 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:21.816915 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:21.817538 17526 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.804548 18761 raft_consensus.cc:697] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:21.817845 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.818828 18761 consensus_queue.cc:237] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.778332 18975 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.819824 18975 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.822418 18932 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:21.801522 18941 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.081s	user 0.004s	sys 0.000s
I20260709 13:18:21.824080 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.789654 18948 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:21.824743 17527 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:21.802364 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:21.802487 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:21.826367 17528 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:21.827005 17568 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:21.828837 18856 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:21.829289 18856 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.804821 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.780246 18839 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.805685 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.838070 17568 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:21.838653 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.839516 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.778752 18904 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:21.777488 18928 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:21.781669 18815 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.810536 17594 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:21.795987 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:18:21.858922 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 63091.4us
I20260709 13:18:21.860678 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:21.801275 18705 raft_consensus.cc:3055] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:21.819180 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:21.830145 17595 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:21.803617 18937 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.831516 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.829648 18856 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.845044 17526 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:21.846408 17568 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:21.806231 18974 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:21.816735 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.950730 17595 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:21.975653 17594 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:21.846668 18868 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:21.936106 18815 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.845786 18952 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:21.960193 18750 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.931670 18717 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.843079 18904 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:21.949414 18934 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:21.872426 18948 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:21.843267 18838 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.035069 18838 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.036525 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.037287 18838 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:21.947916 18841 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.038266 18841 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.038643 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.039431 17451 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:21.932444 18705 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:21.932971 18752 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:22.013159 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:21.978446 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.010039 18868 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.965715 18974 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.984064 18968 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.029882 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.047153 17450 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:22.033331 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:22.033535 17597 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:21.971935 18951 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.134s	user 0.002s	sys 0.002s
I20260709 13:18:22.038280 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:21.932610 18928 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.012001 18953 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.037897 18838 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:22.039729 17600 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:22.057760 17420 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.059126 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.060241 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.061476 17420 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:18:22.044543 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 198269us
I20260709 13:18:22.030732 18904 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:22.034214 18984 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:18:22.053824 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.034104 18934 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.064095 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.069425 17451 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.049620 18868 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.048954 18937 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.045557 18752 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.050594 18761 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:22.065455 18948 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.048489 18974 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.083038 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.063292 18838 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.076778 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 56) took 1144 ms. Trace:
I20260709 13:18:22.032559 18717 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.088200 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:22.083577 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 222945us
I20260709 13:18:22.026405 18750 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.072201 18934 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.068023 18962 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:22.091157 17448 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.065289 18923 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.088510 17453 rpcz_store.cc:276] 0709 13:18:20.924642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.924752 (+   110us) service_pool.cc:224] Handling call
0709 13:18:22.068072 (+1143320us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b5800002798. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab3ffc0 00007f5abab2a929 00007f5abab2a3d2 00007f5ab40a1bd4
0709 13:18:22.068269 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.068464 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.068494 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.068546 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:22.068577 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.068637 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.068746 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2929024}
I20260709 13:18:22.096489 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.088740 18986 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:18:22.072908 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.114420 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:22.115671 17594 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.085915 18752 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.090541 18761 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.092648 18838 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.089425 18705 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.073442 18935 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:18:22.158257 17451 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.108319 18962 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.154290 18977 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.112751 18983 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.160089 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.142535 17595 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:22.086649 18937 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.163733 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:22.173012 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.173379 17451 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:22.164161 18977 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:22.170994 18835 consensus_meta.cc:287] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.003s
W20260709 13:18:22.155249 18989 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
I20260709 13:18:22.176782 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.184369 17453 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.175911 18705 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:22.181548 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 7002e0c7a3624420a1737b1fb29d8142: Illegal state: Replica ddfe9cca0741489b994f8b0178c54fe7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:22.185325 17594 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:22.171582 18962 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.188894 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.189545 17451 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
W20260709 13:18:22.191593 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 126582us
W20260709 13:18:22.193842 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.192768 17568 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.195129 17448 raft_consensus.cc:2410] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:22.184705 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.197878 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.199729 17453 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
W20260709 13:18:22.198671 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.202361 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.201267 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.204229 17453 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
W20260709 13:18:22.207391 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.193893 17569 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.662s (SENT) [suppressed 18 similar messages]
I20260709 13:18:22.149876 18952 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.191044 18841 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.211460 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.218828 17451 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
W20260709 13:18:22.213721 18850 consensus_meta.cc:287] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.009s
I20260709 13:18:22.214573 18865 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.190310 17523 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.196525 18997 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.222651 18891 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.213783 18750 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.227069 17603 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:22.222178 18850 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.228545 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.229259 17599 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:22.229419 18850 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.227058 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.230139 18999 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:22.230558 17602 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:22.231225 18955 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.232221 18963 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:22.239841 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.224234 18937 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.236017 17445 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:18:22.266423 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.267354 17602 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:22.268692 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.267917 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:22.271093 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 77232.7us
I20260709 13:18:22.271857 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.272810 17526 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:22.275717 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.276444 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.276937 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.276484 17451 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:22.275736 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:22.278689 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.240845 18999 raft_consensus.cc:697] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:22.273904 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.251004 18928 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.282771 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:22.236217 18997 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.290210 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.294430 17451 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:22.275573 18937 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.313580 18999 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:18:22.314962 18966 consensus_meta.cc:287] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.000s
I20260709 13:18:22.315400 18966 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.317699 18966 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.298578 18839 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:22.301538 18815 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.302773 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.359222 17451 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:22.303988 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.304590 18975 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.305406 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.306381 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.308643 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.310523 18997 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.285709 18717 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.317765 18955 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.283046 18897 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:18:22.319581 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1048) took 1105 ms. Trace:
I20260709 13:18:22.319435 18868 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.281651 18856 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:22.322685 18925 consensus_meta.cc:287] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.558s	user 0.004s	sys 0.007s
I20260709 13:18:22.298870 18977 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.325079 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1045) took 1113 ms. Trace:
I20260709 13:18:22.399806 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:22.301836 17613 tablet_copy_source_session.cc:215] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:22.336442 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.401948 17525 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:22.400084 17446 rpcz_store.cc:276] 0709 13:18:21.211717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.280394 (+ 68677us) service_pool.cc:224] Handling call
0709 13:18:21.564821 (+284427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.608266 (+ 43445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.324742 (+716476us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54002003d0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:22.324988 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653462272}
I20260709 13:18:22.349685 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.325748 18974 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:22.288414 18983 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:22.361433 17601 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:22.405108 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.377624 18986 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:22.363768 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.372442 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.408450 17598 raft_consensus.cc:2393] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:22.378070 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.382326 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.359226 18928 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:22.395397 17449 rpcz_store.cc:276] 0709 13:18:21.214354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.223151 (+  8797us) service_pool.cc:224] Handling call
0709 13:18:22.319319 (+1096168us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54000d7ad4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:22.319503 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804908416}
I20260709 13:18:22.396554 17602 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:22.396816 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.377130 17445 raft_consensus.cc:2368] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3.
I20260709 13:18:22.398661 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.368016 18815 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:22.400473 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 119157us
I20260709 13:18:22.412274 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.403369 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.413499 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.368232 18963 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:22.395448 18903 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.422938 18904 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.423656 18903 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.424993 18904 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.288160 18888 raft_consensus.cc:2764] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:18:22.426012 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.398310 18934 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:22.435286 17449 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:22.436507 18934 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.405591 17595 raft_consensus.cc:2368] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3.
I20260709 13:18:22.440420 18752 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.441572 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:22.363852 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.442345 18839 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.442530 18752 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.442999 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.443445 17526 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:22.443996 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.444416 17526 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:22.444533 18974 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.445137 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.446138 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.446681 17526 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:22.447191 18856 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.447501 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.448118 17526 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:22.448195 17445 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:22.448923 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.414803 18983 raft_consensus.cc:697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:22.449721 17526 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:22.450676 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.450325 18983 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.451390 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.451704 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.452400 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.412539 18928 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:22.453413 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.453986 17526 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:22.454341 18856 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:22.454865 18856 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.411808 18986 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.457459 18856 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.458211 17446 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:22.408308 17453 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:22.403478 17419 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.407212 17599 raft_consensus.cc:2393] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:22.409063 17451 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
W20260709 13:18:22.459092 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 55699.1us
I20260709 13:18:22.459626 17448 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:22.462396 17524 raft_consensus.cc:2393] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:22.463229 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.463761 17524 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:22.465207 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1047) took 1251 ms. Trace:
W20260709 13:18:22.409013 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.397385 18955 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.399821 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.402773 18925 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.420275 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.404124 18717 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:18:22.422744 18963 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.414242 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.421865 18868 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.425664 18903 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.421865 18975 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.455013 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.455107 18928 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:22.466503 17594 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:22.466846 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.515579 17526 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.515849 17598 raft_consensus.cc:2393] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:22.487777 17454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1301) took 1555 ms (client timeout 1662 ms). Trace:
I20260709 13:18:22.516908 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.466398 17524 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:22.476570 18194 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:22.466120 18845 raft_consensus.cc:3055] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:22.518011 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:22.477289 18200 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:22.406420 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.524827 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.525399 17525 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
W20260709 13:18:22.366159 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 69564.7us
I20260709 13:18:22.519435 17596 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:22.507808 18808 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.521631 17598 raft_consensus.cc:2368] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5.
I20260709 13:18:22.497849 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.470306 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:22.526309 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:22.516528 17454 rpcz_store.cc:269] 0709 13:18:20.932414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.932550 (+   136us) service_pool.cc:224] Handling call
0709 13:18:22.487568 (+1555018us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b5400193054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:22.487713 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398697728}
I20260709 13:18:22.527297 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.520629 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.495244 17569 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.532117 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:22.532727 18197 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:22.475682 18916 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.534484 18916 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:22.535488 18201 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.535954 18761 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.536603 18916 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.537664 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.466214 18986 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.538424 17598 raft_consensus.cc:2393] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:22.527806 18891 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:22.539191 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.508457 18870 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.519527 18845 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:22.541196 18845 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:22.542575 18845 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.542773 18963 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.438009 18962 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.544108 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:22.545172 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.545288 18962 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.545729 17600 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:22.465611 17452 rpcz_store.cc:276] 0709 13:18:21.214079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.282444 (+ 68365us) service_pool.cc:224] Handling call
0709 13:18:21.282702 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.650463 (+367761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.650511 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.650574 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:21.650622 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.464954 (+814332us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54000dbbd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:22.465017 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.465145 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":844797824}
I20260709 13:18:22.528366 17419 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.522410 18943 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:22.547122 18196 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.550441 18955 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.551240 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.551694 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.509469 18904 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:22.552924 18200 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:22.553987 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.550436 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.555155 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.580508 17603 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:22.580832 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.556254 17599 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:22.582181 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.555718 18925 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:22.556907 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 61758.8us
I20260709 13:18:22.589078 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.589951 17529 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.590523 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.557862 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.591936 17525 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.540314 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.559917 18201 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.560336 17450 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.535269 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.564121 17526 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:22.562646 18166 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.562863 18646 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.564640 18866 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.565642 18705 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:22.604316 18955 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.604727 18955 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.568850 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.566051 18943 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:22.569033 17352 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 94) took 2126 ms. Trace:
I20260709 13:18:22.563220 18891 raft_consensus.cc:697] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:22.606707 18891 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.607293 18943 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:22.578837 18888 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:22.572039 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.608698 17447 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.583303 18904 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.613122 18904 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:22.574287 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46000.5us
I20260709 13:18:22.614110 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.614779 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:22.614815 17419 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.575727 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.617063 17419 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.618409 18943 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.576841 17448 pending_rounds.cc:85] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 5
I20260709 13:18:22.619589 17419 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.578346 17520 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:22.620167 18196 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:22.620484 17419 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.620813 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.583552 17599 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:22.622808 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.622920 17447 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:22.623518 17599 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:22.584906 17603 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:22.585687 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.577189 18935 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.587468 18945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57fe371976a485bbdedfdaa4659dec3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:22.556370 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 50454.6us
I20260709 13:18:22.596290 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.594331 17598 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:22.599449 18166 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.631101 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.602824 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.605073 18955 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.632649 17603 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:22.575174 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.615833 18646 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.615350 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.619705 17448 pending_rounds.cc:107] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:22.496034 18600 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:22.601307 18808 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.625427 17529 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:22.627897 18943 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.643725 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.644023 18943 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:22.644398 17529 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.644486 18943 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.625463 17450 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:22.646167 17522 raft_consensus.cc:2410] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:22.615705 17600 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.647771 17568 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.624534 17419 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.631343 18761 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.651175 18600 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.641850 18866 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:18:22.651686 18600 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:22.652140 18600 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.652689 17525 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.631286 18916 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.650000 17419 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.654500 17568 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.425717 18838 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.605880 17352 rpcz_store.cc:276] 0709 13:18:20.442769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.442916 (+   147us) service_pool.cc:224] Handling call
0709 13:18:22.568930 (+2126014us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 13:18:22.632104 18888 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:22.657743 17529 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.639504 17452 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.640498 17528 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.621948 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:22.642107 17598 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:22.640483 17448 raft_consensus.cc:2889] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:22.628338 18963 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.640157 18194 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:22.624400 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:22.662962 17599 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.571367 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:22.642211 18922 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.630219 17420 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:22.664039 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 92723.4us
I20260709 13:18:22.654812 17525 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:18:22.650544 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.665199 17522 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.666505 17520 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:22.655328 17419 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.638442 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:22.657480 18948 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:22.670348 18948 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.670760 18948 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.670832 18994 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:22.632242 17526 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.672245 17522 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:22.673477 17522 raft_consensus.cc:1275] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:22.659133 17568 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.676301 17452 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:22.677160 17522 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:22.677326 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:22.680020 17522 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:22.671437 18994 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.681757 18916 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:22.682296 18916 raft_consensus.cc:697] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:22.682659 18860 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:22.683295 18994 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.683176 18916 consensus_queue.cc:237] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:22.683715 17600 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:22.660787 18983 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:22.684657 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.679046 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.685377 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:22.685531 18860 raft_consensus.cc:2764] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:22.685868 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:22.686100 18897 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:22.686424 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.687109 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.687713 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.687747 17600 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:22.662662 18963 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:22.688843 18970 raft_consensus.cc:2764] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:22.688942 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.681572 18939 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.690676 18970 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:22.692768 17495 leader_election.cc:400] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3.
I20260709 13:18:22.694406 17495 leader_election.cc:400] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3.
I20260709 13:18:22.694953 17495 leader_election.cc:403] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:22.694684 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:22.695834 17526 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.637451 18717 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:22.698328 17419 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.689219 18963 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.701452 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.702634 17419 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.693578 18808 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:18:22.692099 18904 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:22.664650 17525 pending_rounds.cc:85] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 2
I20260709 13:18:22.706364 17525 pending_rounds.cc:107] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:18:22.701918 18897 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3.
I20260709 13:18:22.707412 17525 raft_consensus.cc:2889] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:22.706166 18962 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.663188 18888 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:22.673084 18866 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:22.708714 18983 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:22.710793 18939 raft_consensus.cc:2764] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:22.678231 18986 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:22.713160 17419 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.713742 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.709026 17599 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:22.717604 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.720778 17602 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:22.716394 17528 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:22.708549 18750 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:18:22.680373 18705 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.695925 18761 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:22.723313 18904 raft_consensus.cc:697] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:22.702769 18646 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:22.795257 18646 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.795780 18646 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.795873 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.797480 17601 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:18:22.799338 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 85726us
I20260709 13:18:22.800870 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.802469 18975 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:22.726658 18600 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.805193 18975 raft_consensus.cc:697] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:22.806181 18975 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.806752 18600 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.697536 18903 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:22.807847 18903 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.802664 18856 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:18:22.809597 18897 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:22.734117 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.812248 17599 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:22.735657 18838 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:22.724392 18977 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.756811 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.792425 18904 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.721091 18986 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:22.744563 18860 raft_consensus.cc:2764] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:22.817633 18903 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:22.756134 18970 raft_consensus.cc:2764] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:18:22.804607 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 82094us
I20260709 13:18:22.813385 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:22.837638 17601 raft_consensus.cc:2393] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:22.814877 17602 raft_consensus.cc:2368] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:22.816694 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:22.717367 18962 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.815699 18761 raft_consensus.cc:697] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:22.848977 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:22.821650 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 108565us
I20260709 13:18:22.857801 17419 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.758090 18866 raft_consensus.cc:697] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:22.825698 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.826359 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.861438 17452 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.822238 18986 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.832674 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.866881 17453 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.835774 17568 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.837016 17420 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:22.867964 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:22.868731 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.793434 18888 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:22.848042 18600 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:18:22.859287 17419 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.881752 17453 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.883333 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.882807 17349 catalog_manager.cc:5697] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 2 to 3, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 3 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.881703 17452 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.884438 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.884964 17452 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.884354 17349 catalog_manager.cc:5697] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 2, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.850827 17597 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:22.850996 17451 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:22.851521 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.888113 17447 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.852782 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:22.885869 17349 catalog_manager.cc:5697] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 2, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.830794 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:22.888960 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 45596.1us
I20260709 13:18:22.889225 17454 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.888975 17524 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.824074 18963 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.847720 18928 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:22.876430 18955 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.853693 19002 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:18:22.880204 18761 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:22.930410 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:22.866072 18939 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:22.802439 18983 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:22.921571 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 85900.9us
I20260709 13:18:22.946796 17568 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:22.923210 17349 catalog_manager.cc:5697] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 2, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.948433 17349 catalog_manager.cc:5697] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 2 to 3, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 3 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.925091 17452 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:22.930190 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.951599 17451 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.931468 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.821107 18948 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.954270 17349 catalog_manager.cc:5697] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 2, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.898394 18903 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:22.888005 18935 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:22.870236 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:22.964007 17349 catalog_manager.cc:5697] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 2, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.976285 17524 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.924420 18717 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:22.972802 17453 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.898831 18962 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.974125 17454 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.988927 18752 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:22.887013 18646 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:22.930971 18925 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:22.982501 17349 catalog_manager.cc:5697] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 2, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.956377 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:22.946244 18939 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.031381 17453 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:22.978377 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:18:23.032753 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 54478.8us
I20260709 13:18:23.002257 18197 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 LEARNER]: Advancing to term 3
I20260709 13:18:22.986887 18838 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:23.012946 17569 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:23.042630 17569 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:22.992161 18977 raft_consensus.cc:2764] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:18:22.998255 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 84479.7us
I20260709 13:18:23.015375 17445 raft_consensus.cc:2393] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:22.992508 18935 raft_consensus.cc:697] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:23.025293 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:23.051580 17452 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:23.051906 17454 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:23.031694 18939 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:22.933135 19015 log.cc:927] Time spent T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:23.027202 17451 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:22.989605 17447 raft_consensus.cc:2393] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:23.026572 18717 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:23.046273 17419 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:23.048208 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:23.045990 18846 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:23.061089 18846 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:23.061147 17569 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:23.062095 18846 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:23.062682 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:23.062924 17569 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:23.064812 17569 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:23.054458 18838 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:23.024722 18962 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.065544 18962 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.065925 18838 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:23.069782 18197 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:23.070326 18708 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:23.070825 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:23.053455 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:23.071552 18868 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:23.071707 17454 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:23.072064 18868 raft_consensus.cc:697] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:23.072115 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:23.072546 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:23.072840 17448 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:23.073015 18868 consensus_queue.cc:237] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.073668 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:23.025521 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 155794us
I20260709 13:18:23.074401 18856 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:23.074777 18856 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.999269 18866 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.075071 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1336) took 1445 ms. Trace:
I20260709 13:18:23.075538 18928 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:23.076007 18928 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:23.075606 17523 rpcz_store.cc:276] 0709 13:18:21.629753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.633564 (+  3811us) service_pool.cc:224] Handling call
0709 13:18:23.074882 (+1441318us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b5400413a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:23.074986 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184316288}
I20260709 13:18:23.076480 18928 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.076103 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:23.070879 18708 raft_consensus.cc:697] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:23.078611 18708 consensus_queue.cc:237] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.079656 18975 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:23.080153 18975 raft_consensus.cc:697] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:23.075219 17420 leader_election.cc:400] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5.
I20260709 13:18:23.081670 17448 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:23.082139 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:23.082799 17420 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:23.074186 19010 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:23.075129 18856 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.046578 18925 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:23.048431 18994 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:23.054324 18825 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:23.057869 18717 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:23.032829 18752 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:23.076560 18963 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:23.109998 17420 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:23.115608 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 69418.8us
I20260709 13:18:23.132555 17419 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:23.132864 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:18:23.141281 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.108747 18839 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:23.081002 18975 consensus_queue.cc:237] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.146191 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:23.143527 17419 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:23.148648 17568 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:23.118637 19021 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:23.121016 19020 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:23.154136 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:23.155040 17524 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:23.154136 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 289324us
I20260709 13:18:23.120241 19025 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:23.147192 18977 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:23.195375 17521 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:23.146328 18839 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:23.148314 19018 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:23.150684 18955 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:23.153261 19021 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:23.228116 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 84701.8us
I20260709 13:18:23.240155 17527 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:23.240959 17419 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:23.182207 18866 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:23.201733 18846 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.241755 18866 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.201973 18925 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.241899 18846 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:23.242479 18866 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:23.242725 19024 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:18:23.244397 18846 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:23.201751 18839 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:23.144742 18963 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
W20260709 13:18:23.248198 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 166094us
I20260709 13:18:23.182298 18948 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:23.249104 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:23.250391 17524 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
W20260709 13:18:23.192214 19038 log.cc:927] Time spent T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:18:23.217113 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 70981.3us
I20260709 13:18:23.150550 18600 consensus_queue.cc:1059] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 13:18:23.263685 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 43791.6us
I20260709 13:18:23.293336 17568 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:23.268656 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:23.293411 18600 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:23.149639 19026 consensus_queue.cc:1059] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:18:23.259486 19025 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:23.280777 17420 leader_election.cc:400] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
I20260709 13:18:23.226572 17445 raft_consensus.cc:1275] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:23.226878 19020 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:23.248978 19021 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.203990 19018 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:23.301734 17524 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:23.321190 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:23.302423 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:23.303149 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:23.278275 18948 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:23.309255 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:23.329646 17599 raft_consensus.cc:2410] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:23.309468 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:23.263003 19032 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:18:23.149816 18935 consensus_queue.cc:237] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:23.324572 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 164672us
I20260709 13:18:23.277323 18904 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:23.306864 17420 leader_election.cc:403] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:23.322288 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:23.336886 17524 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:23.328207 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:23.337378 17526 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:23.331394 17522 raft_consensus.cc:2368] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5.
I20260709 13:18:23.308482 19025 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.362521 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:23.363493 17525 raft_consensus.cc:2393] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:23.276780 18705 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:18:23.317044 19020 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:23.325646 19018 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.317651 18646 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:23.306109 18977 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:18:23.340294 17520 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:18:23.421839 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 128558us
I20260709 13:18:23.327904 18994 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:23.319905 18825 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:18:23.367488 19025 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:23.418483 18708 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:23.415489 19020 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.338069 19010 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 13:18:23.431021 19047 raft_consensus.cc:3055] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:23.327654 18868 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:18:23.430626 18994 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:23.430315 18646 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:23.420717 19045 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:23.456720 19031 consensus_queue.cc:1059] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:18:23.461614 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:23.464509 19047 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:18:23.494453 19037 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:18:23.487792 19039 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.348s	user 0.000s	sys 0.002s
W20260709 13:18:23.496095 19046 log.cc:927] Time spent T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:18:23.492705 18948 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3.
W20260709 13:18:23.495661 19035 log.cc:927] Time spent T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.221s	user 0.001s	sys 0.001s
I20260709 13:18:23.484083 18994 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:23.501627 19023 log.cc:927] Time spent T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:18:23.485951 18752 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:23.521533 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.519394 19055 raft_consensus.cc:3055] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:23.507891 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 172051us
I20260709 13:18:23.498057 18646 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.519598 18708 raft_consensus.cc:697] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:23.589033 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:23.594127 18194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42538 (request call id 194) took 1028 ms. Trace:
I20260709 13:18:23.594679 18194 rpcz_store.cc:276] 0709 13:18:22.565301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.569340 (+  4039us) service_pool.cc:224] Handling call
0709 13:18:22.626846 (+ 57506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.664874 (+ 38028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.593805 (+928931us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b5400445050. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:23.594042 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131399424}
I20260709 13:18:23.499084 19045 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:23.577809 19053 log.cc:927] Time spent T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 13:18:23.601928 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:23.604323 19031 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:23.605036 17594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1154) took 1274 ms (client timeout 1694 ms). Trace:
W20260709 13:18:23.606913 19044 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:18:23.616348 17495 leader_election.cc:400] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3.
W20260709 13:18:23.613857 17594 rpcz_store.cc:269] 0709 13:18:22.335190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.396591 (+ 61401us) service_pool.cc:224] Handling call
0709 13:18:23.604842 (+1208251us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b54000762d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:23.604969 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127172352}
I20260709 13:18:23.618992 17449 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:23.550853 19055 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:23.621635 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:23.627844 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:18:23.629261 19054 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:23.632747 19031 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:23.633358 19031 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:23.639585 18943 consensus_meta.cc:287] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.995s	user 0.013s	sys 0.000s
I20260709 13:18:23.640059 18943 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.641120 18897 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:23.578137 18962 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.642972 18897 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:23.645311 17454 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.627777 18866 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.633808 19031 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:23.664222 19050 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:23.663757 18708 consensus_queue.cc:237] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.665264 19055 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.666603 19055 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.613641 19048 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:23.633580 18839 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:23.659827 18986 consensus_meta.cc:287] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.002s
I20260709 13:18:23.655911 19027 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:23.681706 18839 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:23.682104 18646 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:23.694414 17454 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:23.685267 19027 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.684432 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:23.551077 19057 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.135s
I20260709 13:18:23.705041 19027 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.679625 18986 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:23.725754 17450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1322) took 1694 ms (client timeout 2237 ms). Trace:
I20260709 13:18:23.726475 19045 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:23.729568 17450 rpcz_store.cc:269] 0709 13:18:22.031400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.058148 (+ 26748us) service_pool.cc:224] Handling call
0709 13:18:22.466715 (+408567us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b5800002798. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:23.725533 (+1258818us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b54000d84d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:23.725678 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115065856}
I20260709 13:18:23.734345 17450 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:18:23.710276 18717 consensus_meta.cc:287] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.589s	user 0.004s	sys 0.008s
W20260709 13:18:23.740649 18928 consensus_meta.cc:287] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.004s
I20260709 13:18:23.655108 19047 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:23.746922 18201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42548 (request call id 214) took 1262 ms (client timeout 1551 ms). Trace:
W20260709 13:18:23.717757 18856 consensus_meta.cc:287] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
W20260709 13:18:23.750214 18201 rpcz_store.cc:269] 0709 13:18:22.469903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.470014 (+   111us) service_pool.cc:224] Handling call
0709 13:18:23.731688 (+1261674us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b54005f0854. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:23.731824 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12474752}
I20260709 13:18:23.754112 17603 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:23.758355 19047 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:23.758821 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:23.747722 18970 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.779209 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1152) took 1449 ms. Trace:
I20260709 13:18:23.779801 17595 rpcz_store.cc:276] 0709 13:18:22.329471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.441311 (+111840us) service_pool.cc:224] Handling call
0709 13:18:23.777187 (+1335876us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54003eba54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:23.779121 (+  1934us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455381888}
I20260709 13:18:23.748484 18717 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:23.789300 18939 consensus_meta.cc:287] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.003s
I20260709 13:18:23.756942 18856 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.810014 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:23.751399 18928 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.828989 17451 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:23.834964 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:23.790292 18970 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.809931 18866 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:23.830662 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 549870us
I20260709 13:18:23.801471 18939 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:23.899821 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 47915.7us
I20260709 13:18:23.832966 19010 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:23.904312 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:23.904963 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:23.905239 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:23.907449 17595 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:23.908728 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:23.910313 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:23.910996 17601 raft_consensus.cc:2368] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4.
I20260709 13:18:23.831799 18870 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:18:23.914796 17601 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:23.832664 19018 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.923264 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:23.924153 17595 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:23.928782 17452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:18:23.929450 17452 raft_consensus.cc:606] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:23.929937 17452 raft_consensus.cc:614] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:23.913064 18600 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:23.937515 18943 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:23.942706 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:23.943521 17446 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:23.951160 19042 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.951788 19042 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.905076 18948 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:18:23.914940 19010 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:23.911966 19057 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:18:23.902562 19045 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 13:18:23.957865 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.962412 19042 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:23.963102 18928 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:23.963626 19057 consensus_queue.cc:1243] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:23.964157 18939 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:23.967736 18600 consensus_queue.cc:1059] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:23.969328 18970 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:23.969156 19027 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:23.970196 18717 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:23.970654 18986 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:23.985699 17446 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:23.992889 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1350) took 1143 ms. Trace:
I20260709 13:18:23.993476 17446 rpcz_store.cc:276] 0709 13:18:22.849507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.868411 (+ 18904us) service_pool.cc:224] Handling call
0709 13:18:23.942519 (+1074108us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b5800002798. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:23.992810 (+ 50291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8529664}
W20260709 13:18:23.979002 19021 consensus_meta.cc:287] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.005s
I20260709 13:18:23.971311 18955 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.998945 17419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.022s	sys 0.046s
W20260709 13:18:24.003719 17419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.022s	sys 0.046s
I20260709 13:18:24.007854 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:24.008931 17529 raft_consensus.cc:2368] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5.
I20260709 13:18:24.015874 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:24.020648 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:24.001544 18945 consensus_meta.cc:287] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.002s
I20260709 13:18:24.025947 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:24.026831 17529 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
W20260709 13:18:23.998741 18705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.010s	sys 0.041s
I20260709 13:18:24.028757 17528 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:18:24.013377 18925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.025s	sys 0.062s
I20260709 13:18:24.013978 18600 raft_consensus.cc:3055] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:24.033916 18705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.010s	sys 0.041s
I20260709 13:18:24.014850 19018 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.024596 18856 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:23.999135 19021 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:24.044260 19020 consensus_meta.cc:287] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
I20260709 13:18:24.003371 18955 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:24.051282 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:24.058264 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:24.036456 18600 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:24.064152 17445 raft_consensus.cc:2393] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:24.025326 18994 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:24.034317 18925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.026s	sys 0.063s
W20260709 13:18:24.068228 18750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.003s	sys 0.021s
I20260709 13:18:24.067665 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1349) took 1228 ms. Trace:
I20260709 13:18:24.074144 17447 rpcz_store.cc:276] 0709 13:18:22.839362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.888743 (+ 49381us) service_pool.cc:224] Handling call
0709 13:18:24.067404 (+1178661us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b54000b4354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:24.067593 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82654592}
I20260709 13:18:24.036672 19010 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:24.078465 17419 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:24.083659 18600 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:24.084723 18986 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.085134 18600 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:24.085776 19041 log.cc:927] Time spent T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.947s	user 0.004s	sys 0.001s
I20260709 13:18:24.064791 19021 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.057307 19020 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:24.077093 18750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.003s	sys 0.021s
W20260709 13:18:24.077198 19026 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.011s	sys 0.015s
W20260709 13:18:24.111706 19026 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.011s	sys 0.015s
I20260709 13:18:24.094810 17419 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:24.110982 19031 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.114370 17526 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:24.116564 19031 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.118333 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1353) took 1227 ms. Trace:
W20260709 13:18:24.092975 19025 consensus_meta.cc:287] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.004s
I20260709 13:18:24.118767 17454 rpcz_store.cc:276] 0709 13:18:22.890761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.073439 (+182678us) service_pool.cc:224] Handling call
0709 13:18:24.118125 (+1044686us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400320354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:24.118262 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313279360}
I20260709 13:18:24.119690 17419 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:24.117260 18945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42548 (request call id 210) took 3870 ms. Trace:
W20260709 13:18:24.107985 18200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.007s	sys 0.020s
I20260709 13:18:24.121284 18999 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:18:24.142678 18200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.007s	sys 0.024s
I20260709 13:18:24.122674 19021 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:24.143540 17495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.029s
I20260709 13:18:24.144054 17419 leader_election.cc:400] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5.
I20260709 13:18:24.144589 17419 leader_election.cc:403] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:18:24.140215 19036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.003s	sys 0.016s
I20260709 13:18:24.144302 18200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42548 (request call id 218) took 1185 ms. Trace:
I20260709 13:18:24.149044 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:24.160818 18200 rpcz_store.cc:276] 0709 13:18:22.959376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.959563 (+   187us) service_pool.cc:224] Handling call
0709 13:18:22.964691 (+  5128us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:23.100235 (+135544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.100284 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:23.113081 (+ 12797us) log.cc:844] Serialized 52 byte log entry
0709 13:18:23.200302 (+ 87221us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:23.307607 (+107305us) log.cc:844] Serialized 14 byte log entry
0709 13:18:23.308061 (+   454us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.143629 (+835568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.143725 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:24.143764 (+    39us) raft_consensus.cc:1685] finished
0709 13:18:24.143782 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.144232 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17033,"prepare.queue_time_us":644697,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":53491,"raft.run_cpu_time_us":497,"raft.run_wall_time_us":40636,"thread_start_us":1032333,"threads_started":4,"wal-append.queue_time_us":134195}
W20260709 13:18:24.144470 17495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.000s	sys 0.029s
W20260709 13:18:24.163865 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 536032us
I20260709 13:18:24.159420 17419 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:24.118706 18943 consensus_queue.cc:1059] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:18:24.122488 19025 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:24.168515 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 238074us
I20260709 13:18:24.144315 19065 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.140138 19027 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.172086 17420 leader_election.cc:400] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4.
I20260709 13:18:24.173801 17420 leader_election.cc:403] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:24.160508 19036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.004s	sys 0.017s
I20260709 13:18:24.145375 18999 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.160606 19021 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5.
I20260709 13:18:24.201443 17420 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:24.166976 18903 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:24.209961 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:24.211074 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:24.211870 17601 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:24.199397 18911 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.219182 18911 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:24.221005 19061 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:24.224486 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:24.225399 17599 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.203424 18935 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.203471 19027 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:24.167246 18750 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:24.180341 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:24.205440 17419 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:24.176436 18860 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:24.241429 18955 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:24.243438 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:24.244262 17446 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:18:24.247246 17495 connection.cc:256] RPC call timeout handler was delayed by -1.2764042080000308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
I20260709 13:18:24.205313 18891 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.255446 18201 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:24.256134 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:24.253437 17599 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:24.242051 18994 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:24.215426 18903 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:24.257297 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:24.180079 19000 consensus_queue.cc:1059] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:18:24.259886 18196 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:24.260829 19025 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.259106 18750 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.261739 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:24.262645 17596 raft_consensus.cc:2393] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:24.263792 18750 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.267517 19000 raft_consensus.cc:3055] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:24.267930 19000 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:24.221880 19026 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:24.273232 17447 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:24.274134 18201 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:24.274756 17598 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:24.275050 18750 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:24.276233 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:24.277423 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:24.280179 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:24.281077 17598 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:24.281307 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:24.253393 17601 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:24.258945 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:24.283094 17446 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.269905 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:24.284202 18200 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:24.286371 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 81024.7us
I20260709 13:18:24.287370 17419 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:24.261597 18193 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:24.304800 17420 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:24.259941 18911 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.305912 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:24.306936 17598 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:24.313133 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:24.273326 19026 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:24.317538 17447 raft_consensus.cc:1240] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:24.253892 19027 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.316026 17601 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:24.347235 18193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42538 (request call id 200) took 1352 ms. Trace:
I20260709 13:18:24.343822 17446 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:24.306604 18708 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.289201 19067 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.268850 19000 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.352205 17419 leader_election.cc:400] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5.
I20260709 13:18:24.347249 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:24.354310 17419 leader_election.cc:403] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:24.312463 18939 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.273005 18860 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:24.348799 17446 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:24.125849 18945 rpcz_store.cc:276] 0709 13:18:20.247235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.247909 (+   674us) service_pool.cc:224] Handling call
0709 13:18:20.561853 (+313944us) ts_tablet_manager.cc:934] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
0709 13:18:22.576625 (+2014772us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:23.468811 (+892186us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:23.472879 (+  4068us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:24.039323 (+566444us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:24.071371 (+ 32048us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:24.103640 (+ 32269us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:24.117178 (+ 13538us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":44400,"tablet-copy.queue_time_us":301401,"thread_start_us":464293,"threads_started":2}
I20260709 13:18:24.309979 18970 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:24.355244 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:24.364367 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:24.289103 18705 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:18:24.355440 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 83570.5us
I20260709 13:18:24.318231 19020 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.328347 19026 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:24.368968 18999 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:24.375917 19026 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.378273 17447 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:24.360700 17446 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:24.380522 19026 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.381493 17447 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:24.383430 18903 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.327191 19069 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:24.384909 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.351804 19045 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.351729 19018 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:24.366871 17601 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:24.366149 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:24.395002 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:24.397677 17601 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:18:24.386385 17447 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:24.355340 17596 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:24.355527 19029 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.319181 19048 consensus_queue.cc:1059] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:18:24.354619 19079 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:24.402483 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:24.356943 18708 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.418721 17569 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:24.386776 18986 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5.
I20260709 13:18:24.384804 19069 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:24.401072 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:24.414135 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:24.471441 17454 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:24.390796 19000 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:24.481650 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 63104.5us
I20260709 13:18:24.472735 18850 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 13:18:24.482609 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.483214 17453 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1351) took 1610 ms (client timeout 2081 ms). Trace:
I20260709 13:18:24.478452 19066 consensus_queue.cc:1059] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:18:24.478458 19070 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:18:24.485033 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:24.475709 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:24.498039 17454 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 1.
W20260709 13:18:24.487643 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 86671.6us
I20260709 13:18:24.494553 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1356) took 1563 ms. Trace:
I20260709 13:18:24.499102 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:24.418139 19018 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:18:24.493643 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 79650.6us
W20260709 13:18:24.496134 17453 rpcz_store.cc:269] 0709 13:18:22.872630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.883102 (+ 10472us) service_pool.cc:224] Handling call
0709 13:18:24.483031 (+1599929us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b54000d89d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:24.483151 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204515712}
I20260709 13:18:24.499459 17448 rpcz_store.cc:276] 0709 13:18:22.931394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.493591 (+1562197us) service_pool.cc:224] Handling call
0709 13:18:24.494011 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.494224 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.494249 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.494288 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:24.494318 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.494377 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.494487 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.509475 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:24.510061 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:24.512126 19064 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:24.513080 19064 raft_consensus.cc:697] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:24.514645 18845 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:24.515463 18845 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:24.518873 19064 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.389014 18970 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.526618 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:24.534636 17454 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:24.536278 17454 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:24.528254 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:24.539606 17453 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:24.539839 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:24.541153 17453 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:24.543041 17453 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:24.476915 18945 tablet_copy_client.cc:806] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:24.400018 19020 consensus_queue.cc:1059] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:18:24.482197 18856 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.480178 19057 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.541080 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:24.570474 17595 raft_consensus.cc:2368] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5.
I20260709 13:18:24.574097 17569 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:24.498587 19029 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:24.491624 18928 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.417740 18939 consensus_queue.cc:1059] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 13:18:24.400553 19045 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.498139 18983 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:24.486135 19079 raft_consensus.cc:697] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:24.568714 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:24.544821 17453 pending_rounds.cc:85] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 1
I20260709 13:18:24.605052 17453 pending_rounds.cc:107] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:24.605437 17453 raft_consensus.cc:2889] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.347756 18193 rpcz_store.cc:276] 0709 13:18:22.991225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.019088 (+ 27863us) service_pool.cc:224] Handling call
0709 13:18:24.261000 (+1241912us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b5800003c98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab3ffc0 00007f5abab2a929 00007f5abab2a3d2 00007f5ab40a1bd4
0709 13:18:24.261206 (+   206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.305784 (+ 44578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.343661 (+ 37877us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5930752}
I20260709 13:18:24.498826 19048 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:24.549588 19069 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:24.524488 18845 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:24.419292 19059 consensus_queue.cc:1059] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.161s
I20260709 13:18:24.623603 19018 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.624650 19080 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:24.625250 19080 raft_consensus.cc:697] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:24.554502 18945 tablet_copy_client.cc:670] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:24.618320 17595 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:24.593163 18925 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:24.580863 18705 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:24.623988 19059 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.635186 17454 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:24.639945 19055 consensus_meta.cc:287] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.973s	user 0.007s	sys 0.008s
I20260709 13:18:24.608420 19029 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:24.579224 18856 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.622432 18983 raft_consensus.cc:697] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:24.626307 19080 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.637413 19069 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.595376 19057 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:24.640240 18925 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:24.713141 18708 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:24.675995 19068 log.cc:927] Time spent T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:18:24.606949 18928 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:24.647137 18705 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:24.773633 18705 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:24.686098 18860 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.661985 19097 raft_consensus.cc:3055] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:24.774459 19097 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:18:24.737673 17600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 893) took 2067 ms (client timeout 1917 ms). Trace:
I20260709 13:18:24.660149 19059 raft_consensus.cc:3055] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:24.627753 19048 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:24.688545 19083 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 13:18:24.659704 19027 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:24.650501 19072 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
W20260709 13:18:24.738471 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 210337us
W20260709 13:18:24.738957 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 162988us
I20260709 13:18:24.662777 19029 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:24.750461 19092 log.cc:927] Time spent T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.003s
I20260709 13:18:24.694473 19079 consensus_queue.cc:237] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:24.741976 19047 consensus_meta.cc:287] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.983s	user 0.010s	sys 0.004s
W20260709 13:18:24.741130 19090 log.cc:927] Time spent T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.002s
I20260709 13:18:24.775434 19097 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.754599 18925 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:24.758136 19094 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.002s
W20260709 13:18:24.821925 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 259555us
I20260709 13:18:24.816737 17452 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:24.825219 17452 pending_rounds.cc:85] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 1
I20260709 13:18:24.825578 17452 pending_rounds.cc:107] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:18:24.777343 17600 rpcz_store.cc:269] 0709 13:18:22.670560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.688720 (+ 18160us) service_pool.cc:224] Handling call
0709 13:18:24.668462 (+1979742us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54003ad9d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:24.737601 (+ 69139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178508032}
I20260709 13:18:24.744518 19069 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.829717 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:24.831251 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:24.832971 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:24.799590 19059 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:24.807056 19027 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.825919 17452 raft_consensus.cc:2889] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.821015 19000 consensus_queue.cc:1059] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 13:18:24.848032 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.850607 18970 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.863124 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:24.866500 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:24.867435 17598 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:24.868665 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:24.870859 17451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1357) took 1900 ms (client timeout 1923 ms). Trace:
W20260709 13:18:24.871434 17451 rpcz_store.cc:269] 0709 13:18:22.970295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.055411 (+ 85116us) service_pool.cc:224] Handling call
0709 13:18:24.870617 (+1815206us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b54000d9dd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:24.870783 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1760455552}
I20260709 13:18:24.830132 19031 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.881906 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:24.883612 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:24.833767 17600 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:24.889024 17598 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:24.894347 17598 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:24.895643 17600 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:24.896265 17598 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:24.857193 19098 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.849157 19097 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:24.841146 17520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c6864e5b711423291c531e98224c311"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:24.849471 19027 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.902472 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:24.844684 18839 consensus_queue.cc:1059] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
W20260709 13:18:24.905848 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 68174.3us
I20260709 13:18:24.886103 19045 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:24.909749 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 60925.4us
I20260709 13:18:24.917079 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:24.891563 18856 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:24.893975 19031 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.893749 19000 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.911135 18928 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:24.911234 19029 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.912159 19048 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:24.912436 18600 consensus_meta.cc:287] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.827s	user 0.010s	sys 0.004s
I20260709 13:18:24.912856 19057 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:24.912784 19098 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:24.905105 19102 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:24.834493 18983 consensus_queue.cc:237] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.904469 18708 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:18:24.912875 19027 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.860544 19099 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:18:24.919008 18970 consensus_queue.cc:1059] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:24.918853 19107 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:24.923498 19025 raft_consensus.cc:3055] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:24.966218 19025 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:24.966706 19031 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.966768 18750 raft_consensus.cc:3055] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:24.967123 19025 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.924475 18925 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:24.912257 18891 consensus_meta.cc:287] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.643s	user 0.004s	sys 0.007s
I20260709 13:18:24.968331 18891 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4.
I20260709 13:18:24.968470 19025 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:24.919517 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 403959us
I20260709 13:18:24.924690 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1365) took 1612 ms. Trace:
I20260709 13:18:24.969450 17445 rpcz_store.cc:276] 0709 13:18:23.311770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.417935 (+106165us) service_pool.cc:224] Handling call
0709 13:18:24.924348 (+1506413us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b540004fe54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:24.924582 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276746624}
I20260709 13:18:24.926573 17446 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:24.948362 17525 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:24.949083 17451 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:18:24.885560 19066 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:24.940728 18705 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:24.909476 19010 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:18:24.908036 18850 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:18:24.979375 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:24.915202 19059 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.944168 19069 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.942204 19000 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.958361 19030 consensus_queue.cc:1059] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:18:24.967458 18750 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:24.974184 17451 pending_rounds.cc:85] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 5
W20260709 13:18:24.974676 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 58096.4us
I20260709 13:18:24.989313 17451 pending_rounds.cc:107] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:24.989621 17451 raft_consensus.cc:2889] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.968518 19098 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:24.972234 17520 raft_consensus.cc:606] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:24.983055 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:24.984380 17595 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:24.958997 19048 consensus_queue.cc:1059] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:18:24.944743 19106 consensus_queue.cc:1059] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 13:18:24.943264 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 48674.8us
W20260709 13:18:24.992942 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.009377 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:25.009323 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:25.038075 17420 leader_election.cc:400] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5.
I20260709 13:18:25.038527 17420 leader_election.cc:403] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:24.977126 19066 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:24.993269 19027 raft_consensus.cc:3055] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:24.988106 18705 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:25.052264 17447 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:25.015755 19069 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:25.053196 19099 raft_consensus.cc:3055] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:25.042081 18600 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5.
I20260709 13:18:24.990738 19107 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:25.014346 17520 raft_consensus.cc:614] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:25.040084 18870 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.990209 19029 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:18:25.054967 19048 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.075117 19099 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:25.054915 19027 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:25.094264 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:25.101552 17525 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:25.055824 19028 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:25.056951 18925 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:25.056351 19066 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.095753 19048 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.057453 19111 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:18:25.094199 19000 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.103048 19059 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.124835 18986 consensus_queue.cc:1059] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:25.125563 18705 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.126875 19031 raft_consensus.cc:3055] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:25.127342 19031 raft_consensus.cc:740] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:25.128172 19031 consensus_queue.cc:260] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.129477 19031 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:25.130703 19027 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.132120 19027 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.091424 19107 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:25.056216 18750 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.135430 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:25.114742 18962 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.120119 18891 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:25.154886 19111 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.177645 18891 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.178690 18970 raft_consensus.cc:3055] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:25.179067 18970 raft_consensus.cc:740] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:25.180015 18891 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.179839 18970 consensus_queue.cc:260] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.136982 19018 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:18:25.181008 18970 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.152055 18750 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.184247 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1382) took 1983 ms. Trace:
I20260709 13:18:25.191216 18903 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.155690 19107 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.123980 19100 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:25.158627 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 767436us
I20260709 13:18:25.163187 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.197316 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:25.198412 17451 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:25.164562 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:25.167604 19077 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.642s	user 0.004s	sys 0.003s
I20260709 13:18:25.171898 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.210929 17447 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:25.211853 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.173796 17527 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:25.174963 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:25.213147 17528 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:25.175740 18943 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:25.140305 19104 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 13:18:25.224249 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 214931us
I20260709 13:18:25.176541 18939 raft_consensus.cc:3055] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:25.184639 17521 rpcz_store.cc:276] 0709 13:18:23.202371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.241274 (+ 38903us) service_pool.cc:224] Handling call
0709 13:18:23.241618 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:23.279680 (+ 38062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.279806 (+   126us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.658329 (+1378523us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b2c00015ec8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446f372 00007f5ab5ba1a01 00007f5ab5b6643a 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2
0709 13:18:24.658831 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.183711 (+524880us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b18000f7900. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab570e4bc 00007f5ab2a5c48b 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab57060d1
0709 13:18:25.183860 (+   149us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:25.183897 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.183975 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.184016 (+    41us) raft_consensus.cc:1685] finished
0709 13:18:25.184028 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.184163 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29380,"raft.queue_time_us":195231,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":11594,"spinlock_wait_cycles":88174208,"thread_start_us":160966,"threads_started":1,"wal-append.queue_time_us":225439}
I20260709 13:18:25.195184 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:25.200380 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.201154 19100 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.194254 18860 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:25.203998 17568 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:25.233704 17568 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:25.213807 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 234554us
I20260709 13:18:25.133992 19025 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:18:25.175673 19048 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.223165 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.244949 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.229769 17451 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:25.246367 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.247586 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:25.248179 17451 raft_consensus.cc:2376] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4. Re-sending same reply.
I20260709 13:18:25.249298 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:25.236768 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.240658 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:25.252942 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.252964 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.253949 17447 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:25.227599 18939 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:25.257076 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.257510 17603 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:25.257326 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.210769 18903 consensus_queue.cc:1059] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:18:25.260267 17451 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
W20260709 13:18:25.268219 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.238112 18868 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:25.279752 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.237360 19057 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:25.227011 18943 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.258407 19027 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:25.233944 19070 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:18:25.284616 19031 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:25.287573 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.281215 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.238539 18860 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.290715 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:25.289212 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1366) took 1977 ms. Trace:
I20260709 13:18:25.298704 17449 rpcz_store.cc:276] 0709 13:18:23.312057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.623013 (+310956us) service_pool.cc:224] Handling call
0709 13:18:23.623575 (+   562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:23.625395 (+  1820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.625444 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:23.662591 (+ 37147us) log.cc:844] Serialized 26 byte log entry
0709 13:18:24.165535 (+502944us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:24.165590 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.165684 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.167191 (+1001507us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b2400116ee8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab28ff9c4 00007f5ab28fdacb 00007f5ab2ab8dc9 00007f5ab2ab8a55 00007f5ab2ab809d 00007f5ab56ea10e 00007f5ab570188c 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221
0709 13:18:25.285867 (+118676us) raft_consensus.cc:1685] finished
0709 13:18:25.285897 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.289149 (+  3252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1401,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":13555,"spinlock_wait_cycles":3880832,"thread_start_us":475064,"threads_started":1,"wal-append.queue_time_us":683405}
I20260709 13:18:25.300475 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.301321 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.297662 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.301887 17449 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:25.304674 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.282841 19048 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.308344 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.304562 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.306176 17603 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:25.308420 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.287732 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:25.288462 19027 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:25.355165 17449 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:25.433986 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:25.438067 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.305439 18891 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.306583 19107 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:25.306305 19059 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:25.305518 18962 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:25.440680 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 915) took 1213 ms. Trace:
I20260709 13:18:25.451895 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.309650 19066 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.463043 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:25.474745 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.422340 18705 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:25.516824 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:25.305516 19031 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:25.436089 19027 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.311523 19123 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:25.490645 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:25.493271 17445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.037s	sys 0.060s
W20260709 13:18:25.523429 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 287814us
I20260709 13:18:25.231477 19099 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.514319 19097 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.528771 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:25.423276 19048 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.544507 17601 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:25.522387 19059 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:25.523221 17597 rpcz_store.cc:276] 0709 13:18:24.226881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.243015 (+ 16134us) service_pool.cc:224] Handling call
0709 13:18:24.261976 (+ 18961us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.317019 (+ 55043us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:24.554887 (+237868us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.794824 (+239937us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.815178 (+ 20354us) log.cc:844] Serialized 26 byte log entry
0709 13:18:24.815372 (+   194us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:24.815422 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.965954 (+150532us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b5400328054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:24.966040 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.425853 (+459813us) raft_consensus.cc:1685] finished
0709 13:18:25.440391 (+ 14538us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.440596 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29945,"prepare.queue_time_us":206504,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":27531,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":15383,"spinlock_wait_cycles":19125120,"thread_start_us":269131,"threads_started":2,"wal-append.queue_time_us":295512}
I20260709 13:18:25.552682 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:25.511974 19047 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.510600 19107 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:25.307371 18939 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.508363 19113 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:25.523959 19028 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:25.553850 17568 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:25.514520 18888 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:25.539216 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:25.599975 19121 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:18:25.601058 19055 raft_consensus.cc:3055] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:25.599999 18888 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:25.602149 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:25.548835 17451 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
W20260709 13:18:25.551347 17445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.038s	sys 0.060s
I20260709 13:18:25.510341 18891 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:25.598670 19047 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.546427 19120 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:25.604364 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:25.556710 19069 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:25.601765 18197 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:25.539626 19066 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:25.610862 19117 log.cc:927] Time spent T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
W20260709 13:18:25.612630 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 58901.1us
I20260709 13:18:25.534759 18962 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:25.559477 18983 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:18:25.562920 19099 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.601516 19055 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:25.544448 18705 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:25.614950 18198 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:25.623769 17568 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:25.560801 19059 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.627137 17449 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:25.629696 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:25.617136 19069 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.615471 18761 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:25.616179 18939 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:25.640748 17568 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:25.610363 19028 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:25.561158 19097 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:25.652877 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.619942 19120 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:25.656066 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:25.656857 17529 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:25.637686 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:25.663302 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:25.664966 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:25.666498 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:25.606178 19113 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.668684 19120 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:25.669387 19113 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:25.648358 19130 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:25.670238 19130 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.670671 19130 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.671073 19066 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.649313 19069 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.649834 19000 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:25.550578 19123 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:25.654482 19102 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:25.703521 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:25.704069 17522 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.657742 18943 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.705773 18192 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:18:25.715502 19119 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:18:25.715909 19047 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.715983 18962 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:25.722152 19126 log.cc:927] Time spent T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:18:25.723336 19097 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.705595 19055 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:25.758991 19127 log.cc:927] Time spent T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:18:25.883098 17522 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:25.866194 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1169) took 1581 ms. Trace:
I20260709 13:18:25.900723 17595 rpcz_store.cc:276] 0709 13:18:24.284697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.627640 (+342943us) service_pool.cc:224] Handling call
0709 13:18:24.627916 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.994946 (+367030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.865896 (+870950us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400062a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:25.866127 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819177216}
I20260709 13:18:25.724385 19107 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.900663 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:25.818959 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 214675us
I20260709 13:18:25.826169 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1385) took 1407 ms. Trace:
I20260709 13:18:25.908234 17452 rpcz_store.cc:276] 0709 13:18:24.419965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.554102 (+134137us) service_pool.cc:224] Handling call
0709 13:18:24.554353 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.844171 (+289818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.825862 (+981691us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b540036a454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:25.826095 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602301312}
I20260709 13:18:25.752271 18943 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:25.910312 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:25.911902 17523 raft_consensus.cc:2410] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:25.910908 18943 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.912427 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1376) took 1523 ms. Trace:
I20260709 13:18:25.912807 17454 rpcz_store.cc:276] 0709 13:18:24.389346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.540449 (+151103us) service_pool.cc:224] Handling call
0709 13:18:24.543403 (+  2954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.636107 (+ 92704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.912196 (+1276089us) spinlock_profiling.cc:243] Waited 88.1 ms on lock 0x7b540036a954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:25.912372 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202684160}
I20260709 13:18:25.913750 18943 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:25.759656 19128 log.cc:927] Time spent T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:18:25.920271 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.920423 17603 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:25.847837 18986 consensus_queue.cc:1243] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:18:25.838043 19105 log.cc:927] Time spent T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.832s	user 0.002s	sys 0.000s
I20260709 13:18:25.867651 19123 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:25.918668 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.726351 19031 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:25.810396 18970 consensus_meta.cc:287] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.629s	user 0.013s	sys 0.001s
I20260709 13:18:25.922605 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.922991 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.923228 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:25.908908 18750 consensus_meta.cc:287] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.000s
I20260709 13:18:25.924110 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:25.945372 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:25.946431 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.924259 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.948549 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:25.765133 18891 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.783869 19028 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:25.927198 17595 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:18:25.890430 19059 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.764477 19027 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:25.765462 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1387) took 1192 ms. Trace:
I20260709 13:18:25.950927 19107 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.922802 18850 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:25.929829 17522 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:25.924741 19099 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:25.931015 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:25.931713 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:25.921182 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.784850 19045 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:25.862643 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60446 (request call id 1) took 1063 ms. Trace:
I20260709 13:18:25.758330 19048 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.934445 17597 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:25.947211 17598 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:25.954864 19102 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:25.949333 17603 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
W20260709 13:18:25.966084 19084 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.360s	user 0.010s	sys 0.035s
I20260709 13:18:25.954782 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:26.010401 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1390) took 1111 ms. Trace:
W20260709 13:18:26.010910 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 56217.7us
I20260709 13:18:25.924996 19055 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:25.893357 18705 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:25.930301 18197 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:25.923273 19057 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:25.979346 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.917227 18928 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:25.970548 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:25.966256 19002 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:26.013037 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:26.017176 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:26.017760 17569 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:26.011144 17526 rpcz_store.cc:276] 0709 13:18:24.899456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.899591 (+   135us) service_pool.cc:224] Handling call
0709 13:18:24.899922 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.982759 (+ 82837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.982801 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.983303 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.460600 (+477297us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:25.460643 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.460711 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.010072 (+549361us) raft_consensus.cc:1685] finished
0709 13:18:26.010103 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.010316 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18617,"raft.queue_time_us":21074,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":96,"thread_start_us":511149,"threads_started":2,"wal-append.queue_time_us":568774}
I20260709 13:18:26.019178 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.019402 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:26.019968 17526 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:26.021706 18166 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:26.029043 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.022135 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:26.039877 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.046871 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:26.048149 18970 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:26.048586 18970 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:26.051540 17495 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:25.978758 19099 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.021637 18708 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:26.124455 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:26.125876 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:26.010586 19084 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.453s	user 0.010s	sys 0.036s
I20260709 13:18:26.045405 18925 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:25.987016 19100 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.054448 17448 raft_consensus.cc:1240] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:26.049441 18986 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:26.060251 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1382) took 1668 ms. Trace:
I20260709 13:18:26.060580 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1393) took 1153 ms. Trace:
I20260709 13:18:25.978466 19107 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:26.064560 17451 raft_consensus.cc:3055] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:26.148651 17451 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:26.071269 18194 raft_consensus.cc:1240] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:26.072511 18856 raft_consensus.cc:3055] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:26.085659 18860 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.088054 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1077) took 1841 ms. Trace:
I20260709 13:18:26.165936 17451 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:26.204082 17446 rpcz_store.cc:276] 0709 13:18:24.246825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.381265 (+134440us) service_pool.cc:224] Handling call
0709 13:18:24.926251 (+544986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.973531 (+ 47280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.087741 (+1114210us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b540004fe50. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:26.087968 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252626304}
I20260709 13:18:26.205648 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:26.206941 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:26.090101 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:26.134440 19139 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.100584 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:26.105830 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:26.226802 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.106333 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:26.237191 19069 consensus_meta.cc:287] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.530s	user 0.005s	sys 0.005s
I20260709 13:18:26.114249 19131 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:25.964108 17445 rpcz_store.cc:276] 0709 13:18:24.573129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.970480 (+397351us) service_pool.cc:224] Handling call
0709 13:18:24.970872 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.971233 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.971271 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.971729 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.617164 (+645435us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:25.619891 (+  2727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.627589 (+  7698us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.725348 (+ 97759us) raft_consensus.cc:1685] finished
0709 13:18:25.752569 (+ 27221us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.765381 (+ 12812us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4494,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":4827,"thread_start_us":634325,"threads_started":1,"wal-append.queue_time_us":656017}
I20260709 13:18:26.115219 18977 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.115914 19026 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:26.118394 18943 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:26.122044 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.243134 18977 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.243709 17525 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 1.
I20260709 13:18:26.243573 18943 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.244750 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:26.245297 17525 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.245647 18943 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:25.983469 19045 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.246232 19100 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:26.246167 19026 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:26.246929 19100 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:26.247541 19045 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.027024 18868 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:26.248185 18868 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:26.248402 19026 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:26.248629 18868 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:26.124102 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 71024.3us
I20260709 13:18:26.200203 18856 raft_consensus.cc:740] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:25.985247 19102 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.045246 18750 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:26.126775 17419 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:26.253299 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 126576us
I20260709 13:18:26.052717 19048 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.051906 18970 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.978314 18850 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:26.052618 18983 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:26.027681 19002 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.141197 19116 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:26.143460 17524 rpcz_store.cc:276] 0709 13:18:24.907155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.907351 (+   196us) service_pool.cc:224] Handling call
0709 13:18:25.824753 (+917402us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b58000f5a98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab3ffc0 00007f5abab2a929 00007f5abab2a3d2 00007f5ab40a1bd4
0709 13:18:25.825003 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.825245 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:25.962563 (+137318us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.059529 (+ 96966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.059606 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:26.059667 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.059762 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.060343 (+   581us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4217,"prepare.queue_time_us":188277,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":59,"raft.queue_time_us":4490,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":8486,"spinlock_wait_cycles":6049664,"thread_start_us":229255,"threads_started":2}
I20260709 13:18:25.981567 17520 rpcz_store.cc:276] 0709 13:18:24.799668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.800476 (+   808us) service_pool.cc:224] Handling call
0709 13:18:25.862387 (+1061911us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b5400088754. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b60853 00007f5abab2e60a 00007f5ab40b47d4 00007f5ab40b4762 00007f5ab40b4691 00007f5ab40b460c 00007f5ab40b38c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:25.862542 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142482688}
I20260709 13:18:26.123314 19114 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.027766 18705 consensus_queue.cc:1059] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.113s
I20260709 13:18:26.124621 18939 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:26.021854 19057 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.135890 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:26.143270 17453 rpcz_store.cc:276] 0709 13:18:24.391998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.544176 (+152178us) service_pool.cc:224] Handling call
0709 13:18:24.544595 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:24.619242 (+ 74647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.619270 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:24.619873 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 13:18:24.908228 (+288355us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:25.114497 (+206269us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.123848 (+  9351us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.140800 (+ 16952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.140892 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.785951 (+645059us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:25.822701 (+ 36750us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b180032e120. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:26.059978 (+237277us) raft_consensus.cc:1685] finished
0709 13:18:26.060007 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.060176 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22521,"prepare.queue_time_us":932654,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":36971,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":20353,"spinlock_wait_cycles":18813568,"thread_start_us":423158,"threads_started":2,"wal-append.queue_time_us":311309}
I20260709 13:18:26.125082 19059 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.268590 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.122852 19031 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:18:26.092134 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1170) took 1807 ms. Trace:
I20260709 13:18:26.269416 18983 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:26.208680 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:26.149639 18708 raft_consensus.cc:697] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:26.209879 18925 raft_consensus.cc:697] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:26.237087 19097 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.114732 18600 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:26.054787 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:25.988417 19130 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.250488 18166 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:26.308091 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 57713.4us
I20260709 13:18:26.262913 17419 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:26.245764 18977 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.169045 18986 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:26.319949 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 57147.7us
I20260709 13:18:26.290997 18891 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.206687 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:26.246181 18860 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.306440 18983 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.238368 19131 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.275964 19116 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.343452 17454 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:26.302276 17523 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 1.
I20260709 13:18:26.278618 17524 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:26.365145 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1396) took 1424 ms. Trace:
I20260709 13:18:26.260696 18750 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.262043 19139 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.264993 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:26.283351 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 147600us
I20260709 13:18:26.033352 18928 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.277076 19114 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:26.210649 17446 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:26.346431 19116 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.278851 19027 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.269810 18866 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:18:26.392172 19002 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:26.406555 19102 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:26.291832 19113 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:18:26.323972 18925 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:26.408993 19148 log.cc:927] Time spent T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:26.325495 17599 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:26.324877 18600 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:26.413054 18600 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.324802 19130 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:26.317494 19028 raft_consensus.cc:2804] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:26.317212 19097 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.417526 19028 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:26.418537 19028 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:26.431617 18970 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:26.396008 18850 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:26.396174 18705 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:18:26.328576 19057 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:26.302213 19031 consensus_queue.cc:1243] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:26.294257 19059 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.265388 19100 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:26.237872 19069 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:26.362911 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 113183us
I20260709 13:18:26.336282 18977 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.329828 18963 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:26.461028 17569 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:26.366567 17524 rpcz_store.cc:276] 0709 13:18:24.940431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.277874 (+1337443us) service_pool.cc:224] Handling call
0709 13:18:26.278317 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.364822 (+ 86505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.365074 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:26.373800 19139 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:26.374533 19149 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:18:26.375010 18939 consensus_queue.cc:1059] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:26.379056 17445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "2158c0f750fd4b21afe24135c52167b2"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:18:26.367882 18750 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:26.381064 19140 log.cc:927] Time spent T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:18:26.391583 17446 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:26.291348 17601 rpcz_store.cc:276] 0709 13:18:24.284999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.761244 (+476245us) service_pool.cc:224] Handling call
0709 13:18:24.761695 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.558786 (+797091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.091786 (+533000us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b5400327b54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:26.092051 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799791360}
I20260709 13:18:26.342887 18860 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.390553 19114 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.297562 18856 consensus_queue.cc:260] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.369938 18195 raft_consensus.cc:2393] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 4: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:26.267109 18943 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:26.435601 19116 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.394058 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:26.399569 18986 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.402505 19027 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:18:26.453194 17525 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:26.404455 19144 log.cc:927] Time spent T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:18:26.338918 18891 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:26.397835 19147 log.cc:927] Time spent T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:18:26.465212 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1400) took 1512 ms. Trace:
I20260709 13:18:26.401512 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1399) took 1451 ms. Trace:
I20260709 13:18:26.404951 19020 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:26.400004 19107 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.397137 18928 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:26.472632 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.473639 17454 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:26.421124 19097 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.398505 19099 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.398216 19131 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.485726 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1090) took 1233 ms. Trace:
I20260709 13:18:26.478565 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:26.565339 17446 rpcz_store.cc:276] 0709 13:18:25.252764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.390971 (+1138207us) service_pool.cc:224] Handling call
0709 13:18:26.391369 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.485470 (+ 94101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.485670 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:26.565935 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 87505.8us
W20260709 13:18:26.505658 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 111743us
I20260709 13:18:26.507184 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1397) took 1565 ms. Trace:
I20260709 13:18:26.568024 17525 rpcz_store.cc:276] 0709 13:18:24.942049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.244494 (+1302445us) service_pool.cc:224] Handling call
0709 13:18:26.507123 (+262629us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:26.568271 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:26.568861 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.569347 17525 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:26.508662 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:26.513950 17524 rpcz_store.cc:276] 0709 13:18:24.952647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.464498 (+1511851us) service_pool.cc:224] Handling call
0709 13:18:26.464795 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.464976 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.465001 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.465043 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:26.465060 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.465095 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.465170 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:26.466485 18977 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.487350 18866 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:18:26.521391 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.570477 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.398300 18708 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.484225 19130 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.476254 19045 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:26.525923 19113 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:26.526948 19139 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.527434 18860 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.520613 17523 rpcz_store.cc:276] 0709 13:18:24.950465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.400297 (+1449832us) service_pool.cc:224] Handling call
0709 13:18:26.400797 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.401042 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.401083 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.401150 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:26.401199 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.401280 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.401438 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:26.583295 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.514297 18856 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:26.583911 17523 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:26.583803 19113 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.585176 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:26.585387 19145 log.cc:927] Time spent T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.331s	user 0.006s	sys 0.003s
I20260709 13:18:26.585948 17523 raft_consensus.cc:2393] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:26.575120 19130 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.586771 19130 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.586819 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.587410 19018 raft_consensus.cc:3055] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:26.587531 17523 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:26.587824 19018 raft_consensus.cc:740] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:26.588431 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.588644 19018 consensus_queue.cc:260] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.589766 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1399) took 1471 ms. Trace:
I20260709 13:18:26.589722 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.590173 19139 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:26.590826 17523 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:26.590293 17452 rpcz_store.cc:276] 0709 13:18:25.118777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.915870 (+797093us) service_pool.cc:224] Handling call
0709 13:18:25.916078 (+   208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.916211 (+   133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.916225 (+    14us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.916504 (+   279us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.050845 (+134341us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:26.051288 (+   443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.051363 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.584870 (+533507us) spinlock_profiling.cc:243] Waited 9.58 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:26.589489 (+  4619us) raft_consensus.cc:1685] finished
0709 13:18:26.589509 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.589711 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22024064,"thread_start_us":86143,"threads_started":1,"wal-append.queue_time_us":199021}
I20260709 13:18:26.591763 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.592149 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:26.592288 17523 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:26.592705 17452 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:26.593091 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.593577 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:26.594657 17419 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:26.528365 19020 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:26.532640 19150 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:26.520686 18943 raft_consensus.cc:697] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:26.596283 18943 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.596836 19020 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:26.597687 19048 raft_consensus.cc:3055] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:26.540087 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.502517 18970 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:26.545210 17351 catalog_manager.cc:5697] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 2 to 3, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 3 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:26.546952 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 72) took 1537 ms. Trace:
I20260709 13:18:26.567780 18600 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.548959 18888 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:26.501263 17445 raft_consensus.cc:606] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Received request to transfer leadership to TS 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:26.507937 19100 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:26.571278 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.571300 17524 raft_consensus.cc:2393] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:26.571885 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:26.569521 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:26.573339 19099 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:26.641367 19099 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:26.641793 19099 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.594738 18195 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:26.531092 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1401) took 1410 ms. Trace:
I20260709 13:18:26.590893 19139 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:26.644634 19028 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:26.644405 17450 rpcz_store.cc:276] 0709 13:18:25.120616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.307578 (+1186962us) service_pool.cc:224] Handling call
0709 13:18:26.308080 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.322916 (+ 14836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.322960 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.336770 (+ 13810us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.483307 (+146537us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:26.483364 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.483456 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.530777 (+ 47321us) raft_consensus.cc:1685] finished
0709 13:18:26.530811 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.531015 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7847,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":16273,"thread_start_us":116238,"threads_started":1,"wal-append.queue_time_us":187044}
I20260709 13:18:26.580605 19045 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.583832 18977 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.649384 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.581985 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.650079 17524 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:26.598362 19103 raft_consensus.cc:3055] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:26.652649 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.604482 17447 rpcz_store.cc:276] 0709 13:18:25.009268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.254840 (+245572us) service_pool.cc:224] Handling call
0709 13:18:25.255167 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.255991 (+   824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.256031 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.934486 (+678455us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b2c000014c8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446f372 00007f5ab5ba1a01 00007f5ab5b6643a 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2
0709 13:18:25.952286 (+ 17800us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.127412 (+175126us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:26.127617 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.127734 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.546688 (+418954us) raft_consensus.cc:1685] finished
0709 13:18:26.546706 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.546890 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":407,"raft.queue_time_us":419,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":20464,"spinlock_wait_cycles":7229312,"thread_start_us":147330,"threads_started":1,"wal-append.queue_time_us":288039}
I20260709 13:18:26.652064 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.548648 18891 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.607841 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:26.656193 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.609753 17446 raft_consensus.cc:2393] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:26.610663 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:26.611106 17419 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:26.653541 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1391) took 1543 ms. Trace:
I20260709 13:18:26.617090 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.658140 17601 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:26.618789 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.659093 17595 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:26.657516 17449 rpcz_store.cc:276] 0709 13:18:25.110051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.490173 (+380122us) service_pool.cc:224] Handling call
0709 13:18:25.509586 (+ 19413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.647425 (+137839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.653340 (+1005915us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54003cd7d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:26.653479 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263983488}
I20260709 13:18:26.661942 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.664072 17595 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:26.665011 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.666251 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.662655 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.667909 17601 raft_consensus.cc:2410] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:26.668756 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:18:26.670857 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 63133.1us
I20260709 13:18:26.671286 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.671913 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:26.672304 17525 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:26.674222 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 63225us
I20260709 13:18:26.675169 17419 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:26.676501 17419 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:26.603605 19048 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:26.650372 19018 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.642864 18888 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:26.643401 18970 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.643757 17596 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:26.646291 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:26.600188 19055 consensus_meta.cc:287] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.582s	user 0.005s	sys 0.005s
I20260709 13:18:26.618119 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.538419 18868 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:26.603847 17528 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:26.706408 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.707120 17528 raft_consensus.cc:2410] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:26.654497 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.653712 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:26.611413 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.670850 17446 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:26.673646 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1400) took 1554 ms. Trace:
I20260709 13:18:26.678835 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.681423 17602 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:18:26.640793 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 71367.9us
I20260709 13:18:26.681434 17449 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:26.683576 17419 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:26.595007 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.650905 19100 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:26.708985 17523 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:26.708156 17453 rpcz_store.cc:276] 0709 13:18:25.119374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.285386 (+1166012us) service_pool.cc:224] Handling call
0709 13:18:26.285769 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.295823 (+ 10054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.295867 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.315716 (+ 19849us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.450048 (+134332us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:26.450096 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.450174 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.673377 (+223203us) raft_consensus.cc:1685] finished
0709 13:18:26.673404 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.673572 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6033,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":7534,"thread_start_us":98994,"threads_started":1,"wal-append.queue_time_us":163303}
I20260709 13:18:26.711108 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:26.653002 19103 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:26.696462 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.666939 19080 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:26.704120 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:26.718626 17525 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.688809 18963 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:26.712693 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1091) took 1459 ms. Trace:
I20260709 13:18:26.687254 19026 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.735440 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:26.713994 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.714632 17529 raft_consensus.cc:2410] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:26.713804 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.688916 19079 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:26.686841 19020 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:26.717290 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:26.719410 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.707741 17598 raft_consensus.cc:2393] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 2: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:26.689072 18600 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:26.701349 18970 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.745196 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.738751 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.723430 17449 rpcz_store.cc:276] 0709 13:18:25.253482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.667134 (+1413652us) service_pool.cc:224] Handling call
0709 13:18:26.680439 (+ 13305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.712417 (+ 31978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.712633 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:26.725140 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.739900 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:26.723877 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.689167 19062 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.742097 17523 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:26.713466 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1099) took 1427 ms. Trace:
I20260709 13:18:26.746748 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.747773 17446 rpcz_store.cc:276] 0709 13:18:25.286425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.670218 (+1383793us) service_pool.cc:224] Handling call
0709 13:18:26.670539 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.713196 (+ 42657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.713414 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:26.748927 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:26.750196 19159 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:18:26.750144 19153 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.746253 18943 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:26.751612 18943 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:26.751719 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1398) took 1801 ms. Trace:
I20260709 13:18:26.752068 18943 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.748587 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:26.713428 19100 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:26.763075 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:26.712743 19113 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:26.768443 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:26.766139 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.768046 17523 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:26.771934 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1405) took 1731 ms. Trace:
W20260709 13:18:26.771817 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 84877.6us
I20260709 13:18:26.772558 17523 rpcz_store.cc:276] 0709 13:18:25.040812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.763563 (+1722751us) service_pool.cc:224] Handling call
0709 13:18:26.767710 (+  4147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.771541 (+  3831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.771851 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:26.770442 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.777014 17523 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:26.778748 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.698880 19112 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:18:26.735394 19055 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.723387 18963 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:26.780391 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:26.722709 19116 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:26.792083 17524 raft_consensus.cc:1240] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:26.753628 18970 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.779605 17523 pending_rounds.cc:85] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 1
I20260709 13:18:26.796025 17523 pending_rounds.cc:107] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:26.796391 17523 raft_consensus.cc:2889] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:26.797236 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1408) took 1737 ms. Trace:
I20260709 13:18:26.797899 17523 rpcz_store.cc:276] 0709 13:18:25.059889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.773649 (+1713760us) service_pool.cc:224] Handling call
0709 13:18:26.775029 (+  1380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.796910 (+ 21881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.797168 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:26.784739 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:26.770337 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.741043 19097 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.741870 19027 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.806849 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:26.792263 17525 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:26.792730 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1403) took 1805 ms. Trace:
I20260709 13:18:26.807888 17524 rpcz_store.cc:276] 0709 13:18:24.986928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.762533 (+1775605us) service_pool.cc:224] Handling call
0709 13:18:26.791892 (+ 29359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.792496 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.792677 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:26.703363 18983 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:26.810750 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 127271us
I20260709 13:18:26.781976 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:26.745522 18600 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:26.753198 19062 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:26.740965 18860 consensus_queue.cc:1059] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:18:26.741053 19079 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.717720 19130 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:26.806857 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.812355 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:26.786119 19028 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:26.784263 18939 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:26.788894 19031 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:26.737552 19099 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:26.812000 17419 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:26.793855 18963 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.790346 19055 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:26.856127 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1022) took 1645 ms. Trace:
W20260709 13:18:26.858731 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46847.4us
I20260709 13:18:26.859787 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:26.863293 17524 rpcz_store.cc:276] 0709 13:18:25.211002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.817953 (+1606951us) service_pool.cc:224] Handling call
0709 13:18:26.855496 (+ 37543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.855677 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.855727 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.855784 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:26.855827 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.855902 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.856056 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:26.864087 17419 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:26.818117 19116 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:26.822314 19062 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.819008 18891 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.819608 18600 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.764281 19048 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.875118 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:26.875725 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:26.876601 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 59469.3us
I20260709 13:18:26.862967 18868 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:26.866230 19080 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:26.879599 17419 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:26.859861 19031 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.852929 18939 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:26.891326 17419 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:26.883471 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:26.885603 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1024) took 1674 ms. Trace:
I20260709 13:18:26.896111 17524 rpcz_store.cc:276] 0709 13:18:25.211604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.880349 (+1668745us) service_pool.cc:224] Handling call
0709 13:18:26.885138 (+  4789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.885301 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.885324 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.885362 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:26.885388 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.885435 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.885553 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:26.851171 19079 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.862246 18761 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.855294 18860 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.919384 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:26.920230 17524 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:26.866117 19055 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.825847 19027 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.820078 19097 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.886716 19167 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.805919 19103 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.899284 18983 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:26.874312 18999 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:26.887162 19116 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:26.927065 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 43664.6us
I20260709 13:18:26.924793 17419 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:26.901139 19048 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:26.890795 19080 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.902606 19020 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.902441 18939 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.894404 19031 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.920668 19026 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:26.956261 17523 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:26.881860 18891 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.928956 19167 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:18:26.964648 19161 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:18:26.963860 19080 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:26.980180 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 120487us
I20260709 13:18:26.954911 18999 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.925486 18761 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:26.973620 19026 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.955264 19171 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:26.971125 19103 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.976871 19167 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.979988 18192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42548 (request call id 224) took 1436 ms. Trace:
W20260709 13:18:27.049806 19178 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:27.051448 18999 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:27.051782 19020 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:27.052214 19169 log.cc:927] Time spent T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:18:26.752265 17520 rpcz_store.cc:276] 0709 13:18:24.949994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.277178 (+1327184us) service_pool.cc:224] Handling call
0709 13:18:26.305169 (+ 27991us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.344828 (+ 39659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.347187 (+  2359us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.400031 (+ 52844us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.546288 (+146257us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:26.546343 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.546418 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.751457 (+205039us) raft_consensus.cc:1685] finished
0709 13:18:26.751489 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.751650 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4873,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":17030,"thread_start_us":124991,"threads_started":1,"wal-append.queue_time_us":172276}
I20260709 13:18:26.976505 18750 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.053486 19059 raft_consensus.cc:3055] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:27.061630 18192 rpcz_store.cc:276] 0709 13:18:25.543964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.552795 (+  8831us) service_pool.cc:224] Handling call
0709 13:18:25.648125 (+ 95330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.716584 (+ 68459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.967054 (+1250470us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b54005f0850. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:26.978343 (+ 11289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61045120}
W20260709 13:18:27.066316 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.072814 19099 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:27.135826 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:27.143514 17523 raft_consensus.cc:2393] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:27.030066 19026 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:27.139995 19059 raft_consensus.cc:740] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:27.099393 19020 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:27.156111 19020 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.161101 17526 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:18:27.171940 17527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1392) took 2270 ms (client timeout 2114 ms). Trace:
I20260709 13:18:27.172783 17521 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:27.173468 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1415) took 1474 ms. Trace:
I20260709 13:18:27.173761 17521 rpcz_store.cc:276] 0709 13:18:25.698777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.172084 (+1473307us) service_pool.cc:224] Handling call
0709 13:18:27.172450 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.173203 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.173394 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.176471 19059 consensus_queue.cc:260] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.177536 19059 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:27.179711 17454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1402) took 1254 ms (client timeout 1624 ms). Trace:
W20260709 13:18:27.180171 17454 rpcz_store.cc:269] 0709 13:18:25.925296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.054447 (+129151us) service_pool.cc:224] Handling call
0709 13:18:27.179504 (+1125057us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b54000b5254. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:27.179639 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81771904}
I20260709 13:18:27.180783 19154 raft_consensus.cc:1064] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:27.165064 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 98) took 1723 ms. Trace:
I20260709 13:18:27.181509 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:27.181818 17523 rpcz_store.cc:276] 0709 13:18:25.441910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.144708 (+1702798us) service_pool.cc:224] Handling call
0709 13:18:27.147025 (+  2317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.164628 (+ 17603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.164666 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.164722 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:27.164766 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.164843 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.164992 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:27.172502 17527 rpcz_store.cc:269] 0709 13:18:24.901845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.902229 (+   384us) service_pool.cc:224] Handling call
0709 13:18:27.171650 (+2269421us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400090e54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:27.171829 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522944896}
I20260709 13:18:27.183851 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:27.184949 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:27.182835 17569 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:27.187570 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 187833us
I20260709 13:18:27.188060 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1406) took 1261 ms. Trace:
I20260709 13:18:27.188398 17454 rpcz_store.cc:276] 0709 13:18:25.926512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.187345 (+1260833us) service_pool.cc:224] Handling call
0709 13:18:27.187609 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.187767 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.187790 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.187827 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:27.187855 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.187904 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.188013 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:27.190117 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.181221 19154 raft_consensus.cc:1068] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Unable to promote non-voter 2158c0f750fd4b21afe24135c52167b2: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:27.191430 17454 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:27.145251 19131 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:27.206036 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 248718us
W20260709 13:18:27.214473 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 289770us
W20260709 13:18:27.215152 17453 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.033s	sys 0.066s
I20260709 13:18:27.197751 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1407) took 1271 ms. Trace:
I20260709 13:18:27.216646 17454 rpcz_store.cc:276] 0709 13:18:25.926777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.190712 (+1263935us) service_pool.cc:224] Handling call
0709 13:18:27.191023 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.197395 (+  6372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.197675 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.195274 18850 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:27.195348 19130 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:27.203727 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:27.207042 19097 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.216003 18761 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:27.198467 19031 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.234129 18945 tablet_copy_client.cc:538] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:18:27.234335 19179 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:18:27.272603 19018 consensus_meta.cc:287] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260709 13:18:27.215699 19131 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:27.253010 18888 consensus_meta.cc:287] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.015s
I20260709 13:18:27.287242 18939 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:27.353255 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.354991 17452 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:27.358630 17419 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.66:40943 timed out after 1.728s (SENT) [suppressed 10 similar messages]
I20260709 13:18:27.357550 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 74) took 1826 ms. Trace:
I20260709 13:18:27.232463 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1030) took 2016 ms. Trace:
I20260709 13:18:27.360589 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:27.361445 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1403) took 1435 ms. Trace:
W20260709 13:18:27.274642 18962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.029s	sys 0.028s
W20260709 13:18:27.397531 18962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.030s	sys 0.029s
W20260709 13:18:27.396394 17522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1417) took 1692 ms (client timeout 1756 ms). Trace:
W20260709 13:18:27.402400 17522 rpcz_store.cc:269] 0709 13:18:25.701487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.965505 (+264018us) service_pool.cc:224] Handling call
0709 13:18:27.360027 (+1394522us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b58000f5a98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:27.393708 (+ 33681us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11589504}
I20260709 13:18:27.405012 17522 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:27.357522 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 664144us
I20260709 13:18:27.405731 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1420) took 1652 ms. Trace:
W20260709 13:18:27.371591 17529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 1023) took 2160 ms (client timeout 1728 ms). Trace:
I20260709 13:18:27.378333 18166 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:18:27.428368 18600 consensus_meta.cc:287] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.518s	user 0.018s	sys 0.016s
I20260709 13:18:27.451104 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1079) took 3203 ms. Trace:
I20260709 13:18:27.462566 18600 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:18:27.459502 19055 consensus_meta.cc:287] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.509s	user 0.021s	sys 0.002s
I20260709 13:18:27.232259 18850 raft_consensus.cc:697] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:27.384678 18888 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:27.463923 19055 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:27.267133 18963 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.462582 17448 rpcz_store.cc:276] 0709 13:18:24.247295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.527815 (+280520us) service_pool.cc:224] Handling call
0709 13:18:24.528238 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.137924 (+1609686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.450295 (+1312371us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54000dbbd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.450741 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3509225728}
I20260709 13:18:27.362679 17523 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:27.279774 19027 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.296435 19031 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.312417 19069 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.252851 19062 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:27.281980 19114 consensus_meta.cc:287] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.008s
I20260709 13:18:27.295243 19131 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.323907 19139 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:27.306422 19165 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.445s	user 0.003s	sys 0.000s
I20260709 13:18:27.464993 18850 consensus_queue.cc:237] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.467973 18963 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.433149 17524 raft_consensus.cc:1240] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:27.464375 18888 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.475013 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1418) took 1756 ms. Trace:
I20260709 13:18:27.475497 17523 rpcz_store.cc:276] 0709 13:18:25.718741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.182966 (+1464225us) service_pool.cc:224] Handling call
0709 13:18:27.198918 (+ 15952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.473284 (+274366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.474589 (+  1305us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54003c0ad4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.474902 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374195584}
I20260709 13:18:27.468679 17445 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:27.477133 18888 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.477501 17595 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:27.390269 17447 rpcz_store.cc:276] 0709 13:18:25.925589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.714457 (+788868us) service_pool.cc:224] Handling call
0709 13:18:26.714881 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.955385 (+240504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.955415 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.956850 (+  1435us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.360570 (+403720us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:27.360654 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.360765 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.360853 (+    88us) raft_consensus.cc:1685] finished
0709 13:18:27.360871 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.361172 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38103,"raft.run_cpu_time_us":4353,"raft.run_wall_time_us":668899,"spinlock_wait_cycles":41382144,"thread_start_us":643025,"threads_started":2,"wal-append.queue_time_us":330021}
I20260709 13:18:27.479032 19062 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:27.479645 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:27.461649 17529 rpcz_store.cc:269] 0709 13:18:25.211299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.666221 (+454922us) service_pool.cc:224] Handling call
0709 13:18:27.371110 (+1704889us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002f7e54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:27.371355 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2408314112}
I20260709 13:18:27.481338 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:27.272564 19167 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:27.236122 19174 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:27.289677 19180 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:18:27.388514 17525 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:18:27.520314 17525 pending_rounds.cc:85] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 4
I20260709 13:18:27.520694 17525 pending_rounds.cc:107] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:27.521067 17525 raft_consensus.cc:2889] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:27.520406 19174 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.389191 17527 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:27.523962 19099 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.524756 19099 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:27.379282 18192 raft_consensus.cc:2393] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 4: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:27.378012 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 931) took 1453 ms. Trace:
I20260709 13:18:27.527474 17599 rpcz_store.cc:276] 0709 13:18:25.924739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.951237 (+ 26498us) service_pool.cc:224] Handling call
0709 13:18:25.951615 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.410283 (+458668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.377261 (+966978us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b5400316354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.377683 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859191808}
I20260709 13:18:27.318881 19079 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.409056 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:27.531060 19167 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:27.410295 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:27.410745 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:27.532547 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1419) took 1813 ms. Trace:
I20260709 13:18:27.532858 18197 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.533057 17527 rpcz_store.cc:276] 0709 13:18:25.719364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.183800 (+1464436us) service_pool.cc:224] Handling call
0709 13:18:27.184134 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.522998 (+338864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.532164 (+  9166us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540013a1d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.532481 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469868416}
I20260709 13:18:27.413856 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:27.416128 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:27.416836 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:27.367481 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.388537 18856 consensus_meta.cc:287] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.804s	user 0.013s	sys 0.018s
I20260709 13:18:27.421778 18705 raft_consensus.cc:3055] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:27.386082 18891 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:27.432358 17526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1413) took 2269 ms (client timeout 2481 ms). Trace:
I20260709 13:18:27.298089 19026 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.453179 17451 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.463135 19190 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:27.373883 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:27.461427 18935 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:27.309139 19045 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.548286 17528 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:27.548779 18888 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.544700 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1411) took 2445 ms. Trace:
I20260709 13:18:27.549499 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:27.549767 17525 rpcz_store.cc:276] 0709 13:18:25.098941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.808212 (+1709271us) service_pool.cc:224] Handling call
0709 13:18:26.808578 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.521675 (+713097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.537127 (+ 15452us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b5400020dd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.544641 (+  7514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331236224}
I20260709 13:18:27.551206 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:27.551473 17525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dac17c6792414180963986e500f47356"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:27.541216 19190 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:27.552783 19190 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:27.552672 17525 raft_consensus.cc:606] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:27.553397 17525 raft_consensus.cc:614] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:27.555274 17525 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:27.555884 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1424) took 1505 ms. Trace:
I20260709 13:18:27.556217 17525 rpcz_store.cc:276] 0709 13:18:26.050699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.554512 (+1503813us) service_pool.cc:224] Handling call
0709 13:18:27.554925 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.555664 (+   739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.555832 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.558312 19139 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.559193 19139 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.561389 19139 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.466097 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:27.481374 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1101) took 2177 ms. Trace:
I20260709 13:18:27.482419 18750 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.562391 17448 raft_consensus.cc:2393] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:27.562085 17445 rpcz_store.cc:276] 0709 13:18:25.303791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.678448 (+1374657us) service_pool.cc:224] Handling call
0709 13:18:26.715798 (+ 37350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.477060 (+761262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.480442 (+  3382us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54001f0754. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.481315 (+   873us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726554880}
I20260709 13:18:27.563390 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:27.481737 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1029) took 2268 ms. Trace:
I20260709 13:18:27.389508 17520 rpcz_store.cc:276] 0709 13:18:25.213316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.139637 (+1926321us) service_pool.cc:224] Handling call
0709 13:18:27.181707 (+ 42070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.193743 (+ 12036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.199500 (+  5757us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.201331 (+  1831us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:27.217729 (+ 16398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.223108 (+  5379us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.229373 (+  6265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.564466 17445 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:27.565371 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1103) took 1446 ms. Trace:
I20260709 13:18:27.565861 17520 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:27.566614 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1425) took 1045 ms. Trace:
I20260709 13:18:27.567028 17520 rpcz_store.cc:276] 0709 13:18:26.521552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.564747 (+1043195us) service_pool.cc:224] Handling call
0709 13:18:27.565300 (+   553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.566343 (+  1043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.566554 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.565758 17445 rpcz_store.cc:276] 0709 13:18:26.118807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.563569 (+1444762us) service_pool.cc:224] Handling call
0709 13:18:27.564011 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.564984 (+   973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.565277 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.568279 19099 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:27.466123 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:27.483634 17449 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:27.568831 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.569319 17452 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:27.388422 18939 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:27.463193 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 85473.8us
W20260709 13:18:27.570093 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 153515us
I20260709 13:18:27.570740 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1410) took 1083 ms. Trace:
I20260709 13:18:27.571281 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:27.571727 18166 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:27.572108 19167 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:27.481812 19114 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:27.573392 18891 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:27.461292 17522 rpcz_store.cc:276] 0709 13:18:25.752875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.403989 (+1651114us) service_pool.cc:224] Handling call
0709 13:18:27.404619 (+   630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.405435 (+   816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.405631 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.574836 19114 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.575021 19079 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.575239 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1432) took 1028 ms. Trace:
I20260709 13:18:27.576188 17454 raft_consensus.cc:1240] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:27.575753 17522 rpcz_store.cc:276] 0709 13:18:26.547269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.574173 (+1026904us) service_pool.cc:224] Handling call
0709 13:18:27.574604 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.574928 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.574951 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.575012 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:27.575039 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.575093 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.575187 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.577301 19026 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.577673 17522 raft_consensus.cc:1240] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:27.425752 19080 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.489719 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:27.490614 17521 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:27.492689 19055 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:27.492719 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:27.494055 18825 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:27.495601 17600 raft_consensus.cc:1240] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:27.309968 19100 consensus_meta.cc:287] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.008s
I20260709 13:18:27.583961 19174 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.583725 19100 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:27.584481 19080 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.585299 17595 raft_consensus.cc:2368] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:27.497349 17597 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:27.498983 17349 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40498 (request call id 187) took 5969 ms. Trace:
I20260709 13:18:27.511253 17447 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:27.485682 18600 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.389215 17453 rpcz_store.cc:276] 0709 13:18:25.531218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.709811 (+1178593us) service_pool.cc:224] Handling call
0709 13:18:26.710152 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.216275 (+506123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.216311 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.216885 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.356573 (+139688us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:27.356726 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.356888 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.356961 (+    73us) raft_consensus.cc:1685] finished
0709 13:18:27.356978 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.357292 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34839,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":29072,"thread_start_us":644086,"threads_started":2,"wal-append.queue_time_us":76080}
I20260709 13:18:27.587636 17525 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:27.539299 17526 rpcz_store.cc:269] 0709 13:18:25.163039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.039305 (+876266us) service_pool.cc:224] Handling call
0709 13:18:27.431896 (+1392591us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400089654. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:27.432156 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2557281536}
I20260709 13:18:27.545814 17596 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:27.538050 18705 raft_consensus.cc:740] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:27.546650 17450 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:27.546520 17603 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:27.547068 18935 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.549319 18888 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.571554 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1404) took 1645 ms. Trace:
I20260709 13:18:27.589423 17420 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:27.573526 18194 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:27.578438 19172 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:27.487048 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.577690 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1408) took 1650 ms. Trace:
I20260709 13:18:27.440531 17351 catalog_manager.cc:5697] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 3 to 4, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 4 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:27.486663 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1421) took 1564 ms. Trace:
I20260709 13:18:27.552048 17528 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:27.582237 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1033) took 1026 ms. Trace:
I20260709 13:18:27.594005 17522 rpcz_store.cc:276] 0709 13:18:26.552969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.577010 (+1024041us) service_pool.cc:224] Handling call
0709 13:18:27.577386 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.579587 (+  2201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.579729 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.564319 17524 rpcz_store.cc:276] 0709 13:18:25.212982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.924132 (+1711150us) service_pool.cc:224] Handling call
0709 13:18:27.432649 (+508517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.474959 (+ 42310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.476147 (+  1188us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400089650. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:27.481655 (+  5508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156061440}
I20260709 13:18:27.586947 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1102) took 1468 ms. Trace:
I20260709 13:18:27.539306 17529 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:27.588965 17448 raft_consensus.cc:2368] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6.
I20260709 13:18:27.593850 17523 rpcz_store.cc:276] 0709 13:18:25.922088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.477139 (+1555051us) service_pool.cc:224] Handling call
0709 13:18:27.477580 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.477788 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.477814 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.477877 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:27.477911 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.477971 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.486574 (+  8603us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.595098 17447 rpcz_store.cc:276] 0709 13:18:26.118563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.509330 (+1390767us) service_pool.cc:224] Handling call
0709 13:18:27.509850 (+   520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.586686 (+ 76836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.586896 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.592396 17449 rpcz_store.cc:276] 0709 13:18:25.925833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.746688 (+820855us) service_pool.cc:224] Handling call
0709 13:18:26.747014 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.569222 (+822208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.570942 (+  1720us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54002008d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.571490 (+   548us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693077376}
I20260709 13:18:27.593528 17454 rpcz_store.cc:276] 0709 13:18:25.927030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.454017 (+1526987us) service_pool.cc:224] Handling call
0709 13:18:27.454739 (+   722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.576766 (+122027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.577451 (+   685us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400351e54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.577619 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278489856}
I20260709 13:18:27.568847 17520 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:27.586710 19100 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:27.604171 17453 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:27.604394 18825 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:27.604986 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1411) took 1115 ms. Trace:
I20260709 13:18:27.605378 17453 rpcz_store.cc:276] 0709 13:18:26.489916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.596917 (+1107001us) service_pool.cc:224] Handling call
0709 13:18:27.603799 (+  6882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.604697 (+   898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.604912 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.605877 17448 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:27.606623 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1421) took 1086 ms. Trace:
I20260709 13:18:27.606937 17448 rpcz_store.cc:276] 0709 13:18:26.520253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.605246 (+1084993us) service_pool.cc:224] Handling call
0709 13:18:27.605602 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.606366 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.606565 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.607482 17449 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:27.607589 18935 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.608366 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1415) took 1090 ms. Trace:
I20260709 13:18:27.606627 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1412) took 1106 ms. Trace:
I20260709 13:18:27.608743 17449 rpcz_store.cc:276] 0709 13:18:26.518445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.606680 (+1088235us) service_pool.cc:224] Handling call
0709 13:18:27.607043 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.607944 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.608281 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.609432 17447 rpcz_store.cc:276] 0709 13:18:26.500631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.601831 (+1101200us) service_pool.cc:224] Handling call
0709 13:18:27.605928 (+  4097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.606254 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.606279 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.606345 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:27.606371 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.606424 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.606550 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.610997 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1422) took 1678 ms. Trace:
I20260709 13:18:27.616657 17529 rpcz_store.cc:276] 0709 13:18:25.924074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.480836 (+1556762us) service_pool.cc:224] Handling call
0709 13:18:27.481236 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.595236 (+114000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.600392 (+  5156us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b5400414454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.602504 (+  2112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111124864}
I20260709 13:18:27.627086 17449 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:27.586709 17349 rpcz_store.cc:276] 0709 13:18:21.529159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.529313 (+   154us) service_pool.cc:224] Handling call
0709 13:18:27.498660 (+5969347us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:23.135865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:23.263250 (+127385us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:23.267658 (+  4408us) write_op.cc:435] Acquired schema lock
0709 13:18:23.274734 (+  7076us) tablet.cc:662] Decoding operations
0709 13:18:23.504888 (+230154us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:23.515823 (+ 10935us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:23.520431 (+  4608us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:18:23.595552 (+ 75121us) tablet.cc:701] Row locks acquired
0709 13:18:23.595589 (+    37us) write_op.cc:260] PREPARE: finished
0709 13:18:23.595800 (+   211us) write_op.cc:270] Start()
0709 13:18:23.595959 (+   159us) write_op.cc:276] Timestamp: P: 1783603103595735 usec, L: 0
0709 13:18:23.595993 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:18:23.596872 (+   879us) log.cc:844] Serialized 3247 byte log entry
0709 13:18:24.492782 (+895910us) op_driver.cc:464] REPLICATION: finished
0709 13:18:24.964576 (+471794us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b1800397120. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a79522 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:25.873809 (+909233us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab2a5c0ac 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab959cef0
0709 13:18:25.985365 (+111556us) write_op.cc:301] APPLY: starting
0709 13:18:25.985444 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:25.985652 (+   208us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:25.985674 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:25.986662 (+   988us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:25.986864 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:18:25.986917 (+    53us) write_op.cc:312] APPLY: finished
0709 13:18:25.987182 (+   265us) log.cc:844] Serialized 64 byte log entry
0709 13:18:26.207479 (+220297us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:26.207599 (+   120us) write_op.cc:454] Released schema lock
0709 13:18:26.235414 (+ 27815us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:26.235832 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:26.235863 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":65888,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":1486331,"apply.run_cpu_time_us":108348,"apply.run_wall_time_us":250464,"num_ops":8,"prepare.queue_time_us":75587,"prepare.run_cpu_time_us":26526,"prepare.run_wall_time_us":1066400,"raft.queue_time_us":149715,"raft.run_cpu_time_us":49308,"raft.run_wall_time_us":1743271,"replication_time_us":874604,"spinlock_wait_cycles":74472960,"thread_start_us":2523707,"threads_started":5,"wal-append.queue_time_us":865604,"wal-append.run_cpu_time_us":39931,"wal-append.run_wall_time_us":2347004}]]}
I20260709 13:18:27.616441 17451 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:18:27.615249 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 102) took 1387 ms. Trace:
I20260709 13:18:27.631595 17525 rpcz_store.cc:276] 0709 13:18:26.205742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.557009 (+1351267us) service_pool.cc:224] Handling call
0709 13:18:27.557432 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.589781 (+ 32349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.592639 (+  2858us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b5400201cd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.592796 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68344576}
I20260709 13:18:27.630409 17451 pending_rounds.cc:85] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 5
I20260709 13:18:27.636224 17451 pending_rounds.cc:107] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:27.636906 17451 raft_consensus.cc:2889] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:27.639760 18888 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.640986 17454 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:27.641745 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1413) took 1136 ms. Trace:
I20260709 13:18:27.641824 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1043) took 1085 ms. Trace:
I20260709 13:18:27.642103 17454 rpcz_store.cc:276] 0709 13:18:26.504936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.602648 (+1097712us) service_pool.cc:224] Handling call
0709 13:18:27.640726 (+ 38078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.641472 (+   746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.641673 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.642246 17524 rpcz_store.cc:276] 0709 13:18:26.556559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.627351 (+1070792us) service_pool.cc:224] Handling call
0709 13:18:27.630002 (+  2651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.641457 (+ 11455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.641507 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.641571 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:27.641610 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.641666 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.641773 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:27.643734 18943 consensus_meta.cc:287] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.864s	user 0.004s	sys 0.033s
I20260709 13:18:27.643985 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:27.644212 18943 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:27.644685 17524 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.645552 17446 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:27.646862 18825 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:27.633601 18194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42548 (request call id 228) took 1149 ms. Trace:
I20260709 13:18:27.647816 18825 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:27.648653 17568 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:27.646972 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1405) took 1720 ms. Trace:
I20260709 13:18:27.649789 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:27.633984 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 63901us
W20260709 13:18:27.654424 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 73991.5us
I20260709 13:18:27.632923 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:27.656574 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 311614us
I20260709 13:18:27.659360 17452 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:27.618896 19080 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:27.648329 18194 rpcz_store.cc:276] 0709 13:18:26.481808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.484098 (+  2290us) service_pool.cc:224] Handling call
0709 13:18:26.517032 (+ 32934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.603806 (+1086774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.628938 (+ 25132us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400438354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.630919 (+  1981us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428575104}
I20260709 13:18:27.649919 17446 rpcz_store.cc:276] 0709 13:18:25.926240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.748796 (+822556us) service_pool.cc:224] Handling call
0709 13:18:26.749120 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.645949 (+896829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.646659 (+   710us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54001851d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.646919 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2060674304}
I20260709 13:18:27.571362 17445 rpcz_store.cc:276] 0709 13:18:26.487733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.568270 (+1080537us) service_pool.cc:224] Handling call
0709 13:18:27.569758 (+  1488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.570343 (+   585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.570377 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.570428 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:27.570461 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.570540 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.570663 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.655676 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1042) took 1099 ms. Trace:
I20260709 13:18:27.671002 17529 rpcz_store.cc:276] 0709 13:18:26.556249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.620051 (+1063802us) service_pool.cc:224] Handling call
0709 13:18:27.654683 (+ 34632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.655225 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.655262 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.655341 (+    79us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:27.655389 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.655468 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.655623 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1665}
I20260709 13:18:27.671586 17452 raft_consensus.cc:1240] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:27.671725 17527 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:27.629742 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1428) took 1092 ms. Trace:
I20260709 13:18:27.675256 17528 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:27.679739 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1423) took 1747 ms. Trace:
I20260709 13:18:27.680281 17527 rpcz_store.cc:276] 0709 13:18:25.925296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.538689 (+1613393us) service_pool.cc:224] Handling call
0709 13:18:27.592022 (+ 53333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.672249 (+ 80227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.672482 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.681618 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1396) took 2555 ms. Trace:
W20260709 13:18:27.668449 18928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.008s	sys 0.004s
I20260709 13:18:27.682143 17451 rpcz_store.cc:276] 0709 13:18:25.117129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.755829 (+638700us) service_pool.cc:224] Handling call
0709 13:18:25.756150 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.064421 (+308271us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400144c20. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5adddc0 00007f5ab5b681c0 00007f5ab5b69231 00007f5ab5b65d8f 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c
0709 13:18:27.437831 (+1373410us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b58001a03d0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5ac20aa 00007f5ab5b44447 00007f5ab5b5cfe7 00007f5ab5b5e7de 00007f5ab5b68b49 00007f5ab5b69416 00007f5ab5b65d8f 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4
0709 13:18:27.666705 (+228874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.672382 (+  5677us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3046057600}
I20260709 13:18:27.686362 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1035) took 1132 ms. Trace:
I20260709 13:18:27.688918 17528 rpcz_store.cc:276] 0709 13:18:26.553909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.612799 (+1058890us) service_pool.cc:224] Handling call
0709 13:18:27.661471 (+ 48672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.686005 (+ 24534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.686294 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.690538 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:27.691370 17528 raft_consensus.cc:2376] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3. Re-sending same reply.
I20260709 13:18:27.653765 19114 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:27.696492 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 940) took 1084 ms. Trace:
I20260709 13:18:27.678364 17520 rpcz_store.cc:276] 0709 13:18:26.529545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.567923 (+1038378us) service_pool.cc:224] Handling call
0709 13:18:27.568395 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.602984 (+ 34589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.622097 (+ 19113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:27.710134 19051 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:18:27.730571 19114 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:27.731506 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:27.693785 18928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.008s	sys 0.004s
I20260709 13:18:27.732813 19114 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:27.732831 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:27.725170 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 65227.8us
I20260709 13:18:27.735029 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:27.735688 17520 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.737087 19107 consensus_queue.cc:1059] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:27.709693 19020 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.703145 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
W20260709 13:18:27.740702 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 153942us
I20260709 13:18:27.740954 19020 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.741724 18928 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:27.742204 18999 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:27.744624 17453 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:27.685655 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1416) took 1985 ms. Trace:
I20260709 13:18:27.697870 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:27.697446 17445 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:27.705395 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:27.718458 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 70021us
I20260709 13:18:27.702999 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:27.725951 17526 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:27.727183 17446 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:27.745237 17521 rpcz_store.cc:276] 0709 13:18:25.699798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.174522 (+1474724us) service_pool.cc:224] Handling call
0709 13:18:27.174816 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.591930 (+417114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.673152 (+ 81222us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400413054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.685583 (+ 12431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725290368}
W20260709 13:18:27.702567 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 71887.9us
I20260709 13:18:27.782828 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:27.707000 18705 consensus_queue.cc:260] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:27.783233 17520 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:27.744542 17601 rpcz_store.cc:276] 0709 13:18:26.612311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.668943 (+ 56632us) service_pool.cc:224] Handling call
0709 13:18:26.669616 (+   673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.669867 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:26.686195 (+ 16328us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.428680 (+742485us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b1800204e20. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab570623a 00007f5ab5b70a2a
0709 13:18:27.695822 (+267142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.695941 (+   119us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:27.696016 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.696115 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.696290 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20404,"prepare.queue_time_us":3283,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":16639,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":45492,"spinlock_wait_cycles":5452544,"thread_start_us":228671,"threads_started":1}
W20260709 13:18:27.784186 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.784320 18705 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:27.784448 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:27.784989 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:27.785671 17527 raft_consensus.cc:2376] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3. Re-sending same reply.
I20260709 13:18:27.783285 17529 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:27.776832 17526 pending_rounds.cc:85] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 2
I20260709 13:18:27.708420 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:27.784567 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:27.750517 18945 tablet_bootstrap.cc:492] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
W20260709 13:18:27.724841 18970 consensus_meta.cc:287] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.912s	user 0.018s	sys 0.015s
I20260709 13:18:27.720978 19172 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:27.795343 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:27.771705 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:27.792714 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:27.796276 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:27.798207 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:27.798312 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:27.792369 17526 pending_rounds.cc:107] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:27.797425 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:27.797217 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:27.789458 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:27.824947 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:27.792196 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:27.807554 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 99335.6us
I20260709 13:18:27.823496 17526 raft_consensus.cc:2889] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:27.804647 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:27.706301 18943 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:27.707983 19062 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:27.794829 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:27.795778 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:27.852309 17521 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:27.816547 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 61261us
W20260709 13:18:27.840399 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.853397 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.850585 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.815325 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1424) took 1163 ms. Trace:
I20260709 13:18:27.830874 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:27.792132 17568 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:27.853916 17523 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:27.807753 19020 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:27.852887 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:27.812923 18935 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.867758 18167 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:27.785982 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:27.864590 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1037) took 1310 ms. Trace:
I20260709 13:18:27.868453 17526 rpcz_store.cc:276] 0709 13:18:26.554613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.630326 (+1075713us) service_pool.cc:224] Handling call
0709 13:18:27.725482 (+ 95156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.864293 (+138811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.864515 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.810842 19172 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.802757 19171 raft_consensus.cc:3055] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:27.854532 17453 rpcz_store.cc:276] 0709 13:18:26.651725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.613528 (+961803us) service_pool.cc:224] Handling call
0709 13:18:27.654187 (+ 40659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.776177 (+121990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.814941 (+ 38764us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b5400193054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:27.815240 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207553280}
I20260709 13:18:27.799008 17596 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:27.816277 18197 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:27.878196 19151 raft_consensus.cc:1064] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:27.879187 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:27.879845 17419 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:27.880550 19045 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:27.882189 17595 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:27.815770 19170 consensus_queue.cc:1059] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:18:27.882791 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:27.883569 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:27.830525 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:27.885440 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:27.858165 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:27.890467 17527 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:27.883733 19107 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:27.886751 19055 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.807551 19181 consensus_queue.cc:1059] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:18:27.887810 19172 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:27.886937 19171 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:27.814231 19080 consensus_queue.cc:1059] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:18:27.814066 19026 consensus_queue.cc:1059] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:18:27.808597 18970 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.826743 19190 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:27.892812 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:27.920644 17528 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:27.921332 17525 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:27.887125 18935 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:27.895857 19151 raft_consensus.cc:1068] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Unable to promote non-voter 2158c0f750fd4b21afe24135c52167b2: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:27.896651 19062 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:27.919094 17529 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:27.924957 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45197.6us
I20260709 13:18:27.911360 17520 raft_consensus.cc:2410] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:27.926864 18194 raft_consensus.cc:2393] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:27.923079 19167 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:27.933382 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 49922us
I20260709 13:18:27.876772 17524 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:27.925256 17598 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:27.934587 19062 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.943288 17419 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:27.944408 17527 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:27.945147 17569 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:27.945391 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1049) took 1358 ms. Trace:
I20260709 13:18:27.946074 17527 rpcz_store.cc:276] 0709 13:18:26.587446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.903201 (+1315755us) service_pool.cc:224] Handling call
0709 13:18:27.927347 (+ 24146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.944960 (+ 17613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.945321 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.948091 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:27.949040 19100 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:27.928376 18962 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:27.928725 18888 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:27.955864 17524 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:27.955761 19188 raft_consensus.cc:3055] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:27.956954 19188 raft_consensus.cc:740] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:18:27.958915 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 166959us
I20260709 13:18:27.960155 17526 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:27.961012 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 57572.1us
I20260709 13:18:27.958213 19188 consensus_queue.cc:260] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.964419 19188 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:27.944868 18999 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:27.982870 18888 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:27.982712 19171 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:27.983747 18888 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.984501 19171 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.986666 18888 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:27.922853 18928 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:18:27.926959 19055 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:27.993263 17495 leader_election.cc:400] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:27.996729 17495 leader_election.cc:403] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:18:27.998335 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 66531.6us
I20260709 13:18:28.000578 18962 raft_consensus.cc:697] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:28.000959 19131 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.001571 19131 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.001745 18962 consensus_queue.cc:237] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.003998 19131 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.004459 19080 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:28.004894 19080 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.004845 18838 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:18:28.005419 19080 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.013571 17525 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:28.016808 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 73830.9us
I20260709 13:18:27.991951 18935 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:28.023952 17419 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:28.030177 18850 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:28.030678 18850 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:28.031185 18850 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:28.037505 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.996471 18999 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:18:28.044430 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.054744 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 105045us
I20260709 13:18:28.056437 18928 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:18:28.041661 19100 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:28.047631 18999 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:28.072249 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:28.058461 18935 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:28.076565 17521 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:28.041854 18888 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:28.070617 19020 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:28.083375 19067 raft_consensus.cc:3055] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:28.084018 19067 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:28.083434 19020 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:28.087919 19020 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:28.090158 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.089666 19020 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:28.095045 19199 log.cc:927] Time spent T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:28.052320 19026 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:18:28.104710 19151 raft_consensus.cc:3055] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:28.105288 19151 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:28.106508 19151 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:28.108378 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:28.110000 18761 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:28.122980 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 50226.6us
W20260709 13:18:28.141234 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 73805.3us
I20260709 13:18:28.146456 17568 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:28.085286 19067 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:28.148891 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 79910.1us
I20260709 13:18:28.128667 18935 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:18:28.184125 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.148018 18761 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:28.184398 17528 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
W20260709 13:18:28.190971 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.192194 19026 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:18:28.189620 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.201702 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1034) took 1648 ms. Trace:
I20260709 13:18:28.202595 17522 rpcz_store.cc:276] 0709 13:18:26.553527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.604318 (+1050791us) service_pool.cc:224] Handling call
0709 13:18:27.604737 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.605090 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:27.827338 (+222248us) log.cc:844] Serialized 14 byte log entry
0709 13:18:28.201245 (+373907us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:28.201322 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:28.201388 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.201476 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.201633 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":377338,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"thread_start_us":516256,"threads_started":2}
I20260709 13:18:28.205386 18708 consensus_queue.cc:1059] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:28.164374 19151 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.229154 18838 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:28.229574 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 179646us
I20260709 13:18:28.163909 19190 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:28.232963 19190 consensus_queue.cc:1059] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:28.234392 19190 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.236706 17523 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:18:28.215116 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:28.216531 17419 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:28.185492 18970 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.237241 17523 pending_rounds.cc:85] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 4
I20260709 13:18:28.243007 17523 pending_rounds.cc:107] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:28.243371 17523 raft_consensus.cc:2889] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:28.200668 18856 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:28.181274 18935 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.158870 18888 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.245908 17419 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:28.235054 19190 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:28.248245 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 85850us
I20260709 13:18:28.247673 19131 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:28.247181 19067 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:28.258901 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 182282us
I20260709 13:18:28.262841 17569 leader_election.cc:400] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6.
I20260709 13:18:28.249711 18761 raft_consensus.cc:3055] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:28.263236 17569 leader_election.cc:403] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:18:28.287390 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.287441 17568 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:28.287846 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1048) took 1700 ms. Trace:
I20260709 13:18:28.288462 17523 rpcz_store.cc:276] 0709 13:18:26.587181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.878373 (+1291192us) service_pool.cc:224] Handling call
0709 13:18:27.878736 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.258613 (+379877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.287474 (+ 28861us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400090454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:28.287748 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822102784}
I20260709 13:18:28.261071 19026 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:28.261107 19055 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.255479 18708 consensus_queue.cc:1059] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:18:28.264070 18761 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:28.265555 19131 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:28.296219 17420 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:28.256863 18856 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.316040 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:28.319434 17522 raft_consensus.cc:2410] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:28.287528 18705 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:28.323410 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:28.291141 19181 raft_consensus.cc:3055] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:18:28.334400 19204 log.cc:927] Time spent T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:28.335125 19171 raft_consensus.cc:3055] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:28.335698 19171 raft_consensus.cc:740] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:18:28.335353 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 49856.6us
I20260709 13:18:28.336802 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1423) took 1772 ms. Trace:
I20260709 13:18:28.331664 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:28.340404 17526 raft_consensus.cc:2410] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:28.341746 17528 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.339309 18943 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:28.296382 18825 consensus_queue.cc:1059] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:18:28.314749 19026 raft_consensus.cc:697] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:28.350404 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:28.350210 19131 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:28.338383 17448 rpcz_store.cc:276] 0709 13:18:26.564262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.607709 (+1043447us) service_pool.cc:224] Handling call
0709 13:18:27.608310 (+   601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.616584 (+  8274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.616614 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.678826 (+ 62212us) log.cc:844] Serialized 26 byte log entry
0709 13:18:28.064748 (+385922us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:28.064789 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.064858 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.336567 (+271709us) raft_consensus.cc:1685] finished
0709 13:18:28.336586 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.336740 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4304,"raft.queue_time_us":8048,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":9350,"thread_start_us":362486,"threads_started":1,"wal-append.queue_time_us":542960}
I20260709 13:18:28.331167 18705 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:28.356158 18705 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:28.357065 19188 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:28.359647 19107 raft_consensus.cc:3055] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:28.360198 19107 raft_consensus.cc:740] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:28.361166 19107 consensus_queue.cc:260] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:28.331418 19181 raft_consensus.cc:740] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:28.363041 19181 consensus_queue.cc:260] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:28.364691 19181 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:28.336879 19167 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.367062 19107 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:28.367264 19167 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.370388 18761 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:28.372174 18761 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:28.381208 18999 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.382413 19107 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:28.384166 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.383014 19107 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:28.387845 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:28.388121 18888 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.388552 17448 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:28.388670 19026 consensus_queue.cc:237] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.389904 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:28.390748 19114 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:28.391050 18891 consensus_meta.cc:287] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.817s	user 0.013s	sys 0.000s
I20260709 13:18:28.391134 19114 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:28.391508 18891 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:28.391637 19114 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:28.393481 19100 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.394217 19100 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.396732 19100 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.397331 19100 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.389917 19062 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.400241 19062 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:28.400831 19062 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:28.401787 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.402141 17528 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:28.387765 18856 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:28.405192 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 117836us
W20260709 13:18:28.408990 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 60318.9us
W20260709 13:18:28.431950 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.433001 17529 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:28.377430 19172 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:28.416610 19208 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.003s
I20260709 13:18:28.442283 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:28.446692 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1414) took 1931 ms. Trace:
W20260709 13:18:28.439109 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 293034us
I20260709 13:18:28.410193 18856 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:28.455320 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:28.453202 17449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.009s	sys 0.044s
W20260709 13:18:28.461454 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 111170us
W20260709 13:18:28.450729 17447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.009s	sys 0.043s
I20260709 13:18:28.453454 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:28.397868 19100 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:28.467569 17449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.009s	sys 0.044s
W20260709 13:18:28.470006 17447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.010s	sys 0.043s
I20260709 13:18:28.471254 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:28.343942 19171 consensus_queue.cc:260] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:28.485071 17568 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:28.408447 18850 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.452222 19167 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.449762 19051 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:28.449028 18962 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:28.490962 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:28.487118 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1430) took 1030 ms. Trace:
I20260709 13:18:28.439815 19080 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.506369 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1426) took 1839 ms. Trace:
I20260709 13:18:28.504019 19051 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.507985 17447 rpcz_store.cc:276] 0709 13:18:26.666780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.612574 (+945794us) service_pool.cc:224] Handling call
0709 13:18:27.615806 (+  3232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.623943 (+  8137us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:27.905810 (+281867us) log.cc:844] Serialized 14 byte log entry
0709 13:18:28.505939 (+600129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:28.506000 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:28.506077 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.506158 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.506301 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39312,"prepare.queue_time_us":519136,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2866,"raft.queue_time_us":35513,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":813042,"threads_started":2}
I20260709 13:18:28.486106 19114 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:28.515830 19100 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.516237 18850 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:28.517406 19114 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.520505 19027 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:28.521054 19027 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.500779 19107 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.523065 19027 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.523661 19027 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:28.524029 19027 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.524360 19027 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:28.528020 17495 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:28.529654 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 54891us
W20260709 13:18:28.530861 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.533274 19055 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:28.533852 19055 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.534281 19055 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.533300 18943 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:18:28.542726 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:28.542932 18999 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:28.545189 18943 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.545555 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:28.545248 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:28.546842 17596 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:28.505193 18196 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 4: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:28.556375 19051 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.556945 19080 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.502636 17449 rpcz_store.cc:276] 0709 13:18:27.457220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.633584 (+176364us) service_pool.cc:224] Handling call
0709 13:18:27.637667 (+  4083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.638157 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:27.906737 (+268580us) log.cc:844] Serialized 14 byte log entry
0709 13:18:28.486677 (+579940us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:28.486746 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:28.486802 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.486888 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.487049 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13443,"prepare.queue_time_us":520257,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":25546,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":133,"thread_start_us":806542,"threads_started":2}
I20260709 13:18:28.558036 19171 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:28.560132 19055 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.495082 17419 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:28.568087 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 51099.2us
W20260709 13:18:28.568715 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 80972.7us
I20260709 13:18:28.569262 17568 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:28.571633 17419 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:28.465190 18888 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:28.572903 18888 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.573305 18888 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.574573 18891 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.575237 18891 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.577301 18891 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.545819 18943 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.561728 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:28.493754 18970 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:28.563766 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:28.565682 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:28.586562 18970 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.587177 17597 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:28.566542 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:28.587265 18970 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.566956 19100 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:28.588621 19100 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.567538 19190 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:28.452339 18856 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:28.572333 19079 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:28.578307 17419 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:28.584398 18943 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.621263 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:28.592312 18196 raft_consensus.cc:1240] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:28.624253 19079 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:28.625062 19079 raft_consensus.cc:697] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:28.625353 18856 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:28.627465 19055 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:28.623415 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45182.3us
I20260709 13:18:28.629777 19079 consensus_queue.cc:237] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.590642 19100 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.616650 18999 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:18:28.644234 18999 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:28.642007 18856 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.447314 17450 rpcz_store.cc:276] 0709 13:18:26.515310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.602210 (+1086900us) service_pool.cc:224] Handling call
0709 13:18:27.684494 (+ 82284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.705813 (+ 21319us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:28.047228 (+341415us) log.cc:844] Serialized 14 byte log entry
0709 13:18:28.446212 (+398984us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:28.446276 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:28.446330 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.446415 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.446554 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":494851,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":7302,"thread_start_us":619375,"threads_started":2}
I20260709 13:18:28.651624 18856 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:28.655251 18194 raft_consensus.cc:1240] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:28.633625 18705 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.475869 18166 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:28.664489 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:28.711122 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:28.717259 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:28.742390 17526 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.742704 17521 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:28.657764 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:28.671022 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.751045 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.617000 19172 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.589924 18970 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.750133 17451 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:28.758694 17524 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:28.657913 19062 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6.
I20260709 13:18:28.717718 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:28.766417 17522 raft_consensus.cc:2393] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:28.590078 19067 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:28.605976 19151 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:28.755936 17528 raft_consensus.cc:2410] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:28.684580 18194 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 6. Ops: [4.6-4.6]
W20260709 13:18:28.748926 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 273121us
I20260709 13:18:28.780094 19220 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:28.787637 19027 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:28.747942 18838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.006s	sys 0.024s
I20260709 13:18:28.686012 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:28.793566 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:28.792853 17419 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:28.796247 18166 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:28.659318 18888 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.811844 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:28.813446 17523 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:28.778126 18970 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.794013 18935 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.818948 17526 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
W20260709 13:18:28.831120 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.815624 17569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.030s	sys 0.037s
W20260709 13:18:28.835038 17569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.030s	sys 0.037s
I20260709 13:18:28.795158 18838 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:28.792855 19067 raft_consensus.cc:697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:28.798676 19172 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:28.811405 18891 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:28.835467 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 572725us
W20260709 13:18:28.851794 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.858390 19051 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:28.862722 18943 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:28.866197 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.866700 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.866430 19229 consensus_queue.cc:1059] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:18:28.867894 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:28.868597 18838 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.869185 18194 raft_consensus.cc:2393] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:28.870164 17523 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:28.871577 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:28.863291 17419 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:28.875957 17451 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
W20260709 13:18:28.881282 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.883481 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:28.847095 18891 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:28.879652 19181 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:28.863255 18943 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.860713 18970 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.889720 18891 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:28.862103 18935 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.894635 19190 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:28.888926 18962 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:28.900528 18600 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:28.942680 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:28.901849 19051 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.916229 19027 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.925951 19181 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:28.946862 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:28.936184 18705 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.956125 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:28.944237 19190 raft_consensus.cc:697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:28.951927 18850 raft_consensus.cc:3055] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:28.961755 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.952092 18962 raft_consensus.cc:697] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:18:28.968154 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.956125 19100 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:28.970157 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:28.970748 17598 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.972875 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:28.939843 19067 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:28.960970 19027 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:28.975086 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 64798.6us
I20260709 13:18:28.974191 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:28.984444 17595 raft_consensus.cc:2410] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:18:28.985080 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 415939us
I20260709 13:18:28.989847 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:28.990123 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 46393us
I20260709 13:18:28.965231 18850 raft_consensus.cc:740] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:28.969224 18888 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:28.958568 18600 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:29.030706 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.042296 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:29.049738 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 58675.1us
I20260709 13:18:29.048194 17596 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:29.055271 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.056267 17568 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:29.058089 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:29.052603 19027 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:29.064566 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.050810 18708 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:18:29.070607 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.071707 17522 raft_consensus.cc:2410] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:29.073115 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.073945 17524 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:29.058459 19224 consensus_queue.cc:1059] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:18:29.049393 19181 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.055687 19244 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 13:18:29.073058 19230 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:18:29.061452 19190 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.069902 19062 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:29.073167 18943 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:29.085096 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 75732.5us
I20260709 13:18:29.079836 18970 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.112700 17594 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.081478 19051 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:29.114511 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 64135.2us
I20260709 13:18:29.078924 18708 consensus_queue.cc:1243] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:29.059235 19225 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.159s
I20260709 13:18:29.073354 19027 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:29.068464 18962 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:29.127514 19235 log.cc:927] Time spent T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:18:29.136369 19240 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:29.136845 18928 raft_consensus.cc:3055] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:29.133725 19234 consensus_queue.cc:1059] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:18:29.084239 18850 consensus_queue.cc:260] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.137524 19223 raft_consensus.cc:3055] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:29.152642 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:29.155944 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.102818 19080 consensus_queue.cc:1059] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:18:29.111711 18856 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 13:18:29.152721 19246 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:18:29.166806 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 49894.2us
I20260709 13:18:29.152912 19051 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:29.145632 19249 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.179688 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.154906 18928 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.138847 18999 consensus_queue.cc:1059] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:18:29.183702 17450 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:29.131377 18708 consensus_queue.cc:1059] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:18:29.165977 19223 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.170140 19062 raft_consensus.cc:697] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.191058 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.195113 17449 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:29.152686 19167 consensus_queue.cc:1059] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:29.177266 19234 raft_consensus.cc:3055] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:29.157061 19224 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:18:29.202407 19254 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:29.203660 18928 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.205044 18928 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.207012 19027 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:29.195604 19237 log.cc:927] Time spent T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:18:29.210620 17598 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:29.190873 18600 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.195241 18850 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.212985 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:29.214816 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 53036.1us
I20260709 13:18:29.212826 19229 raft_consensus.cc:2764] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:29.215492 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.216266 17450 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:29.213495 18891 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.219731 19027 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:29.220373 18891 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.220737 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:29.221568 19027 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:29.222117 19239 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
I20260709 13:18:29.222070 19027 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.222699 19027 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.223805 18196 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:29.224270 18945 tablet_bootstrap.cc:492] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.225219 18945 tablet_bootstrap.cc:492] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:18:29.208232 19220 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:29.226495 19220 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.228739 19220 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.182318 19253 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:18:29.229991 19062 consensus_queue.cc:237] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.238528 17449 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.183382 19249 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.239138 19224 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:29.240103 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.240710 19249 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.240854 18945 ts_tablet_manager.cc:1403] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 1.524s	user 0.051s	sys 0.011s
I20260709 13:18:29.240882 17451 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:29.211445 18999 raft_consensus.cc:3055] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:29.184836 19051 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.241590 18999 raft_consensus.cc:740] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.201619 19234 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.241222 19257 consensus_queue.cc:1059] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:18:29.244978 18999 consensus_queue.cc:260] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.245050 19234 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.235473 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:29.246694 18999 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:29.247143 19100 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:29.247715 19100 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.248106 19100 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.248773 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:29.250479 17495 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:29.252095 19223 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.252804 19233 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:29.254791 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.255391 17598 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.255774 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.256575 17594 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.258771 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.262916 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.246721 19234 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.262982 17568 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:29.253468 19223 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.269654 17596 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:29.269294 19027 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.272784 19151 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:29.250798 18705 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:29.274781 19252 raft_consensus.cc:3055] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.263979 18850 raft_consensus.cc:3055] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:29.314116 19252 raft_consensus.cc:740] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:29.315413 19252 consensus_queue.cc:260] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.316982 19252 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.279086 19051 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.281070 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.319412 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.320111 17447 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:29.321028 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.281955 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.283245 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.282929 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.282986 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.282492 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.284108 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:29.285971 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.283372 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.288374 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:29.289113 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.290583 17598 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:29.294581 18945 raft_consensus.cc:359] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:29.283584 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:29.306396 19224 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.313448 19027 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.314199 18850 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.250753 18856 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:18:29.321868 17447 raft_consensus.cc:2410] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:29.381450 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.382440 17526 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:18:29.361189 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 112573us
I20260709 13:18:29.340799 17450 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.344103 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.393754 17453 raft_consensus.cc:2410] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:29.387615 17446 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.394203 17529 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:29.387792 17449 raft_consensus.cc:2410] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:29.386252 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.389428 17452 raft_consensus.cc:2410] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:29.395346 17527 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:29.397715 17528 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:29.398738 17522 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:29.399557 17448 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.388427 17454 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.401576 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:29.402274 17520 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.390367 18945 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:18:29.397861 19233 raft_consensus.cc:697] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:18:29.325636 19228 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.383s	user 0.003s	sys 0.000s
I20260709 13:18:29.403267 18945 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:29.403889 19233 consensus_queue.cc:237] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.404711 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1075) took 1097 ms. Trace:
I20260709 13:18:29.405072 17525 rpcz_store.cc:276] 0709 13:18:28.307003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.313199 (+  6196us) service_pool.cc:224] Handling call
0709 13:18:28.326327 (+ 13128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:28.398338 (+ 72011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.398381 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:28.398991 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:18:28.837885 (+438894us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:28.837940 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.838058 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.324903 (+486845us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:29.404433 (+ 79530us) raft_consensus.cc:1685] finished
0709 13:18:29.404453 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.404641 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55550,"raft.queue_time_us":56904,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":10627456,"thread_start_us":419808,"threads_started":1,"wal-append.queue_time_us":504453}
I20260709 13:18:29.407694 19261 raft_consensus.cc:3055] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:29.408427 19261 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.408751 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:29.409518 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 146638us
I20260709 13:18:29.409936 17447 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.410693 19257 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:29.411132 17568 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:29.343029 18705 raft_consensus.cc:697] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:29.412353 19257 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:29.412933 19265 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:29.413292 17568 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:29.408886 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.413877 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.407505 17445 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.429416 17452 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.432610 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.433585 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.434163 17448 raft_consensus.cc:2410] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:29.434516 17447 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.434991 17450 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.435657 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.436221 17449 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.439023 17568 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:29.439726 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.442001 18198 raft_consensus.cc:1217] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEARNER]: Deduplicated request from leader. Original: 1.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:18:29.442270 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.442072 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.443450 17453 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.444593 18708 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:29.445201 18708 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.407435 19100 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.447242 18708 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:29.447429 17520 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:29.448242 19100 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.449335 18999 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.449441 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:29.450086 19236 log.cc:927] Time spent T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.367s	user 0.004s	sys 0.000s
I20260709 13:18:29.450040 18999 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.452323 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.453831 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.453948 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.414371 19265 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:29.454736 19265 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.356855 18970 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.455122 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.455286 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.454746 17597 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:29.468568 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.452194 18999 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:29.412971 19257 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.462937 17419 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:29.429643 19188 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:29.460206 17449 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:29.473708 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.474572 17449 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:29.463969 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.476898 17447 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.480967 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.481312 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.482084 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.485723 17603 raft_consensus.cc:2410] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:29.487627 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.488693 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.436069 19026 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:18:29.489375 17447 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.462375 19252 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:29.491734 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 58976.3us
I20260709 13:18:29.475682 18891 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.493718 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.481199 19167 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:29.495913 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:29.497828 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.505406 17452 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:29.506870 17568 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:29.508705 17568 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:29.509335 18928 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:29.514364 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.515026 17452 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.516111 17450 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:29.517331 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.500075 18891 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.519052 19265 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.520581 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:29.520859 18945 ts_tablet_manager.cc:1434] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.278s	user 0.008s	sys 0.012s
I20260709 13:18:29.521313 19266 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:29.521955 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.521842 19266 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:29.522706 19229 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:29.523306 19229 raft_consensus.cc:697] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.524242 19229 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.524060 19266 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.526903 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.527367 18761 raft_consensus.cc:3055] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:29.527740 18761 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.528762 18761 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.530121 19026 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.530678 19026 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.531476 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.532665 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.534420 19171 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.535048 19171 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.536286 19266 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:29.538498 19171 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:29.538748 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.533805 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.477276 18970 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.483179 19244 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:18:29.540988 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.489773 18850 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.548897 18850 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:29.476676 18705 consensus_queue.cc:237] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.552176 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.540764 19266 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.553680 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.499747 19167 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.494228 19261 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.560261 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.561093 17449 raft_consensus.cc:2376] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5. Re-sending same reply.
I20260709 13:18:29.562042 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.562220 17450 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:29.478097 19188 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.562688 17452 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:29.563915 17601 raft_consensus.cc:2410] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:29.564888 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.569406 17602 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:29.572516 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.572685 19261 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.563412 19100 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.593900 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:29.594708 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.559742 19167 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.574128 18928 consensus_queue.cc:1059] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:29.574937 19188 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.600277 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:29.601011 17527 raft_consensus.cc:2368] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6.
I20260709 13:18:29.601135 19253 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:29.603185 18928 raft_consensus.cc:3055] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:29.603593 18928 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.603639 18970 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.575026 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.577479 18891 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.577553 17451 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:29.605121 19220 consensus_queue.cc:1059] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:18:29.577929 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.580569 17529 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:29.582715 17522 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:29.581754 17526 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:29.586851 17597 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:29.615778 19225 raft_consensus.cc:3055] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:29.616034 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.616894 18825 raft_consensus.cc:3055] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:29.617545 17449 raft_consensus.cc:2393] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:29.587845 17600 raft_consensus.cc:2410] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:29.587558 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.618693 17450 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.597265 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.619426 17602 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:29.619652 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:29.619742 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.620409 17450 raft_consensus.cc:2368] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4.
I20260709 13:18:29.561005 18761 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:29.542797 19257 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.588824 17453 raft_consensus.cc:2410] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:29.621243 19026 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.621912 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.622539 17453 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.623345 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.589632 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.624240 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.625262 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.625342 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:29.597288 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.621178 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.604544 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:29.618404 17599 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:29.559757 19266 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.628125 17450 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:29.628993 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:29.624292 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.618479 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.604583 18928 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.618547 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.630487 17449 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.616237 19225 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.620419 17601 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:29.587052 17446 raft_consensus.cc:2410] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:29.617275 19224 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:29.616098 17351 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40508 (request call id 185) took 7073 ms. Trace:
I20260709 13:18:29.635640 17526 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:29.636404 17449 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:29.638294 19223 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:29.660859 17449 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:29.618403 19067 raft_consensus.cc:3055] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.662768 19067 raft_consensus.cc:740] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:29.664345 19067 consensus_queue.cc:260] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.639060 17597 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:29.620253 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.642570 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.601634 19253 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.582444 19252 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:29.673483 17602 raft_consensus.cc:2393] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:29.674420 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.673861 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.702999 17597 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:29.704021 17526 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:29.617271 18825 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.712879 17453 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:18:29.714756 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.720569 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:29.721550 17526 raft_consensus.cc:2393] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:29.723488 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.665995 19067 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.727468 17447 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:29.728906 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:29.724954 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.609318 19100 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.673328 18999 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.733599 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.705418 18888 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:29.643100 17351 rpcz_store.cc:276] 0709 13:18:22.542395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.546159 (+  3764us) service_pool.cc:224] Handling call
0709 13:18:29.616016 (+7069857us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:27.963758 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:27.964679 (+   921us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:27.964762 (+    83us) write_op.cc:435] Acquired schema lock
0709 13:18:27.964795 (+    33us) tablet.cc:662] Decoding operations
0709 13:18:27.965501 (+   706us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:27.965631 (+   130us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:27.965673 (+    42us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:27.990583 (+ 24910us) tablet.cc:701] Row locks acquired
0709 13:18:27.990617 (+    34us) write_op.cc:260] PREPARE: finished
0709 13:18:27.990790 (+   173us) write_op.cc:270] Start()
0709 13:18:27.990945 (+   155us) write_op.cc:276] Timestamp: P: 1783603107990729 usec, L: 0
0709 13:18:27.990981 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:18:27.991691 (+   710us) log.cc:844] Serialized 919 byte log entry
0709 13:18:29.047798 (+1056107us) op_driver.cc:464] REPLICATION: finished
0709 13:18:29.226452 (+178654us) write_op.cc:301] APPLY: starting
0709 13:18:29.226539 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:29.226663 (+   124us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:29.226811 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:29.227205 (+   394us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:29.227462 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:29.227531 (+    69us) write_op.cc:312] APPLY: finished
0709 13:18:29.227782 (+   251us) log.cc:844] Serialized 29 byte log entry
0709 13:18:29.229415 (+  1633us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:29.229510 (+    95us) write_op.cc:454] Released schema lock
0709 13:18:29.229574 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:29.230769 (+  1195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:29.230800 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":887003,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":178336,"apply.run_cpu_time_us":2068,"apply.run_wall_time_us":4292,"num_ops":2,"prepare.queue_time_us":295936,"prepare.run_cpu_time_us":39113,"prepare.run_wall_time_us":331784,"raft.queue_time_us":447717,"raft.run_cpu_time_us":19885,"raft.run_wall_time_us":199748,"replication_time_us":1054707,"thread_start_us":1096698,"threads_started":4,"wal-append.queue_time_us":459688}]]}
I20260709 13:18:29.740578 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.744457 17602 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:29.711939 18194 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:29.741870 17521 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:29.748772 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:29.750054 17526 raft_consensus.cc:2368] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4.
I20260709 13:18:29.751906 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.754933 19270 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.755472 19270 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.756660 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.763490 17602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:18:29.764283 17602 raft_consensus.cc:606] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:29.764626 17602 raft_consensus.cc:614] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:29.769765 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.770479 17597 raft_consensus.cc:2376] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5. Re-sending same reply.
W20260709 13:18:29.772814 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 100469us
I20260709 13:18:29.773623 17420 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:29.777523 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:29.782269 17420 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:29.776831 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:29.808753 17526 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:18:29.809877 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 180969us
I20260709 13:18:29.718406 19223 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.808244 17522 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:29.824358 17602 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:29.811224 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:29.812736 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 86648.4us
I20260709 13:18:29.818101 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.866598 17594 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:18:29.902374 17594 pending_rounds.cc:85] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 1
W20260709 13:18:29.867815 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 85659.7us
I20260709 13:18:29.879560 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:29.885667 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:29.902778 17594 pending_rounds.cc:107] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:18:29.901423 17419 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:29.906980 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:29.905709 17594 raft_consensus.cc:2889] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:29.909409 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.913594 17569 leader_election.cc:400] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4.
I20260709 13:18:29.914458 17569 leader_election.cc:403] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:29.820808 19027 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.917038 17419 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:29.867017 19241 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.919440 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:29.876487 18970 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:29.886313 19240 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:29.904842 19079 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:29.972604 17594 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:29.974948 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-e57fe371976a485bbdedfdaa4659dec3 received from {username='slave'} at 127.0.0.1:52572
I20260709 13:18:29.975595 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-e57fe371976a485bbdedfdaa4659dec3 on tablet e57fe371976a485bbdedfdaa4659dec3 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:29.976123 19266 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.976145 19249 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:29.974479 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:29.978250 17448 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:29.979369 17523 raft_consensus.cc:2368] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4.
I20260709 13:18:29.978544 19266 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:29.981868 19263 consensus_queue.cc:1059] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:18:29.982815 19263 raft_consensus.cc:3055] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:29.983191 19263 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:29.984073 19263 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:29.985361 19263 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.958134 18838 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4.
I20260709 13:18:29.957789 18891 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:29.964651 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:29.996099 17445 consensus_meta.cc:287] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.000s
W20260709 13:18:29.976256 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.001659 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 84728.4us
W20260709 13:18:29.973596 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 54253us
I20260709 13:18:30.002885 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:30.005833 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.914917 19234 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:30.011283 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.914676 18943 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:30.017910 17420 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:29.776912 19225 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
W20260709 13:18:30.048015 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.061406 17420 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:29.877317 18825 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.076241 17445 raft_consensus.cc:2410] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:29.965838 19027 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:29.961395 19062 consensus_queue.cc:1059] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:18:29.965248 19241 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.012668 19249 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:30.019443 18891 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:30.092799 17568 leader_election.cc:400] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6.
I20260709 13:18:30.077387 19244 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:30.106150 19271 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:18:30.106570 17526 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:30.107087 19273 log.cc:927] Time spent T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 13:18:30.107491 19274 log.cc:927] Time spent T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:30.089387 19131 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.097651 19249 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.099408 19225 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.116645 17568 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:30.101434 19252 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.085215 19151 consensus_queue.cc:1059] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:18:30.158058 18825 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.126196 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:18:30.126690 19276 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:18:30.132131 18928 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.180016 17446 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:18:30.180827 19261 consensus_meta.cc:287] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.000s
I20260709 13:18:30.184279 17352 catalog_manager.cc:5697] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 1 to 3, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 3 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.134528 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:30.137421 19277 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:18:30.123457 19249 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.123317 19131 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.117687 19269 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.143066 19223 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:30.144595 18935 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.146617 17450 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:30.194193 18850 consensus_meta.cc:287] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.002s
I20260709 13:18:30.197611 17598 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
W20260709 13:18:30.148300 19167 consensus_meta.cc:287] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 13:18:30.113657 19062 consensus_queue.cc:1243] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:30.124054 19270 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.150998 19241 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.114086 19026 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:30.152931 19171 raft_consensus.cc:3055] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:30.161227 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.162434 17522 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:30.143136 17529 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:30.169133 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:30.171026 18761 consensus_meta.cc:287] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.005s
W20260709 13:18:30.172034 19279 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.292s	user 0.002s	sys 0.000s
I20260709 13:18:30.134282 19253 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:30.189821 17352 catalog_manager.cc:5697] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 1 to 2, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 2 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:30.201568 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 84999.2us
I20260709 13:18:30.194661 19223 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:30.225449 17529 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:30.226971 17529 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:30.224222 17601 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:30.221740 17568 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:30.193768 17603 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:30.219380 19171 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:30.238181 17352 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 4 to 5, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 5 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.221001 19026 raft_consensus.cc:697] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:30.236790 18856 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:30.207155 19234 consensus_queue.cc:1059] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:18:30.242988 17568 leader_election.cc:400] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4.
I20260709 13:18:30.207538 19167 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.195640 19269 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:30.242357 18761 consensus_queue.cc:1059] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:18:30.265496 17452 raft_consensus.cc:2368] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5.
W20260709 13:18:30.268150 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.261490 19027 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.260476 19223 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:18:30.270412 18856 raft_consensus.cc:3055] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:30.266827 18943 raft_consensus.cc:697] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:30.270360 19270 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:30.283370 17597 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:18:30.284191 17597 pending_rounds.cc:85] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 2
I20260709 13:18:30.284406 17597 pending_rounds.cc:107] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:18:30.284694 17597 raft_consensus.cc:2889] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.277670 19171 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:30.287392 19171 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.281574 19290 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.288084 19290 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:30.292883 18197 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:30.293989 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 232692us
I20260709 13:18:30.295341 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:30.297302 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:30.291983 19270 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:30.279636 18856 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:30.305056 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:30.312302 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:30.300345 19026 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:30.303133 19241 raft_consensus.cc:2764] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:30.317541 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:30.302907 19296 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:30.319110 19079 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:30.323153 19270 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:30.323994 18856 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.325654 18856 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.328672 18705 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.328946 19281 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:30.311098 19051 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:30.329646 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 518434us
I20260709 13:18:30.358726 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:30.358546 18705 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.359362 17522 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:30.359445 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:30.331418 19252 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:18:30.333006 18943 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.334225 19266 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:30.320575 19242 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:18:30.310719 19290 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:30.314551 18999 consensus_meta.cc:287] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.004s
W20260709 13:18:30.341593 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.368988 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.357275 19067 consensus_meta.cc:287] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.002s
I20260709 13:18:30.364158 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:30.374734 17529 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.366849 17526 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:30.368116 18705 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.366118 19266 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:30.339651 19233 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:30.402299 18705 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.403061 18705 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.363355 19281 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:30.408205 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 47285.8us
W20260709 13:18:30.408273 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 67952.9us
I20260709 13:18:30.365037 19296 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:30.409080 17419 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:30.409984 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:30.412045 17449 raft_consensus.cc:2376] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3. Re-sending same reply.
W20260709 13:18:30.410707 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.412791 18705 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.410550 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:30.400077 19266 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.408519 17569 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:30.413501 18705 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:30.416132 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:30.419946 17568 leader_election.cc:400] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4.
I20260709 13:18:30.415654 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:30.418524 17529 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:30.420666 17568 leader_election.cc:403] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:30.420878 17448 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.415540 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:30.697206 17450 raft_consensus.cc:2376] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4. Re-sending same reply.
W20260709 13:18:30.697541 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 277704us
I20260709 13:18:30.698206 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:30.421939 18935 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:30.698939 18935 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.699329 18935 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.700359 19261 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.422083 19293 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:30.422937 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:30.704030 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:30.705093 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:30.419940 17449 raft_consensus.cc:2376] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5. Re-sending same reply.
I20260709 13:18:30.424470 17520 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:30.706367 18935 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:30.425493 19285 log.cc:927] Time spent T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:18:30.425901 17525 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:30.708566 18935 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.710121 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1453) took 1086 ms. Trace:
I20260709 13:18:30.710650 17527 rpcz_store.cc:276] 0709 13:18:29.623549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.628477 (+  4928us) service_pool.cc:224] Handling call
0709 13:18:29.639183 (+ 10706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.710557 (+ 71374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.710586 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.738681 (+ 28095us) log.cc:844] Serialized 26 byte log entry
0709 13:18:30.270768 (+532087us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:30.278216 (+  7448us) log.cc:844] Serialized 14 byte log entry
0709 13:18:30.365068 (+ 86852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.365141 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.652882 (+287741us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b480021c258. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abaa8faa1 00007f5abaa86b37 00007f5abaa869ca 00007f5abab7e26f 00007f5abab7df37 00007f5abab9255c 00007f5abab92508 00007f5abab92488 00007f5abab92443 00007f5abab916ec 00007f5ab9abba96
0709 13:18:30.709747 (+ 56865us) raft_consensus.cc:1685] finished
0709 13:18:30.709882 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.710050 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149063,"prepare.queue_time_us":6316,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":209682,"raft.run_cpu_time_us":3160,"raft.run_wall_time_us":247683,"spinlock_wait_cycles":3605888,"thread_start_us":461164,"threads_started":1,"wal-append.queue_time_us":522737}
I20260709 13:18:30.713399 17568 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:30.428864 19266 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.419766 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:30.718952 17525 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:30.429678 19223 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:30.720000 19224 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:30.720261 19223 consensus_queue.cc:1243] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer 2158c0f750fd4b21afe24135c52167b2 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:30.720616 19224 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.415971 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:30.720014 19266 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.433358 17597 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:18:30.408751 19167 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.437341 19281 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:30.409489 18999 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:30.442446 19249 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.724007 19249 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.436055 19296 raft_consensus.cc:697] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:30.726075 19296 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:30.446229 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:30.407516 19233 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.732142 19233 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.414597 19269 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.585472 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:30.591777 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:30.733345 17595 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:30.444676 17419 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:30.733490 17526 raft_consensus.cc:2393] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 3: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:30.734386 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:30.734589 19167 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:30.721696 17447 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:30.735203 19167 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.735747 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:30.735860 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 291229us
I20260709 13:18:30.736474 17595 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:30.597889 19304 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.736397 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:30.737241 19304 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.738611 17596 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:30.739545 19304 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.598742 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:30.735749 19167 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.600035 19171 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:30.602072 17594 raft_consensus.cc:3055] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:30.743191 17594 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:30.744059 17594 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.745069 17594 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.604879 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:30.746984 17446 raft_consensus.cc:2368] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:30.606140 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:30.747591 17600 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.609264 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:30.613078 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:30.749660 17524 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
W20260709 13:18:30.619266 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.750913 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.751215 19249 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:30.721098 17525 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:30.754493 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:30.755431 18196 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:30.756286 19254 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:30.757346 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:30.760540 18193 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:30.717803 19261 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4.
I20260709 13:18:30.762835 18838 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:30.764406 18850 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:30.764883 18850 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:30.765915 18850 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.766758 17448 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:30.770881 19167 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.771940 17447 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:30.772081 18850 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.774147 18166 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:30.775255 19269 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.776036 19269 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:30.778833 19171 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:30.779445 19171 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.779984 19171 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.617561 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:30.621047 17451 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:30.783878 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1457) took 1016 ms. Trace:
W20260709 13:18:30.783926 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 166458us
I20260709 13:18:30.784253 17451 rpcz_store.cc:276] 0709 13:18:29.767591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.091558 (+323967us) service_pool.cc:224] Handling call
0709 13:18:30.620644 (+529086us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b5800002798. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab3ffc0 00007f5abab2a929 00007f5abab2a3d2 00007f5ab40a1bd4
0709 13:18:30.620849 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.783656 (+162807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.783825 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5367040}
I20260709 13:18:30.784664 18167 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:30.622381 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.783916 17419 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:30.623747 18962 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:30.628062 19257 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.629112 19306 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.793190 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.634603 19253 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:30.636847 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1446) took 1276 ms. Trace:
I20260709 13:18:30.639448 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:30.640556 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 965) took 1145 ms. Trace:
I20260709 13:18:30.641647 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:30.797415 17594 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:30.797258 17528 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:30.798102 17594 pending_rounds.cc:85] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 2
I20260709 13:18:30.641942 19263 raft_consensus.cc:1064] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:30.795073 17452 rpcz_store.cc:276] 0709 13:18:29.360165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.564654 (+204489us) service_pool.cc:224] Handling call
0709 13:18:30.636628 (+1071974us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b5400369a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:30.636756 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1603722624}
I20260709 13:18:30.645095 19131 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:30.655475 18888 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:30.666592 18197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42548 (request call id 239) took 1275 ms. Trace:
I20260709 13:18:30.672878 17350 catalog_manager.cc:5697] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 2 to 4, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 4 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.684908 19252 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.685773 19247 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:30.828819 19247 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:30.831656 19247 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:30.688544 17420 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:30.695010 18970 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:30.428442 17522 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:30.832976 18970 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:30.833251 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 144821us
I20260709 13:18:30.714933 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:30.815357 18888 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:30.713764 17527 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:30.718923 17454 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.431759 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:30.721184 19224 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.721812 17597 pending_rounds.cc:85] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 1
I20260709 13:18:30.839465 17597 pending_rounds.cc:107] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:18:30.839668 17601 raft_consensus.cc:2410] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:30.839769 17597 raft_consensus.cc:2889] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.442332 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:30.446960 19079 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
W20260709 13:18:30.783311 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 423904us
I20260709 13:18:30.792274 17600 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:30.845225 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:30.631197 19100 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:30.798513 17594 pending_rounds.cc:107] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:30.795965 17603 rpcz_store.cc:276] 0709 13:18:29.494886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.495009 (+   123us) service_pool.cc:224] Handling call
0709 13:18:30.640335 (+1145326us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54003eba54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:30.640451 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515083008}
I20260709 13:18:30.794679 19290 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:30.808710 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.815478 17524 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:30.815810 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:30.816577 18166 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:30.791972 18935 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.817381 17451 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:30.794813 19253 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:30.793435 19296 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:30.804211 19257 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:30.820927 17452 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:30.821293 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:30.807914 19270 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:30.804021 19306 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:30.825209 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:30.809648 19254 consensus_queue.cc:1059] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:18:30.795022 18999 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:30.835088 18970 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:30.840708 17420 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:30.847198 17594 raft_consensus.cc:2889] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:30.984231 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 139071us
I20260709 13:18:30.824726 19263 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:30.849531 19299 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.164s
I20260709 13:18:30.849531 19293 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.844189 19252 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:30.994789 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.844635 19251 raft_consensus.cc:2764] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:31.023402 17350 catalog_manager.cc:5697] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 1 to 2, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.849562 19290 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:30.929569 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 87521.7us
I20260709 13:18:30.813889 19269 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:30.849911 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.987016 17445 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:30.850287 18962 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.170s
I20260709 13:18:31.040184 17523 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.988039 18838 consensus_queue.cc:1059] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:18:30.989665 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:30.983671 19249 consensus_queue.cc:1059] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:18:31.048383 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 207770us
I20260709 13:18:31.051191 18888 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:31.051767 19167 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:31.048448 19265 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:18:31.051491 17350 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 4, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 4 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:31.049846 17454 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:30.814834 19261 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.988572 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:31.103574 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 114019us
I20260709 13:18:31.103624 17528 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:30.862227 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.046721 17526 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:31.057612 17602 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:31.105312 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:31.057634 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.045670 19318 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.230s	user 0.000s	sys 0.004s
I20260709 13:18:31.065907 17527 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:31.083518 17450 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:31.096639 17447 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:31.046280 19100 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.099601 19253 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:31.063832 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 256779us
I20260709 13:18:31.106001 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:31.059268 18943 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.042076 19296 raft_consensus.cc:697] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:30.850510 19131 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.240s
I20260709 13:18:30.848670 18850 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.234s
I20260709 13:18:31.040359 18970 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:31.145032 17419 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:31.056983 19290 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.064443 18935 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:31.165095 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 59838us
I20260709 13:18:31.145239 19308 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.194507 17528 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
W20260709 13:18:31.131970 19317 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:18:31.202473 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 385910us
I20260709 13:18:31.133860 18888 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:31.055217 18999 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.090888 19067 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:18:31.052594 19293 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:31.216881 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 71965.1us
I20260709 13:18:31.230284 19253 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.217631 18167 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:31.279747 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 62177.1us
I20260709 13:18:31.280951 18167 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:31.132210 17350 catalog_manager.cc:5697] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added, no longer has a pending config: VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65), VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66), VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67), NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 3 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:31.220875 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:31.095870 19223 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.206100 19270 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:31.227749 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:31.228289 18891 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:30.808223 18197 rpcz_store.cc:276] 0709 13:18:29.391341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.397790 (+  6449us) service_pool.cc:224] Handling call
0709 13:18:29.402246 (+  4456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.293302 (+891056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.666210 (+372908us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b5400445054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:30.666497 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2043446656}
I20260709 13:18:31.234364 19304 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:31.234725 19309 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:18:31.235008 19296 consensus_queue.cc:237] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.236014 19229 raft_consensus.cc:3055] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:31.237074 18928 raft_consensus.cc:3055] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:31.241750 18838 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.216974 19269 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:31.229257 18970 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:31.130795 19261 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.248350 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1108) took 1607 ms. Trace:
I20260709 13:18:31.287022 18891 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:31.257119 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.278636 17419 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:31.283540 17528 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:31.274093 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 133249us
I20260709 13:18:31.254503 19252 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:31.283241 18888 raft_consensus.cc:697] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:18:31.381314 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 247067us
I20260709 13:18:31.307359 17521 rpcz_store.cc:276] 0709 13:18:29.640942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.176688 (+535746us) service_pool.cc:224] Handling call
0709 13:18:30.177049 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.778364 (+601315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.778399 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.802203 (+ 23804us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.042503 (+240300us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:31.042544 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.042604 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.248126 (+205522us) raft_consensus.cc:1685] finished
0709 13:18:31.248152 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.248289 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160756,"raft.queue_time_us":223852,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":7762,"thread_start_us":674500,"threads_started":2,"wal-append.queue_time_us":398903}
I20260709 13:18:31.315733 17523 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:31.285300 19323 raft_consensus.cc:2804] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:31.390983 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:31.391538 19323 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.391909 19323 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:31.392493 17524 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:31.359112 18935 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:31.395438 19261 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:31.396513 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1458) took 1628 ms. Trace:
I20260709 13:18:31.397490 18970 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:31.311496 17350 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 1 to 2, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:31.398996 17350 catalog_manager.cc:5697] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:31.299654 19229 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:31.303610 19257 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:31.300098 19308 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:31.303287 19270 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:31.286861 19223 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:31.364131 19171 consensus_meta.cc:287] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.000s
I20260709 13:18:31.323725 18891 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:31.308233 18838 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.308498 19269 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.301179 18928 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:31.387259 17528 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:31.430317 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:31.431113 17521 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:31.390223 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:31.341459 18999 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:31.341665 19234 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.354192 19067 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:31.401342 19252 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:31.401563 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.416148 19327 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.428685 19224 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.441221 19327 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:31.406765 19313 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.200s	user 0.004s	sys 0.000s
I20260709 13:18:31.443367 19327 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:31.443439 19224 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:31.444653 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:31.445358 17528 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:31.446929 17596 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:18:31.447589 17596 pending_rounds.cc:85] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 4
I20260709 13:18:31.447930 17596 pending_rounds.cc:107] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:18:31.448417 17596 raft_consensus.cc:2889] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.449635 18197 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEARNER]: Advancing to term 4
I20260709 13:18:31.452253 19067 raft_consensus.cc:697] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:31.426162 19171 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:31.416620 19308 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:31.411865 19323 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:31.415609 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.293319 19304 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:31.425405 17419 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:31.428194 18838 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:31.428627 19269 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.359584 19306 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:31.330407 19325 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.515794 19323 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:31.401954 19079 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.518385 19079 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:31.520663 19079 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:31.440992 19229 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.397064 17445 rpcz_store.cc:276] 0709 13:18:29.767843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.116059 (+348216us) service_pool.cc:224] Handling call
0709 13:18:30.143867 (+ 27808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.082327 (+938460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.396202 (+313875us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54000b4354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:31.396436 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1606393600}
I20260709 13:18:31.451561 19223 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:31.526290 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.460397 17521 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:31.453398 19067 consensus_queue.cc:237] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.467072 19241 raft_consensus.cc:3055] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:31.472937 17446 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:31.473644 17529 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:31.473937 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:31.506222 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.478013 17522 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.480535 17569 leader_election.cc:400] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5.
I20260709 13:18:31.482583 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:31.480720 18999 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:31.482126 19331 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.536571 17569 leader_election.cc:403] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:18:31.538729 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 317943us
I20260709 13:18:31.463384 19308 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.512032 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:31.513309 18193 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:18:31.517860 19315 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.316s	user 0.000s	sys 0.003s
W20260709 13:18:31.541591 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.530709 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 109399us
I20260709 13:18:31.429733 18928 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.532037 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:31.532418 19251 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:31.463637 19171 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:31.454896 18888 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:31.546012 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.521744 19293 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:31.440202 19234 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.476190 18970 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:31.525449 19261 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.539768 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:31.486121 18197 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:31.506758 19290 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:31.479045 19253 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:18:31.459347 19252 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.534905 19241 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:31.536163 19131 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:31.558818 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 78409.6us
I20260709 13:18:31.549250 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:31.537413 19229 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.574144 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:31.578186 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:31.579030 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:31.596828 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:31.597528 17420 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:31.573659 18928 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.547150 18196 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:31.580615 19241 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.581705 19131 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:31.550987 19079 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:18:31.549316 19331 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:31.584363 19304 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:31.585584 19234 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:31.585737 19269 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:31.592496 19334 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5.
I20260709 13:18:31.593034 19171 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:31.575184 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.552831 19251 raft_consensus.cc:697] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:31.633507 19167 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.684192 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:31.684831 17603 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:31.684897 17601 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:31.633975 18943 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:18:31.686179 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:31.686831 17602 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:31.634359 19335 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.687458 19335 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.610455 18962 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:18:31.686179 19234 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.691256 19304 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:31.690997 19234 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.691892 19304 raft_consensus.cc:697] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:31.692893 19304 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.604571 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:31.570165 18999 consensus_queue.cc:1243] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:31.594255 19299 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:31.598727 19306 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:31.599165 18935 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:31.664467 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:31.569908 18970 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:31.571888 19261 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:31.549832 17419 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:31.606158 18195 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:31.679818 19290 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:31.634258 18194 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:31.682364 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:31.682812 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:31.683861 19253 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.683418 19251 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.694495 17527 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 1.
I20260709 13:18:31.695398 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:31.697577 17569 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:31.756551 17595 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:31.756914 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 59463.6us
I20260709 13:18:31.757699 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:31.759007 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:31.755621 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 473703us
I20260709 13:18:31.700816 17602 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:31.696796 19171 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:31.704305 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:31.634161 19294 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
W20260709 13:18:31.707523 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 157741us
I20260709 13:18:31.777765 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:31.669783 19242 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:18:31.704437 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:31.716043 19269 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:31.762058 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:31.714701 18935 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:31.789201 18935 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.789914 18935 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.762593 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:31.714953 18943 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:31.778942 17598 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.765162 18999 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.778470 17599 raft_consensus.cc:2376] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5. Re-sending same reply.
I20260709 13:18:31.763060 18962 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:18:31.786909 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:31.702687 19299 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.787948 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:31.788256 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:31.812187 17529 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.812342 17520 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:31.799465 17526 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:31.764761 18199 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
W20260709 13:18:31.806005 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 209213us
I20260709 13:18:31.810336 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:31.805030 18943 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.825294 17527 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.766317 19332 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:31.806754 19323 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:31.827498 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 54275.8us
I20260709 13:18:31.826969 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:31.759963 19253 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.837109 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:31.816957 19335 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:31.803308 18838 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:18:31.847139 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:31.803790 19296 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:18:31.826702 19290 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.853885 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:31.759644 19339 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:31.827600 18943 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:31.836522 18999 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.857348 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:31.861706 17522 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:31.862986 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:31.838191 19332 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:31.870791 17520 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:31.872217 17529 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:31.847422 19342 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:31.885298 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.877851 17598 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
W20260709 13:18:31.885896 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.899411 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:31.901235 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:31.857041 19026 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.863009 18888 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.867223 19252 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:31.904454 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 126437us
I20260709 13:18:31.868680 19100 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.848317 19323 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:31.881716 17527 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:31.886864 19342 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.888209 19310 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.878149 19335 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:31.868135 19306 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:31.866297 19339 raft_consensus.cc:697] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:31.927433 17603 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:31.882944 19332 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:31.936331 19339 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.936853 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:31.937695 17603 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.862789 19294 consensus_queue.cc:1059] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:18:31.866786 19290 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:31.904598 18195 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:31.949405 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:31.950294 17529 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:31.876946 18999 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:31.920347 19131 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:31.931609 17419 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:31.928206 19167 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.957813 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:31.930776 19342 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.933146 19306 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:31.939077 18970 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:31.933919 19335 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.944110 18888 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.958773 17524 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
W20260709 13:18:31.970942 19344 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:18:31.971764 19343 log.cc:927] Time spent T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:18:31.979806 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 177214us
W20260709 13:18:31.972069 18891 consensus_meta.cc:287] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.002s
I20260709 13:18:31.945089 19348 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.946122 18838 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.963637 19131 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:31.998108 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 96991us
W20260709 13:18:31.980029 19337 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:18:31.938437 19067 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:18:31.977715 19335 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:31.973500 19306 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.991418 17603 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:32.004194 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:32.006310 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:32.013563 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:32.019609 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:31.976136 17595 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:31.984566 19261 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:31.997875 19131 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.025225 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:32.026719 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:32.028843 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 56342.4us
W20260709 13:18:32.031159 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.031221 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:31.989921 19331 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:31.981515 19356 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:18:31.995486 18891 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.035872 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:32.020437 19171 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:32.025130 19348 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:32.041654 17525 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:32.042661 19350 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.999146 18838 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.028481 19131 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:32.048955 19326 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:18:32.049368 18891 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:32.040138 19353 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:18:32.050350 18999 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:32.013592 19299 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.081553 18838 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:32.053798 19348 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:32.082296 19348 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.094695 19234 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:32.046644 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:32.060407 17594 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:32.061167 19358 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:32.014173 19247 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:32.030277 18888 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:32.071094 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 133) took 1359 ms. Trace:
W20260709 13:18:32.075786 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46278.1us
W20260709 13:18:32.097738 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 53023.9us
I20260709 13:18:32.107110 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:32.108234 19310 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:32.108899 19310 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:32.109431 19310 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:32.108304 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 78607.5us
W20260709 13:18:32.114115 19325 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.000s	sys 0.011s
I20260709 13:18:32.121781 17527 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:32.123329 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:32.107205 19229 consensus_meta.cc:287] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.001s
I20260709 13:18:32.129851 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:32.130671 17527 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.130738 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:32.125711 19358 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:32.105692 19350 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:32.133065 19350 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:32.132978 19358 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.133769 19350 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.135411 19358 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.136850 18935 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:32.138435 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:32.139043 18935 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:32.141674 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:32.144232 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:32.145074 18194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42538 (request call id 220) took 1044 ms. Trace:
I20260709 13:18:32.145592 19356 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.146337 19356 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.147027 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:32.148492 17352 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 95) took 7908 ms. Trace:
I20260709 13:18:32.148716 19356 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.150707 19253 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:32.158751 17527 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
W20260709 13:18:32.163836 19308 consensus_meta.cc:287] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.612s	user 0.004s	sys 0.007s
I20260709 13:18:32.164458 19308 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.165939 17526 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:32.129726 18970 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:32.131398 18962 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:32.167243 18962 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:32.168828 19346 log.cc:927] Time spent T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
I20260709 13:18:32.169974 18962 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.119029 17596 rpcz_store.cc:276] 0709 13:18:30.711532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.740544 (+ 29012us) service_pool.cc:224] Handling call
0709 13:18:30.759451 (+ 18907us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b58001a1398. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41eee 0000000000375939 00007f5abaab51e0 00007f5abab7e0c4 00007f5abab7e131 00007f5abab3ffc0 00007f5abab2a929 00007f5abab2a3d2 00007f5ab40a1bd4
0709 13:18:30.768307 (+  8856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.449177 (+680870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.045127 (+595950us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54003e9254. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:32.069253 (+ 24126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596384128}
W20260709 13:18:32.175176 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 44499.4us
I20260709 13:18:32.175323 19339 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:32.175722 19290 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.177306 19306 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.179538 19310 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:32.175980 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:32.125191 19325 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.000s	sys 0.013s
I20260709 13:18:32.106312 18888 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:32.191408 17524 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:32.197814 17495 leader_election.cc:400] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:32.198158 17495 leader_election.cc:403] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:32.200790 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:32.188556 18888 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.209836 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:32.211128 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:32.212379 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.215170 18198 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:32.119680 19332 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:32.196985 19310 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.145663 18194 rpcz_store.cc:276] 0709 13:18:31.100353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.100498 (+   145us) service_pool.cc:224] Handling call
0709 13:18:31.100831 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.726854 (+626023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.144715 (+417861us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54006cf054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:32.144991 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143989632}
I20260709 13:18:32.206624 17419 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:32.207602 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.148876 17352 rpcz_store.cc:276] 0709 13:18:24.239642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.239797 (+   155us) service_pool.cc:224] Handling call
0709 13:18:32.148422 (+7908625us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:30.504500 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:30.599319 (+ 94819us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:30.599367 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:18:30.599396 (+    29us) tablet.cc:662] Decoding operations
0709 13:18:30.600155 (+   759us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:30.600238 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:30.600263 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:30.600587 (+   324us) tablet.cc:701] Row locks acquired
0709 13:18:30.600603 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:18:30.600722 (+   119us) write_op.cc:270] Start()
0709 13:18:30.600825 (+   103us) write_op.cc:276] Timestamp: P: 1783603110600683 usec, L: 0
0709 13:18:30.600844 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:30.601456 (+   612us) log.cc:844] Serialized 1302 byte log entry
0709 13:18:31.400927 (+799471us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b20001637f8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5714b91 00007f5ab5736a19 00007f5ab57018c3 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169 00007f5ab570a131 00007f5ab570942d 000000000038f354
0709 13:18:31.839498 (+438571us) op_driver.cc:464] REPLICATION: finished
0709 13:18:31.992053 (+152555us) write_op.cc:301] APPLY: starting
0709 13:18:31.992150 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:31.992290 (+   140us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:31.992313 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:31.992870 (+   557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:31.993048 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:18:31.993094 (+    46us) write_op.cc:312] APPLY: finished
0709 13:18:31.993326 (+   232us) log.cc:844] Serialized 35 byte log entry
0709 13:18:31.993516 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:31.993603 (+    87us) write_op.cc:454] Released schema lock
0709 13:18:31.993643 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:31.993996 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:31.996479 (+  2483us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":145614,"apply.run_cpu_time_us":1913,"apply.run_wall_time_us":1913,"num_ops":3,"prepare.queue_time_us":228273,"prepare.run_cpu_time_us":154599,"prepare.run_wall_time_us":578647,"raft.queue_time_us":364200,"raft.run_cpu_time_us":15242,"raft.run_wall_time_us":150954,"replication_time_us":1222045,"spinlock_wait_cycles":8583552,"thread_start_us":908927,"threads_started":4,"wal-append.queue_time_us":507217}]]}
I20260709 13:18:32.186496 18970 raft_consensus.cc:697] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:32.217434 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:32.223026 19100 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:32.225849 19067 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.225983 18856 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.226859 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:32.227268 18856 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.228152 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:32.228371 19299 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:32.228746 19342 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:32.229605 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:32.221266 17525 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:32.223125 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:32.225031 17598 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:32.191179 19361 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:32.230064 19299 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:32.230479 18199 raft_consensus.cc:2393] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:32.230374 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:32.244655 17594 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.226496 19067 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.222429 17601 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:32.231412 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:32.231750 17603 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.222414 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:32.233552 17597 raft_consensus.cc:2410] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:32.252789 17520 raft_consensus.cc:2393] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:32.234997 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:32.233578 17599 raft_consensus.cc:2410] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:32.194648 19323 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:32.187081 19131 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:32.254604 18970 consensus_queue.cc:237] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.231709 19296 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:32.231447 18856 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:32.256409 19299 raft_consensus.cc:697] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:32.256999 19332 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:32.268743 17603 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:32.246588 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:32.259083 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:32.269515 17601 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:32.261468 17594 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:32.277945 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:32.244184 18962 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.278709 18198 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 1.
I20260709 13:18:32.279400 19361 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:32.260157 19310 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:32.283114 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:32.279367 17495 connection.cc:256] RPC call timeout handler was delayed by -1.4946405610000966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260709 13:18:32.261826 19306 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:32.291702 17495 connection.cc:256] RPC call timeout handler was delayed by -1.4446110520000275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
I20260709 13:18:32.240865 18943 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.286796 19296 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:32.305366 17495 connection.cc:256] RPC call timeout handler was delayed by -1.1388111080002545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 13:18:32.293222 18166 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:32.313114 18166 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:32.314272 18166 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:32.315364 19290 raft_consensus.cc:2804] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:32.316061 19290 raft_consensus.cc:697] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:32.318275 19171 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:32.319190 19171 raft_consensus.cc:697] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:32.320328 19171 consensus_queue.cc:237] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:32.322257 19341 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:32.322993 19341 raft_consensus.cc:697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:32.324169 19341 consensus_queue.cc:237] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:32.328066 18166 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:32.311162 19361 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:32.301694 19241 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:32.312422 17495 connection.cc:256] RPC call timeout handler was delayed by -1.0920111080001789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 13:18:32.331017 17495 connection.cc:256] RPC call timeout handler was delayed by -1.0555107360000875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
I20260709 13:18:32.300072 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:32.332494 18192 raft_consensus.cc:2393] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 2: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:32.332448 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:32.310688 19100 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:32.333524 19100 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:32.334138 19361 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.335572 19100 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.317386 19290 consensus_queue.cc:237] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:32.351374 19323 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:32.352044 19323 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:32.352546 19323 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.354945 19321 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:32.368106 19339 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:32.380456 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 102945us
W20260709 13:18:32.290284 19372 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:18:32.388489 17601 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:32.290969 19308 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.303717 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:32.412072 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.376212 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:32.282986 19327 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.102s
W20260709 13:18:32.417933 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 85550.4us
I20260709 13:18:32.286943 18962 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:32.423171 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:32.290483 19263 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:18:32.286986 19368 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 13:18:32.301023 19335 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:32.303345 18888 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.365767 19323 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:32.381065 18928 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:18:32.474759 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 104343us
I20260709 13:18:32.452380 19308 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:32.463224 19247 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:32.460886 19241 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:32.479694 19308 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:32.496757 19308 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:32.497260 19379 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:18:32.498973 19373 log.cc:927] Time spent T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:32.500808 19310 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:32.502010 19310 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.460987 19348 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.483964 19296 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:32.518558 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1135) took 1241 ms. Trace:
I20260709 13:18:32.533941 19356 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:32.443614 19299 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.494485 19342 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.519887 19333 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:32.540900 19296 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:32.541141 19338 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:18:32.541383 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:18:32.543766 19381 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:18:32.492101 18193 raft_consensus.cc:1217] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 13:18:32.543648 19067 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.560644 19308 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:32.492885 19247 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.534713 17521 rpcz_store.cc:276] 0709 13:18:31.277475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.541299 (+263824us) service_pool.cc:224] Handling call
0709 13:18:31.555286 (+ 13987us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:31.555748 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.555787 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:32.178241 (+622454us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b180034a6e0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a472a6 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446f372 00007f5ab5ba1a01 00007f5ab5b6643a
0709 13:18:32.178832 (+   591us) log.cc:844] Serialized 52 byte log entry
0709 13:18:32.243589 (+ 64757us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:32.243627 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.243704 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.500370 (+256666us) raft_consensus.cc:1685] finished
0709 13:18:32.500392 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.518461 (+ 18069us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":479,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":14256,"spinlock_wait_cycles":10614272,"thread_start_us":64362,"threads_started":1,"wal-append.queue_time_us":232078}
W20260709 13:18:32.542567 19388 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:18:32.569312 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.570183 17446 raft_consensus.cc:2393] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:32.570683 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.571270 17454 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:32.533061 18943 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.558703 18193 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:32.580307 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:32.540517 19131 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:32.500675 19241 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.574468 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.576936 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.571094 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.588971 17447 raft_consensus.cc:2393] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:32.581032 17446 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.553958 19333 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:32.594789 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.595460 17448 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:32.595762 17452 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:32.596343 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.582613 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:32.594511 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.599421 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:32.599983 17449 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.602376 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.603786 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:32.546233 19350 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.585700 18195 raft_consensus.cc:1240] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:32.602471 19067 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:32.558139 19296 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:32.616195 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.616693 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.616254 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:32.617405 17454 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:32.552591 19356 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.620139 19356 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:32.610240 19389 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:18:32.620796 19247 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.620667 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:32.621961 19308 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:32.623190 19296 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.625358 17450 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:32.611886 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.605273 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.622639 17448 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.627398 17452 raft_consensus.cc:2368] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3.
I20260709 13:18:32.629187 17446 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:32.630134 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.612166 17420 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:32.595075 19401 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.631738 19401 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.632675 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:32.633948 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.635520 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:32.636739 17446 raft_consensus.cc:2393] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 5: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:32.637714 19051 raft_consensus.cc:3055] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:32.637729 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.638275 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.640944 17451 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:32.641734 19241 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.637132 19399 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.646171 19399 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.648572 19399 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.650498 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:32.652118 19350 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.657577 17446 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:32.643491 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:32.662743 19335 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:32.660548 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.624150 19131 consensus_queue.cc:1059] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:18:32.644409 19323 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:32.644738 19348 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.645366 19296 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:32.614593 19067 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.638336 19051 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:32.675544 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.676446 19051 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.662214 19401 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:32.630229 17449 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:32.677206 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:33.122299 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:32.697882 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:32.862010 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.677542 17447 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.695704 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:32.698424 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:33.127534 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:32.894455 17520 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:32.819804 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:32.749600 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.712994 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.123868 17420 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:33.144083 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.145434 17522 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:33.122885 17454 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:32.672729 17452 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:32.602213 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:33.069239 17448 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:33.126713 17523 raft_consensus.cc:2410] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:33.125684 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.148406 17449 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:33.148713 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1502) took 1168 ms. Trace:
I20260709 13:18:33.149124 17524 rpcz_store.cc:276] 0709 13:18:31.980093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.980236 (+   143us) service_pool.cc:224] Handling call
0709 13:18:31.980617 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.191993 (+211376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.148497 (+956504us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54000203d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:33.148660 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481734528}
W20260709 13:18:33.173261 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 474852us
W20260709 13:18:32.912552 19383 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.471s	user 0.003s	sys 0.000s
I20260709 13:18:33.166079 19265 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.187350 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:32.929442 18891 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:33.188365 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 64640.4us
I20260709 13:18:32.746866 19296 raft_consensus.cc:3055] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:32.865624 19335 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.193670 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:33.208359 17420 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:33.209167 17454 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:33.209679 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:33.190583 19323 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:18:32.694635 19131 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:33.197145 17452 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:33.134845 18962 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:33.206786 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:32.907778 19405 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.188890 19342 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.247524 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.193408 19252 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.201046 18192 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.254482 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:33.269587 17524 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.201823 19051 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.257488 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.190888 19067 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:33.261375 17523 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:33.192785 18891 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:32.674219 19333 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.212739 19401 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.275643 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.237439 19399 raft_consensus.cc:2764] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:33.237319 19131 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.284124 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.284780 17521 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:33.276729 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.285859 17523 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:33.238947 19026 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.282472 18891 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:33.283515 17529 raft_consensus.cc:2393] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:33.200742 19265 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.212177 19296 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:33.294323 17524 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:33.294818 17446 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:33.283583 19310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.027s	sys 0.058s
I20260709 13:18:33.297293 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.302639 17529 raft_consensus.cc:2393] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:33.220834 19335 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.305537 17524 raft_consensus.cc:1240] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.308519 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.309407 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.310113 17527 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:33.310237 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.262993 18962 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:18:33.291154 19131 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:33.303439 19310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.027s	sys 0.058s
I20260709 13:18:33.298071 19333 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.273960 19252 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.319118 17446 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:33.263547 19405 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.322283 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.323017 17520 raft_consensus.cc:2393] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:33.335397 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.343312 17446 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:33.335240 17524 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:33.372620 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.375195 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1154) took 1169 ms. Trace:
I20260709 13:18:33.378822 17526 rpcz_store.cc:276] 0709 13:18:32.205363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.211908 (+  6545us) service_pool.cc:224] Handling call
0709 13:18:32.212202 (+   294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:32.242961 (+ 30759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.242993 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:32.251538 (+  8545us) log.cc:844] Serialized 52 byte log entry
0709 13:18:32.263607 (+ 12069us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:32.263968 (+   361us) log.cc:844] Serialized 14 byte log entry
0709 13:18:32.264187 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.264267 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.911785 (+647518us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:33.371641 (+459856us) raft_consensus.cc:1685] finished
0709 13:18:33.374959 (+  3318us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.375130 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20530,"prepare.queue_time_us":23525,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":57613,"raft.queue_time_us":31053,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":11613,"spinlock_wait_cycles":4942208,"thread_start_us":6140,"threads_started":1,"wal-append.queue_time_us":153670}
I20260709 13:18:33.342976 19399 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:33.389549 19409 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:33.401595 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.417447 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.423722 18195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42548 (request call id 250) took 1214 ms. Trace:
I20260709 13:18:33.424306 18195 rpcz_store.cc:276] 0709 13:18:32.209310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.211321 (+  2011us) service_pool.cc:224] Handling call
0709 13:18:32.550802 (+339481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.612571 (+ 61769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.423390 (+810819us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54004c95d0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:33.423634 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768608000}
I20260709 13:18:33.429539 19293 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.430137 19293 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.432588 19293 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:33.433156 19293 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:33.433591 19293 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.464157 19254 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:33.464295 19293 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:33.464915 19254 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.465469 19293 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.466110 19293 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.468823 19293 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:33.472251 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:33.343243 19296 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:33.493005 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.493989 17452 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:33.403431 19399 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.411684 19405 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:33.514210 17447 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:33.520923 19296 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.521924 19265 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:33.521948 18192 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:33.533407 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.537930 17450 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:33.338625 19406 log.cc:927] Time spent T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:18:33.527452 19335 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:33.549719 19391 log.cc:927] Time spent T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.970s	user 0.007s	sys 0.017s
I20260709 13:18:33.536859 19252 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:33.559012 17448 raft_consensus.cc:1217] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-5.3]   Dedup: 3.2->[5.3-5.3]
I20260709 13:18:33.559597 17448 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:18:33.563338 17526 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:33.565433 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.566097 17450 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:33.566987 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.567641 17452 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:33.574061 19254 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:33.576783 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:33.577694 17524 raft_consensus.cc:2368] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4.
I20260709 13:18:33.578778 19358 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.579336 19358 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.580408 17521 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:33.581557 19358 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:33.581920 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.582654 17522 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:33.583449 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.584096 17526 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:33.587746 17445 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:33.588356 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1162) took 1019 ms. Trace:
I20260709 13:18:33.588688 17445 rpcz_store.cc:276] 0709 13:18:32.569248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.571386 (+  2138us) service_pool.cc:224] Handling call
0709 13:18:33.472126 (+900740us) spinlock_profiling.cc:243] Waited 9.53 ms on lock 0x7b5800002798. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41f8c 00007f5ab2a41ef6 0000000000375939 00007f5abaab51e0 00007f5abab7e0c4 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:33.588296 (+116170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21924992}
W20260709 13:18:33.595480 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.595155 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.598513 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.596815 19254 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:33.599972 19254 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.607342 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.608161 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1175) took 1032 ms. Trace:
I20260709 13:18:33.608534 17453 rpcz_store.cc:276] 0709 13:18:32.575602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.603474 (+ 27872us) service_pool.cc:224] Handling call
0709 13:18:33.607168 (+1003694us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b5800002798. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:33.608105 (+   937us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3788544}
I20260709 13:18:33.598896 18193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42548 (request call id 247) took 1990 ms. Trace:
I20260709 13:18:33.603883 19335 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:33.617676 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.619378 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:33.619994 17453 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:18:33.622206 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:33.622628 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:33.622714 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 408481us
W20260709 13:18:33.625221 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 450186us
I20260709 13:18:33.625245 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.626343 17529 raft_consensus.cc:2393] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:33.626266 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:33.624579 17445 raft_consensus.cc:1240] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:33.652050 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:33.665643 17450 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:33.628636 19399 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:33.671358 17453 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:33.701568 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.702345 17452 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
W20260709 13:18:33.683007 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.713732 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.714679 17448 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:33.714674 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 43942us
I20260709 13:18:33.716734 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:33.655433 19415 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:33.721941 17569 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.627s (SENT) [suppressed 16 similar messages]
I20260709 13:18:33.657238 19342 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:18:33.675861 19265 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.731352 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:33.700234 19293 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.630228 19310 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:33.617529 18193 rpcz_store.cc:276] 0709 13:18:31.608275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.610666 (+  2391us) service_pool.cc:224] Handling call
0709 13:18:31.683489 (+ 72823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.580429 (+896940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.598594 (+1018165us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b54005f0854. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:33.598832 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1847380224}
I20260709 13:18:33.739377 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:33.621570 19335 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:33.745252 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 82643.3us
I20260709 13:18:33.770536 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.711687 19416 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:33.718410 19254 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:33.784420 17529 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:33.733047 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:18:33.801431 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 84771.8us
I20260709 13:18:33.728461 19131 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.774865 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:33.819727 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.783739 19423 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.820322 17450 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:33.825860 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.827241 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.827904 17450 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:33.804304 18195 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.787741 19254 raft_consensus.cc:2764] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:33.829474 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:33.824563 17529 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:33.732932 19415 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:33.777642 19293 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:33.818924 19051 consensus_meta.cc:287] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.006s
I20260709 13:18:33.773258 19265 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.832692 17446 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:18:33.830108 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 90825us
I20260709 13:18:33.778491 19310 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.843348 17451 raft_consensus.cc:2410] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:33.829355 19414 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:33.795059 19416 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:33.840641 18192 raft_consensus.cc:2368] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7.
I20260709 13:18:33.836891 19430 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:33.831225 19423 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:33.858471 17520 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:33.849906 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
W20260709 13:18:33.856568 19390 log.cc:927] Time spent T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 1.277s	user 0.006s	sys 0.006s
W20260709 13:18:33.854707 19403 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.275s	user 0.012s	sys 0.018s
W20260709 13:18:33.850872 19410 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:18:33.847824 19411 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:33.854861 19416 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:33.840494 19323 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:18:33.853001 19433 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:33.879388 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 145400us
I20260709 13:18:33.882015 17529 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:33.852515 19265 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:33.855304 19293 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:33.858315 19342 raft_consensus.cc:2764] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:33.852766 19310 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:33.890220 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:33.854831 19432 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:18:33.896642 17419 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:33.899704 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 177795us
W20260709 13:18:33.897114 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 77898.6us
I20260709 13:18:33.879047 19413 raft_consensus.cc:2764] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:18:33.905335 17447 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1178) took 1328 ms (client timeout 1687 ms). Trace:
W20260709 13:18:33.908640 17447 rpcz_store.cc:269] 0709 13:18:32.576446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.600862 (+ 24416us) service_pool.cc:224] Handling call
0709 13:18:33.905162 (+1304300us) spinlock_profiling.cc:243] Waited 73.1 ms on lock 0x7b54000db1d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:33.905278 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168077696}
W20260709 13:18:33.909554 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 62505us
I20260709 13:18:33.905568 17454 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:33.911835 18167 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:33.913590 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.916270 17569 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:33.906857 17568 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:33.916917 17495 leader_election.cc:400] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3.
I20260709 13:18:33.917781 17495 leader_election.cc:403] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:33.919536 17568 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:33.849040 19414 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.896227 19428 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:18:33.883396 19411 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.906494 19293 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:33.925832 18167 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:33.936069 17568 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:33.867286 19430 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:33.893360 19412 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:18:33.924361 19265 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:33.926791 19416 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:33.903219 19310 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:18:33.925056 19411 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:33.924420 19414 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:33.920151 19447 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.951370 19414 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3.
W20260709 13:18:33.951911 19426 log.cc:927] Time spent T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:18:33.946545 19429 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:33.953805 19436 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:18:33.954241 19430 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:33.929308 19440 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:33.925973 19341 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:18:33.895263 19433 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:33.926602 19293 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:33.977674 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 51909.8us
I20260709 13:18:33.948076 19416 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.947865 19265 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.939256 19419 consensus_queue.cc:1059] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:18:33.958105 19335 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:33.991043 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 54759us
W20260709 13:18:33.999099 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.000008 19296 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:34.001974 19296 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.002435 19296 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.962622 19131 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:33.937002 19413 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:18:34.007103 19451 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:33.992110 19411 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.996742 19416 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:33.996680 19265 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.022866 19335 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:33.993789 19423 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:34.030179 19333 consensus_meta.cc:287] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.004s
I20260709 13:18:34.029718 18195 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:33.992326 19442 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:18:34.037614 17568 leader_election.cc:400] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4.
I20260709 13:18:34.024858 19451 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.994541 19429 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:18:34.056676 17568 leader_election.cc:403] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.032163 19335 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:34.056182 19451 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.053638 19412 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:34.075012 19299 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:34.080209 19412 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:34.080384 19265 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.062512 19442 consensus_queue.cc:1059] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:34.082794 19442 raft_consensus.cc:3055] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:34.083160 19442 raft_consensus.cc:740] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:34.083316 19265 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:34.083973 19442 consensus_queue.cc:260] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:34.085387 19442 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.064488 19455 raft_consensus.cc:3055] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:34.069069 17568 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.055481 19423 raft_consensus.cc:3055] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:34.103075 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:34.072881 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 158277us
I20260709 13:18:34.072449 17449 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:34.088371 19455 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:34.078301 19335 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.056033 19333 consensus_queue.cc:1059] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:18:34.092675 19450 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.093878 19412 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:34.077911 19254 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4.
I20260709 13:18:34.095942 19433 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:34.122833 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:34.123797 17522 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:34.124836 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:34.125787 17527 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:34.127632 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:34.097293 19451 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.098982 17597 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:34.104171 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.110502 17600 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:34.033771 19411 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:34.117329 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:34.117901 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:34.118202 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:34.132541 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:34.132679 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:34.134320 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:34.134949 17522 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:34.135210 19293 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:34.135844 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:34.136512 17522 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:34.130203 19450 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.112130 19265 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:34.139550 19265 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.139902 19265 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.140547 19450 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:34.141760 18888 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:34.144163 19451 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:34.146354 19350 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:34.147133 19350 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:34.148360 19350 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.150735 19296 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.153746 19296 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:34.155946 19455 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.157655 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:34.170723 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 66634.1us
I20260709 13:18:34.160012 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:34.160804 17568 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:34.158981 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 262431us
I20260709 13:18:34.171733 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.138413 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:34.172214 17568 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.169379 17524 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.099390 19423 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:34.175099 17568 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.175920 17568 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.174072 17419 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.173688 17350 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40488 (request call id 189) took 8911 ms. Trace:
W20260709 13:18:34.170503 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 254278us
I20260709 13:18:34.163770 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:34.189766 17524 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:34.178436 17526 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:34.209494 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 106525us
I20260709 13:18:34.171016 17525 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:34.172573 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.213944 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.178861 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:34.214900 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:34.216723 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:34.208845 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:34.220502 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46536.3us
I20260709 13:18:34.220831 17420 leader_election.cc:400] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) with higher term. Message: Invalid argument: T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7.
I20260709 13:18:34.221133 17420 leader_election.cc:403] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.221285 17419 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.222246 17419 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:34.222388 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:34.223268 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:34.224018 17521 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:34.225858 17594 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:34.234381 19434 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:34.234899 19434 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.235527 19434 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.176996 19464 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:34.237475 19464 raft_consensus.cc:697] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:34.177444 17350 rpcz_store.cc:276] 0709 13:18:25.278088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.282601 (+  4513us) service_pool.cc:224] Handling call
0709 13:18:27.380237 (+2097636us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b540001b8d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5ad0090 00007f5ab5b6ef3a 00007f5abb9251cc 00007f5abba2337e 00007f5ab9ee42a4 00007f5ab9ee4232 00007f5ab9ee4161 00007f5ab9ee40dc 00007f5ab9ee3392 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:34.159093 (+6778856us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:31.532997 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:31.533562 (+   565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:31.535847 (+  2285us) write_op.cc:435] Acquired schema lock
0709 13:18:31.535873 (+    26us) tablet.cc:662] Decoding operations
0709 13:18:31.818752 (+282879us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:31.822818 (+  4066us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:31.823881 (+  1063us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:31.930178 (+106297us) tablet.cc:701] Row locks acquired
0709 13:18:31.933006 (+  2828us) write_op.cc:260] PREPARE: finished
0709 13:18:31.952413 (+ 19407us) write_op.cc:270] Start()
0709 13:18:31.960218 (+  7805us) write_op.cc:276] Timestamp: P: 1783603111946723 usec, L: 0
0709 13:18:31.962337 (+  2119us) op_driver.cc:348] REPLICATION: starting
0709 13:18:32.038834 (+ 76497us) log.cc:844] Serialized 2540 byte log entry
0709 13:18:32.087711 (+ 48877us) op_driver.cc:464] REPLICATION: finished
0709 13:18:32.088223 (+   512us) write_op.cc:301] APPLY: starting
0709 13:18:32.088303 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:32.088525 (+   222us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:32.088615 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:32.089714 (+  1099us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:32.089901 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:18:32.089968 (+    67us) write_op.cc:312] APPLY: finished
0709 13:18:32.090249 (+   281us) log.cc:844] Serialized 53 byte log entry
0709 13:18:32.090432 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:32.090541 (+   109us) write_op.cc:454] Released schema lock
0709 13:18:32.090585 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:32.090957 (+   372us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:32.090986 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":58200,"reported_tablets":20,"spinlock_wait_cycles":1360724352,"child_traces":[["op",{"apply.queue_time_us":293,"apply.run_cpu_time_us":2686,"apply.run_wall_time_us":2686,"num_ops":6,"prepare.queue_time_us":483,"prepare.run_cpu_time_us":6735,"prepare.run_wall_time_us":532289,"replication_time_us":125203}]]}
I20260709 13:18:34.177070 19451 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:34.177286 19293 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:34.180848 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:34.281793 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 59621.5us
I20260709 13:18:34.281343 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:34.250396 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.208801 19433 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:34.247073 17420 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:34.226886 18888 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:34.256217 17526 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:34.247329 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.227169 19310 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:34.235543 19411 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:34.226327 19333 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:34.285701 17599 raft_consensus.cc:2410] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:34.288805 17597 raft_consensus.cc:2393] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 4: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:34.226817 19450 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:34.246587 19453 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) with higher term. Message: Invalid argument: T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7.
I20260709 13:18:34.233006 19254 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:34.238729 19455 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.317242 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.227070 19459 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:34.243110 19167 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:34.240756 19252 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:34.252187 19451 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:34.316166 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 69175.7us
I20260709 13:18:34.326555 17597 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:34.312937 19333 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:34.337136 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:34.370378 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 148076us
I20260709 13:18:34.328871 17596 raft_consensus.cc:2393] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:34.333348 17600 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:34.316800 19457 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:34.325870 18888 raft_consensus.cc:697] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:34.326341 19254 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.327694 19310 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:34.291121 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:34.399863 18198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42548 (request call id 253) took 1256 ms. Trace:
I20260709 13:18:34.334770 19466 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:34.335326 19252 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:34.368336 19333 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.292599 19433 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:34.364213 19451 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.336272 19167 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:34.377813 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 134042us
I20260709 13:18:34.338243 19462 raft_consensus.cc:1064] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:34.409754 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.435376 17597 raft_consensus.cc:2410] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:34.395259 19254 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.317584 19464 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:34.400295 18198 rpcz_store.cc:276] 0709 13:18:33.143883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.150768 (+  6885us) service_pool.cc:224] Handling call
0709 13:18:33.189763 (+ 38995us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:33.285075 (+ 95312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.285111 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:33.292137 (+  7026us) log.cc:844] Serialized 52 byte log entry
0709 13:18:33.618555 (+326418us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:33.779625 (+161070us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.825380 (+ 45755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.391995 (+566615us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b54003b24d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:34.392042 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.392087 (+    45us) raft_consensus.cc:1685] finished
0709 13:18:34.399582 (+  7495us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.399793 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65796,"prepare.queue_time_us":203219,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":85609,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":9629,"spinlock_wait_cycles":205994880,"thread_start_us":428934,"threads_started":2,"wal-append.queue_time_us":589407}
I20260709 13:18:34.387902 19293 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.436352 17601 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:34.438555 19293 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.423863 19415 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:34.430464 19167 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.442965 19265 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:34.445494 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 73909.4us
I20260709 13:18:34.454267 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:34.455231 17602 raft_consensus.cc:2368] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:34.392928 19457 raft_consensus.cc:697] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:34.457252 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:34.463639 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:34.464718 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:34.457939 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:34.458187 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 301157us
I20260709 13:18:34.459053 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:34.461388 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:34.467669 17569 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:34.411988 19252 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.414994 18193 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.468962 18888 consensus_queue.cc:237] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.465744 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:34.480856 17453 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:34.473328 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:34.315464 19423 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.476390 17523 raft_consensus.cc:2410] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:34.477041 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:34.483814 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.484730 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:34.491772 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.493729 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:34.492292 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.496595 17602 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:34.462000 19299 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:34.491235 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:34.475392 19466 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:34.471591 19453 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.491309 19350 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:18:34.512053 19461 raft_consensus.cc:3055] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:34.509881 19453 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.512496 19461 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:34.514348 19453 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:34.515143 17568 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:34.516362 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 233008us
I20260709 13:18:34.516300 19254 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.519493 19428 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:34.519776 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:34.520561 17452 raft_consensus.cc:2376] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4. Re-sending same reply.
I20260709 13:18:34.522974 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.523276 17449 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:34.524192 19350 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:34.475986 19450 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:34.475574 19432 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:34.550916 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.485916 19348 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.479140 19442 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:34.571640 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 56589.9us
I20260709 13:18:34.604017 17568 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.604828 17448 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:34.607878 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.500167 19430 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:34.572664 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 81540.2us
I20260709 13:18:34.494464 17450 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.475247 19415 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:34.472708 19465 consensus_queue.cc:1059] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:18:34.604849 17568 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.499518 19454 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
W20260709 13:18:34.644239 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 126839us
I20260709 13:18:34.645543 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:34.552541 19423 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.645875 17419 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:34.650876 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 166241us
I20260709 13:18:34.500811 19411 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:34.513512 19461 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.657446 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.611649 19435 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:34.488848 19440 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 13:18:34.638038 19466 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.612025 19473 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:34.669996 17601 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:34.643685 19430 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:34.692291 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 87394.2us
I20260709 13:18:34.600274 19450 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:34.624972 19348 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.664222 19465 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:34.700376 17568 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.664861 19442 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:34.700433 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.663182 19411 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.701869 17419 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.697383 19435 raft_consensus.cc:697] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:18:34.702852 19471 log.cc:927] Time spent T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:18:34.732653 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.710301 17450 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:34.599601 19310 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.724663 17419 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:34.689525 19420 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:34.728906 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.693019 19265 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:34.690295 19466 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:34.693200 19473 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.599695 19432 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.711298 19465 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.701768 19430 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.653960 19443 consensus_queue.cc:1059] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:18:34.747478 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:34.713788 19461 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.722669 19411 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.689692 18935 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:18:34.715564 19442 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:34.731143 19254 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:34.748113 19489 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:34.650300 19415 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:34.689265 19453 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:18:34.641256 19457 consensus_queue.cc:237] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:34.750959 19473 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.750732 19466 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:34.765595 19478 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:34.737124 19131 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:34.744051 19420 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:34.754565 19416 consensus_meta.cc:287] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.706s	user 0.006s	sys 0.007s
I20260709 13:18:34.768556 19371 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:34.753849 19465 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.776666 19442 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.808286 19489 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:34.856729 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.857841 17603 raft_consensus.cc:2410] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:18:34.860553 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 149262us
I20260709 13:18:34.787359 18888 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:18:34.813956 19131 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.820362 19371 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.808833 19304 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:34.891114 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:34.877308 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.821669 19420 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.899950 19350 raft_consensus.cc:697] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:34.900159 19371 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.905751 19304 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.913278 19350 consensus_queue.cc:237] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.915490 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.889292 19433 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:34.896363 19131 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.823770 19416 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.905722 19450 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:34.950723 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.951532 17603 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:34.817025 19435 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:34.941066 19438 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:18:34.965839 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 320832us
I20260709 13:18:34.966180 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:34.966423 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:34.976133 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:35.025194 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:35.026563 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:35.027599 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:34.964277 19474 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
W20260709 13:18:35.031597 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 55599.1us
W20260709 13:18:35.064675 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.065202 17445 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:35.065256 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.964437 19304 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:35.024055 19476 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
W20260709 13:18:35.078804 19487 log.cc:927] Time spent T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260709 13:18:35.080610 19485 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 13:18:35.084233 19167 consensus_meta.cc:287] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.001s
W20260709 13:18:35.084686 19293 consensus_meta.cc:287] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.001s
I20260709 13:18:35.085340 19293 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.087684 19167 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.090382 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:35.090956 19494 consensus_queue.cc:1059] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:35.091542 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:35.091799 19494 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:35.092147 17595 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:35.092922 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:35.093420 19416 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.094007 19416 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:35.094483 19416 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:35.094794 19459 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:35.095412 19459 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.095551 19416 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:35.021840 19467 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.098555 19467 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.103297 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:35.093864 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:35.105278 17595 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:35.064210 18888 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.092162 19494 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.165831 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:35.128149 19348 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.183755 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:35.172080 19494 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.203819 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1479) took 2049 ms. Trace:
I20260709 13:18:35.204289 17454 rpcz_store.cc:276] 0709 13:18:33.154079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.263340 (+109261us) service_pool.cc:224] Handling call
0709 13:18:33.905407 (+642067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.910543 (+  5136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.203593 (+1293050us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54000db1d0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:35.203754 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1467836800}
I20260709 13:18:35.209543 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:34.943392 19462 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:35.176113 19459 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.031260 19438 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:35.188987 18888 raft_consensus.cc:697] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:34.957551 19489 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:35.211817 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 487194us
W20260709 13:18:35.231153 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.231600 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 204085us
I20260709 13:18:35.234565 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:35.234709 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:35.212796 19254 raft_consensus.cc:3055] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:35.235772 17520 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.236861 17526 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:35.237061 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.252802 17451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1475) took 2595 ms (client timeout 2308 ms). Trace:
I20260709 13:18:35.242049 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:35.253221 17451 rpcz_store.cc:269] 0709 13:18:32.633988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.642075 (+  8087us) service_pool.cc:224] Handling call
0709 13:18:35.229291 (+2587216us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b54001f0754. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:35.229443 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654285696}
I20260709 13:18:35.254513 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:35.220757 19498 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:35.260056 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:35.258790 17603 raft_consensus.cc:2410] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:35.236778 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:35.259135 17527 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:35.297447 17447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.006s	sys 0.019s
W20260709 13:18:35.300117 17447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.007s	sys 0.019s
W20260709 13:18:35.301852 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 65180.9us
I20260709 13:18:35.323094 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:35.323676 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:35.323830 17603 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:35.324502 17523 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:35.238389 19254 raft_consensus.cc:740] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:35.253274 19435 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.344012 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:35.344884 17523 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:35.344159 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:35.225916 19473 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.347350 17603 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:35.362115 19514 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:35.362960 17528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 1143) took 3233 ms (client timeout 1572 ms). Trace:
W20260709 13:18:35.363157 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 129142us
W20260709 13:18:35.363529 17528 rpcz_store.cc:269] 0709 13:18:32.121268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.121395 (+   127us) service_pool.cc:224] Handling call
0709 13:18:35.354180 (+3232785us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54000fee54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:35.354332 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4266491776}
I20260709 13:18:35.346266 19498 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:35.365255 19333 consensus_meta.cc:287] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.940s	user 0.006s	sys 0.011s
W20260709 13:18:35.373839 19335 consensus_meta.cc:287] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.252s	user 0.015s	sys 0.002s
I20260709 13:18:35.392191 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:35.402711 17520 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:35.375097 19429 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:35.421672 17527 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:35.346222 19435 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.427259 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:35.396297 19499 log.cc:927] Time spent T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.317s	user 0.001s	sys 0.001s
I20260709 13:18:35.428388 17603 raft_consensus.cc:2410] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:18:35.413311 19434 consensus_meta.cc:287] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.177s	user 0.009s	sys 0.004s
I20260709 13:18:35.435858 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 149) took 1336 ms. Trace:
I20260709 13:18:35.342566 19490 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.343s
I20260709 13:18:35.436321 17594 rpcz_store.cc:276] 0709 13:18:34.099399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.099591 (+   192us) service_pool.cc:224] Handling call
0709 13:18:34.129832 (+ 30241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.226300 (+ 96468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.435584 (+1209284us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b54003ea154. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:35.435780 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119671168}
I20260709 13:18:35.364109 19465 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.346231 18888 consensus_queue.cc:237] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.531440 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:35.443962 19434 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:35.436623 19461 consensus_meta.cc:287] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.004s
I20260709 13:18:35.436544 19497 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:35.390247 19498 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.413110 19335 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.396112 19333 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.547814 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:35.391031 19254 consensus_queue.cc:260] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:35.554493 17594 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
W20260709 13:18:35.561043 19511 log.cc:927] Time spent T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 13:18:35.564960 19503 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 13:18:35.568858 19455 consensus_meta.cc:287] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.241s	user 0.002s	sys 0.009s
I20260709 13:18:35.570727 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:35.571396 17603 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:35.572343 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:35.572759 19451 consensus_meta.cc:287] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.116s	user 0.008s	sys 0.001s
I20260709 13:18:35.573151 19451 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.573632 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:35.591814 17595 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:35.592269 17603 raft_consensus.cc:2410] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:18:35.545046 19423 consensus_meta.cc:287] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.882s	user 0.009s	sys 0.009s
I20260709 13:18:35.579123 19308 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:35.580251 19435 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.430564 19429 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:35.580842 19310 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:18:35.589944 19371 consensus_meta.cc:287] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
I20260709 13:18:35.543959 19438 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:35.581821 19514 consensus_queue.cc:1059] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:18:35.583668 19293 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.583890 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1192) took 1124 ms. Trace:
I20260709 13:18:35.586730 17598 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:35.586855 17597 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:35.587997 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1193) took 1128 ms. Trace:
W20260709 13:18:35.565040 19252 consensus_meta.cc:287] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 1.079s	user 0.007s	sys 0.002s
W20260709 13:18:35.578706 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.556959 19497 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:35.602972 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:35.604107 17602 raft_consensus.cc:2393] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:35.609177 17600 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:35.581208 19508 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.647923 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:35.684224 17594 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:35.594934 19335 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.585920 19498 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.674846 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:35.663595 19131 consensus_meta.cc:287] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.711s	user 0.004s	sys 0.007s
I20260709 13:18:35.664028 17446 rpcz_store.cc:276] 0709 13:18:34.459479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.511432 (+ 51953us) service_pool.cc:224] Handling call
0709 13:18:34.511799 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:34.535632 (+ 23833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.535683 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:34.575260 (+ 39577us) log.cc:844] Serialized 52 byte log entry
0709 13:18:34.892446 (+317186us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:35.228291 (+335845us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.228792 (+   501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.228864 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.587770 (+358906us) raft_consensus.cc:1685] finished
0709 13:18:35.587792 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.587939 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50538,"prepare.queue_time_us":75251,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":590,"raft.queue_time_us":163788,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":53878,"thread_start_us":505207,"threads_started":2,"wal-append.queue_time_us":301753}
W20260709 13:18:35.657533 19442 consensus_meta.cc:287] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.796s	user 0.013s	sys 0.003s
I20260709 13:18:35.663514 17447 rpcz_store.cc:276] 0709 13:18:34.459246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.501150 (+ 41904us) service_pool.cc:224] Handling call
0709 13:18:34.557551 (+ 56401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:34.642454 (+ 84903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.642502 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:34.643242 (+   740us) log.cc:844] Serialized 52 byte log entry
0709 13:18:35.302457 (+659215us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:35.314705 (+ 12248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.314814 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.583593 (+268779us) raft_consensus.cc:1685] finished
0709 13:18:35.583621 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.583815 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76017,"raft.queue_time_us":46437,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":32542,"thread_start_us":586811,"threads_started":1,"wal-append.queue_time_us":751070}
I20260709 13:18:35.688385 17603 raft_consensus.cc:2368] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6.
I20260709 13:18:35.616341 19308 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.684556 19401 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.707326 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:35.686411 19420 consensus_meta.cc:287] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.766s	user 0.005s	sys 0.006s
W20260709 13:18:35.706463 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.725334 17603 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:35.725893 17603 pending_rounds.cc:85] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 2
I20260709 13:18:35.726215 17603 pending_rounds.cc:107] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:35.726513 17603 raft_consensus.cc:2889] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.727392 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1267) took 1022 ms. Trace:
I20260709 13:18:35.727802 17603 rpcz_store.cc:276] 0709 13:18:34.704967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.697833 (+992866us) service_pool.cc:224] Handling call
0709 13:18:35.724876 (+ 27043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.727045 (+  2169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.727317 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.728312 17594 raft_consensus.cc:2410] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:35.667390 19371 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.758671 17603 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:18:35.759322 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:35.760056 18195 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:35.760560 18195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42536 (request call id 149) took 1518 ms. Trace:
I20260709 13:18:35.760993 19308 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.759310 17603 pending_rounds.cc:85] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 2
I20260709 13:18:35.762231 17603 pending_rounds.cc:107] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:18:35.762537 17603 raft_consensus.cc:2889] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.763295 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1268) took 1058 ms. Trace:
I20260709 13:18:35.763814 17603 rpcz_store.cc:276] 0709 13:18:34.705188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.728786 (+1023598us) service_pool.cc:224] Handling call
0709 13:18:35.756176 (+ 27390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.763034 (+  6858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.763241 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.701705 19333 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.697647 19442 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:35.782598 19430 consensus_meta.cc:287] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.011s	user 0.016s	sys 0.002s
I20260709 13:18:35.783181 19430 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.784111 19442 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.784904 17601 raft_consensus.cc:2393] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:35.785638 19430 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.786753 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1259) took 1089 ms. Trace:
I20260709 13:18:35.787155 17601 rpcz_store.cc:276] 0709 13:18:34.697467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.700180 (+  2713us) service_pool.cc:224] Handling call
0709 13:18:35.786551 (+1086371us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001e46d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:35.786692 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467835776}
I20260709 13:18:35.788653 17601 raft_consensus.cc:1240] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:35.789198 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1269) took 1083 ms. Trace:
I20260709 13:18:35.790156 19308 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:35.790673 19308 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.792117 19415 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.792996 19308 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.793408 17594 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:35.794060 19418 raft_consensus.cc:3055] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.794672 19418 raft_consensus.cc:740] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:35.795734 19418 consensus_queue.cc:260] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:35.797086 19418 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.675189 19494 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.799863 19494 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.688335 19508 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.801265 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1265) took 1096 ms. Trace:
W20260709 13:18:35.754863 18193 consensus_meta.cc:287] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 1.254s	user 0.012s	sys 0.000s
I20260709 13:18:35.657895 19310 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:35.733301 19401 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.801651 17595 rpcz_store.cc:276] 0709 13:18:34.704458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.149952 (+445494us) service_pool.cc:224] Handling call
0709 13:18:35.801064 (+651112us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54000767d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:35.801211 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921310464}
I20260709 13:18:35.695973 19131 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.686389 19252 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.818516 19167 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.760887 18195 rpcz_store.cc:276] 0709 13:18:34.241881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.247867 (+  5986us) service_pool.cc:224] Handling call
0709 13:18:35.753856 (+1505989us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b5800003c98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:35.760471 (+  6615us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16050560}
I20260709 13:18:35.765923 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:35.766963 18192 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:35.767282 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:35.828099 18194 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:35.830972 18193 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
W20260709 13:18:35.831892 18193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42536 (request call id 148) took 1612 ms (client timeout 1716 ms). Trace:
W20260709 13:18:35.832300 18193 rpcz_store.cc:269] 0709 13:18:34.219580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.220484 (+   904us) service_pool.cc:224] Handling call
0709 13:18:35.831829 (+1611345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.833312 18200 raft_consensus.cc:1240] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.837246 19310 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:35.725528 19420 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.736151 19296 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:35.841424 19296 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:35.770157 19429 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.770795 19254 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.738077 19497 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:35.774366 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:35.851323 17447 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:35.775084 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:35.775897 17445 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:35.860832 17603 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:35.777174 17599 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
W20260709 13:18:35.745740 19466 consensus_meta.cc:287] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.924s	user 0.005s	sys 0.005s
I20260709 13:18:35.778465 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:35.862951 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1263) took 1159 ms. Trace:
I20260709 13:18:35.862534 19466 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.865244 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:35.865080 17599 rpcz_store.cc:276] 0709 13:18:34.703970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.747165 (+ 43195us) service_pool.cc:224] Handling call
0709 13:18:35.862738 (+1115573us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b5400063954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:35.862880 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984488832}
I20260709 13:18:35.779284 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:35.779989 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:35.794113 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1271) took 1088 ms. Trace:
I20260709 13:18:35.866814 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:35.751158 19451 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.789613 17601 rpcz_store.cc:276] 0709 13:18:34.705415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.788187 (+1082772us) service_pool.cc:224] Handling call
0709 13:18:35.788465 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.788993 (+   528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.789151 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.876617 17524 raft_consensus.cc:2393] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 2: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:35.888134 19413 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.876782 19454 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.899775 19413 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:35.900077 19454 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:35.876807 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 65986.1us
I20260709 13:18:35.905184 19434 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.909222 19466 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.912918 19465 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:35.805925 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.814949 19508 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.817713 19415 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:35.861117 18192 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:18:35.867230 17594 rpcz_store.cc:276] 0709 13:18:34.705855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.792849 (+1086994us) service_pool.cc:224] Handling call
0709 13:18:35.793217 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.793850 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.794058 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.867570 17599 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:35.919155 18166 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:35.776786 19411 consensus_meta.cc:287] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.991s	user 0.017s	sys 0.000s
I20260709 13:18:35.913658 19429 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.864727 19432 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.964684 19419 raft_consensus.cc:3055] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:35.964934 19131 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.965144 19419 raft_consensus.cc:740] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:35.966225 19454 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.926471 18200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42538 (request call id 236) took 1211 ms. Trace:
I20260709 13:18:35.870281 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1275) took 1129 ms. Trace:
I20260709 13:18:35.930968 19304 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:35.935256 19252 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.939540 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1262) took 1235 ms. Trace:
I20260709 13:18:35.882166 19473 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:35.928153 19440 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.922014 18192 pending_rounds.cc:85] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Aborting all ops after (but not including) 3
I20260709 13:18:35.950170 19411 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.951378 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1247) took 1735 ms. Trace:
I20260709 13:18:35.952325 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1254) took 1516 ms. Trace:
I20260709 13:18:35.952564 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:35.953502 19401 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:35.956755 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:35.993884 17454 raft_consensus.cc:2368] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6.
I20260709 13:18:35.958972 18193 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:35.918658 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:35.993014 17597 rpcz_store.cc:276] 0709 13:18:34.436006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.436120 (+   114us) service_pool.cc:224] Handling call
0709 13:18:34.454326 (+ 18206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.663960 (+1209634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.952104 (+288144us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000370d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:35.952265 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604140288}
I20260709 13:18:35.966064 19419 consensus_queue.cc:260] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:35.963660 17351 catalog_manager.cc:5697] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 2 to 3, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 3 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:35.930296 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:35.967146 18200 rpcz_store.cc:276] 0709 13:18:34.715264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.715394 (+   130us) service_pool.cc:224] Handling call
0709 13:18:35.833122 (+1117728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.833730 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.926190 (+ 92460us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540068d3d0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:35.926390 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2569794304}
I20260709 13:18:35.967715 17603 rpcz_store.cc:276] 0709 13:18:34.733112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.803211 (+1070099us) service_pool.cc:224] Handling call
0709 13:18:35.860560 (+ 57349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.861911 (+  1351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.862206 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:35.976688 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1194) took 1516 ms. Trace:
I20260709 13:18:35.974220 19454 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:35.976824 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:36.004599 17445 raft_consensus.cc:2393] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:35.978773 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:36.005541 17451 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:35.981150 17449 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:35.957763 19467 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:36.007123 19304 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.007783 19419 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.992815 18192 pending_rounds.cc:107] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 13:18:36.009617 18192 raft_consensus.cc:2917] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
W20260709 13:18:36.011361 17521 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.035s	sys 0.083s
W20260709 13:18:35.940795 17602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1257) took 1333 ms (client timeout 1766 ms). Trace:
W20260709 13:18:36.011701 17521 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.035s	sys 0.083s
I20260709 13:18:35.983458 17600 rpcz_store.cc:276] 0709 13:18:34.703712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.965899 (+262187us) service_pool.cc:224] Handling call
0709 13:18:35.939292 (+973393us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400061b54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:35.939448 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307953920}
I20260709 13:18:35.813081 17595 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:18:35.992202 17529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.017s
I20260709 13:18:35.992558 17598 rpcz_store.cc:276] 0709 13:18:34.216011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.216127 (+   116us) service_pool.cc:224] Handling call
0709 13:18:34.238450 (+ 22323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.663636 (+1425186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.951160 (+287524us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54000771d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:35.951322 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3100219264}
I20260709 13:18:35.998966 17351 catalog_manager.cc:5697] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 2 to 3, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 3 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:36.017692 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1277) took 1263 ms. Trace:
I20260709 13:18:36.018101 17595 rpcz_store.cc:276] 0709 13:18:34.754778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.812275 (+1057497us) service_pool.cc:224] Handling call
0709 13:18:35.812666 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.017444 (+204778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.017642 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:36.002786 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 72617.5us
I20260709 13:18:35.998464 17452 rpcz_store.cc:276] 0709 13:18:34.459784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.521294 (+ 61510us) service_pool.cc:224] Handling call
0709 13:18:34.521653 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.551044 (+ 29391us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:34.814128 (+263084us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.907260 (+1093132us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b180011a7c0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab570e4bc 00007f5ab2a5c48b 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab570623a
0709 13:18:35.974221 (+ 66961us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.974846 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.975044 (+   198us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:35.975094 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.975188 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.976334 (+  1146us) raft_consensus.cc:1685] finished
0709 13:18:35.976453 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.976613 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":183902,"prepare.queue_time_us":355341,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":120824,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":10463,"spinlock_wait_cycles":141793536,"thread_start_us":242550,"threads_started":2,"wal-append.queue_time_us":358078}
W20260709 13:18:36.018987 17522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.008s	sys 0.020s
I20260709 13:18:36.019312 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:36.019912 17598 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:36.002807 17446 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:36.017544 17529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.009s	sys 0.017s
I20260709 13:18:36.019881 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:35.995898 19252 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.969218 19429 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:36.011785 17602 rpcz_store.cc:269] 0709 13:18:34.607334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.607616 (+   282us) service_pool.cc:224] Handling call
0709 13:18:35.940582 (+1332966us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b5400329454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:35.940733 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269277952}
I20260709 13:18:36.018710 17351 catalog_manager.cc:5697] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 3, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 3 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
W20260709 13:18:36.019333 17522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.008s	sys 0.020s
W20260709 13:18:36.039579 17569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.023s	sys 0.056s
I20260709 13:18:36.041847 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:18:35.997681 19484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.024s	sys 0.029s
I20260709 13:18:36.054392 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:36.054127 17351 catalog_manager.cc:5697] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.050594 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:36.023233 18192 raft_consensus.cc:2889] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.055830 17351 catalog_manager.cc:5697] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 2 to 3, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 3 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:36.102339 18198 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:36.046209 17566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.011s	sys 0.024s
W20260709 13:18:36.058000 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.104996 17566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.011s	sys 0.024s
I20260709 13:18:36.058432 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:36.058677 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:36.106945 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 48326.4us
I20260709 13:18:36.107523 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:36.046746 19415 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.046067 19413 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:36.059113 17419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.017s	sys 0.022s
I20260709 13:18:36.053778 19443 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:18:36.119557 17419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.017s	sys 0.022s
I20260709 13:18:36.098896 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:36.107734 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:36.103444 17351 catalog_manager.cc:5697] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 2 to 3, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 3 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:36.120337 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:36.114440 19432 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:36.122391 19432 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:36.123023 19432 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.123602 17351 catalog_manager.cc:5697] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:36.121847 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:36.125335 19350 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.125741 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:36.126751 19350 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:36.127120 19350 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:36.127489 19350 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.127684 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:36.128458 19486 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.122779 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:36.131955 17529 raft_consensus.cc:1240] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:36.135804 19350 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:36.145841 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.059433 18962 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:18:36.163384 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.023936 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:36.151441 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:36.164588 17523 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:18:36.098336 19484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.024s	sys 0.029s
I20260709 13:18:36.118182 18935 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:18:36.054136 19430 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:36.157336 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:36.157827 17598 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:36.118167 19308 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:36.159024 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:36.161531 17599 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:18:36.125329 17351 catalog_manager.cc:5697] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 3, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 3 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:36.214916 17603 raft_consensus.cc:2410] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:36.215229 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:36.215848 17599 pending_rounds.cc:85] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 3
I20260709 13:18:36.216223 17599 pending_rounds.cc:107] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 13:18:36.216266 17598 raft_consensus.cc:2368] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6.
I20260709 13:18:36.216707 17599 raft_consensus.cc:2917] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 13:18:36.166018 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:36.217240 17599 raft_consensus.cc:2889] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.217622 17595 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:36.170797 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:36.165228 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 141626us
I20260709 13:18:36.148960 19458 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:36.159981 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:36.118234 19508 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:36.147794 19459 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.166421 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:36.241389 17596 raft_consensus.cc:2368] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:36.245147 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:36.165613 19290 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:36.174975 19411 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:36.224272 17351 catalog_manager.cc:5697] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 3 to 5, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 5 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.243605 19508 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:36.225912 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.231516 17597 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:36.271030 17597 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:36.239219 19458 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:36.154163 19342 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.218696 17602 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:36.152468 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:36.291033 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 138661us
I20260709 13:18:36.292632 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:36.294401 19308 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.223785 18962 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:36.294617 19490 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.296705 18962 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:36.262428 19290 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.167091 18193 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:36.146601 19415 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:36.047340 17569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.024s	sys 0.057s
I20260709 13:18:36.057766 19252 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:36.153043 19443 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:36.149667 19462 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:36.274354 17419 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:36.328040 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 53777us
W20260709 13:18:36.275615 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.276069 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:36.269126 17351 catalog_manager.cc:5697] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:36.281029 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:36.115072 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:36.247503 19371 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:36.268165 19432 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:36.267031 19501 consensus_queue.cc:1059] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:36.282054 19458 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:36.312510 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
W20260709 13:18:36.311136 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 961857us
W20260709 13:18:36.339856 17448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.033s	sys 0.067s
W20260709 13:18:36.340189 17448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.033s	sys 0.067s
I20260709 13:18:36.340816 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1198) took 1824 ms. Trace:
I20260709 13:18:36.309041 19290 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.332855 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:36.333338 17419 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:36.333434 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:36.247920 19459 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:36.337204 17351 catalog_manager.cc:5697] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.360075 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:36.361233 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:36.360661 17351 catalog_manager.cc:5697] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:36.350658 17451 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:36.351537 17446 raft_consensus.cc:1240] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.366878 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:36.368287 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:36.369478 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:36.371500 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:36.372710 17523 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.332597 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:36.362139 17419 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:36.375052 17452 raft_consensus.cc:2410] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:36.375914 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:36.354974 17495 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:36.341297 17448 rpcz_store.cc:276] 0709 13:18:34.516540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.605697 (+ 89157us) service_pool.cc:224] Handling call
0709 13:18:34.605999 (+   302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:34.644549 (+ 38550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.644578 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:34.653049 (+  8471us) log.cc:844] Serialized 52 byte log entry
0709 13:18:34.893836 (+240787us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:35.200841 (+307005us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.340502 (+1139661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.340582 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.340624 (+    42us) raft_consensus.cc:1685] finished
0709 13:18:36.340638 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.340749 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88753,"prepare.queue_time_us":167968,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":23117,"raft.queue_time_us":158944,"raft.run_cpu_time_us":602,"raft.run_wall_time_us":69471,"thread_start_us":1577455,"threads_started":3,"wal-append.queue_time_us":210635,"wal-append.run_cpu_time_us":3274,"wal-append.run_wall_time_us":1412092}
I20260709 13:18:36.356015 17447 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:36.266760 19457 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:18:36.335469 19496 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:36.334749 19401 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.298472 19342 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:36.389199 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:36.378712 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:36.392457 17453 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.174s	user 0.026s	sys 0.031s
I20260709 13:18:36.379690 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:36.378360 17495 leader_election.cc:400] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6.
I20260709 13:18:36.379804 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:36.453989 17453 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.026s	sys 0.039s
I20260709 13:18:36.347086 19513 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:36.454811 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1186) took 1997 ms. Trace:
I20260709 13:18:36.455242 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:36.456188 17446 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 5: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:36.456135 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:36.455190 17453 rpcz_store.cc:276] 0709 13:18:34.457785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.482522 (+ 24737us) service_pool.cc:224] Handling call
0709 13:18:34.482933 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.483629 (+   696us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:34.768255 (+284626us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.535050 (+766795us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b48003303d8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abaa8faa1 00007f5abaa86b37 00007f5abaa869ca 00007f5abab7e26f 00007f5abab7df37 00007f5abab9255c 00007f5abab92508 00007f5abab92488 00007f5abab92443 00007f5abab916ec 00007f5ab9abba96
0709 13:18:36.454458 (+919408us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.454517 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:36.454561 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.454649 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.454760 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11447,"prepare.queue_time_us":407100,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1960,"raft.queue_time_us":111978,"raft.run_cpu_time_us":2359,"raft.run_wall_time_us":217047,"spinlock_wait_cycles":9799040,"thread_start_us":1797831,"threads_started":3,"wal-append.queue_time_us":878065}
W20260709 13:18:36.457532 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 79329.5us
W20260709 13:18:36.453922 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 51900.4us
I20260709 13:18:36.462662 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:36.463418 17526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.005s	sys 0.012s
W20260709 13:18:36.463864 17526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.005s	sys 0.012s
I20260709 13:18:36.405670 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:36.392273 17528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.002s	sys 0.034s
W20260709 13:18:36.465267 17528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.002s	sys 0.034s
I20260709 13:18:36.467654 17523 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:36.463531 17448 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:36.378527 19371 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:36.393476 19496 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.474752 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:36.335702 19462 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:36.480156 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:36.484009 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:36.484872 17419 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:36.486249 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:36.390434 19467 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:36.487318 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:36.389261 19490 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:36.480682 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:36.488155 17446 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:36.463253 19341 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.004s	sys 0.013s
I20260709 13:18:36.400573 19429 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:36.458801 19358 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.388944 19486 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.470214 19413 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:36.461735 19418 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:18:36.483552 19496 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.457533 17453 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:36.516273 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.490952 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:36.539592 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.490502 19399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.408s	user 0.012s	sys 0.009s
W20260709 13:18:36.496711 19341 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.005s	sys 0.014s
I20260709 13:18:36.453856 19401 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:36.573410 17450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.004s	sys 0.033s
I20260709 13:18:36.576099 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:36.464676 19513 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:36.490204 19490 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:36.600485 17525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.045s	sys 0.074s
I20260709 13:18:36.501876 19304 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:36.578430 19414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.013s	sys 0.023s
I20260709 13:18:36.504851 19350 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:36.502887 19358 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:36.400049 19254 consensus_queue.cc:1059] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 13:18:36.690693 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:36.578696 19438 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:36.860788 17454 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.004s	sys 0.032s
W20260709 13:18:36.922756 17525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.045s	sys 0.095s
W20260709 13:18:36.922837 17454 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.006s	sys 0.032s
W20260709 13:18:36.735705 19534 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:18:36.722872 17521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.013s	sys 0.033s
W20260709 13:18:36.773284 17445 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.003s	sys 0.029s
W20260709 13:18:36.924749 17521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.014s	sys 0.044s
W20260709 13:18:36.924925 17445 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.007s	sys 0.032s
W20260709 13:18:36.881811 17449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.012s	sys 0.012s
W20260709 13:18:36.926403 17449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.012s	sys 0.013s
W20260709 13:18:36.828186 17520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.008s	sys 0.046s
I20260709 13:18:36.690374 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:36.503538 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:36.915267 17453 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:36.930301 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:36.930945 17448 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
W20260709 13:18:36.662392 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 146121us
I20260709 13:18:36.920677 17446 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:36.915067 17451 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.933488 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:36.934329 17450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.004s	sys 0.041s
W20260709 13:18:36.927417 17520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.012s	sys 0.046s
I20260709 13:18:36.936128 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 146) took 1058 ms. Trace:
I20260709 13:18:36.936627 17520 rpcz_store.cc:276] 0709 13:18:35.877391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.906050 (+ 28659us) service_pool.cc:224] Handling call
0709 13:18:35.906374 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.906574 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:36.101213 (+194639us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.935766 (+834553us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.935817 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:36.935859 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.935937 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.936067 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157576,"prepare.queue_time_us":245678,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"thread_start_us":834244,"threads_started":1}
I20260709 13:18:36.934250 17446 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
W20260709 13:18:36.870941 17594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.011s	sys 0.048s
W20260709 13:18:36.944936 17594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.012s	sys 0.048s
I20260709 13:18:36.944659 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:36.945746 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:36.931869 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:36.951231 17448 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.597748 19508 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:36.835922 19308 consensus_meta.cc:287] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.000s
I20260709 13:18:36.956645 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:36.972446 17453 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.968241 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47864 (request call id 112) took 1128 ms. Trace:
I20260709 13:18:36.597119 19538 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.974089 17447 rpcz_store.cc:276] 0709 13:18:35.839726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.952287 (+112561us) service_pool.cc:224] Handling call
0709 13:18:36.967964 (+1015677us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54003cd7d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:36.968169 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":815932672}
I20260709 13:18:36.975428 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 110) took 1148 ms. Trace:
W20260709 13:18:36.926915 19399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.845s	user 0.017s	sys 0.014s
I20260709 13:18:36.603900 19411 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:36.915073 19414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.016s	sys 0.028s
I20260709 13:18:36.985217 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:36.987879 17527 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
W20260709 13:18:36.943023 19419 consensus_meta.cc:287] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.935s	user 0.011s	sys 0.000s
I20260709 13:18:36.577823 19486 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:36.849002 19489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.020s	sys 0.035s
W20260709 13:18:36.735049 19537 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.395s	user 0.000s	sys 0.001s
I20260709 13:18:36.739153 19459 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:36.995011 17600 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.023s	sys 0.031s
W20260709 13:18:36.720371 19530 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:18:36.738452 19415 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:36.646489 19420 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:36.935520 19490 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:36.646128 19467 raft_consensus.cc:697] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:36.646059 19526 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:36.686468 19371 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:36.738776 19252 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:37.005072 17600 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.023s	sys 0.031s
I20260709 13:18:37.006992 17448 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:37.009205 17447 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:36.984843 19438 raft_consensus.cc:697] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:18:37.000531 19489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.024s	sys 0.035s
I20260709 13:18:36.993705 19308 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:37.056969 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:37.058298 17523 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:37.046427 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:37.060153 17451 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
W20260709 13:18:37.060838 17597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.008s	sys 0.015s
W20260709 13:18:37.094244 17597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.008s	sys 0.016s
I20260709 13:18:37.068404 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:37.095352 17448 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.015226 19432 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:37.099243 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.105980 17453 raft_consensus.cc:2410] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:18:37.061314 18888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.002s	sys 0.034s
I20260709 13:18:37.006284 19304 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:18:36.992626 19538 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:37.005400 19411 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:37.066702 19342 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:37.118872 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:37.059734 19415 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:37.117213 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:37.061147 19484 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.008s	sys 0.027s
W20260709 13:18:37.111933 18888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.002s	sys 0.034s
I20260709 13:18:37.133100 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:37.135064 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:37.120501 19462 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:37.136876 17453 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.139640 17520 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:37.145653 17448 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:37.104117 19526 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:37.134989 19484 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.008s	sys 0.028s
I20260709 13:18:37.153257 17529 raft_consensus.cc:1240] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:37.164637 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:37.165310 17492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.025s	sys 0.008s
W20260709 13:18:37.168362 17492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.026s	sys 0.008s
W20260709 13:18:37.171500 17601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.007s	sys 0.007s
W20260709 13:18:37.174901 17601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.008s	sys 0.008s
I20260709 13:18:37.131352 19415 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:37.173565 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:37.172295 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:37.179160 17569 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.007s	sys 0.017s
I20260709 13:18:37.185101 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:37.185141 17569 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.008s	sys 0.017s
W20260709 13:18:37.187330 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 584450us
I20260709 13:18:37.187649 17448 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.191838 17598 raft_consensus.cc:1240] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:37.192291 17603 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:37.193138 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.194394 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:37.194679 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.196487 17599 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:37.197013 19413 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:37.194010 17598 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:37.197822 19413 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:37.200418 19547 log.cc:927] Time spent T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:18:37.201424 19548 log.cc:927] Time spent T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:18:37.202777 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.203950 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.204512 17453 raft_consensus.cc:2410] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:37.205180 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.205890 17598 raft_consensus.cc:2393] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:37.206637 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.207335 17598 raft_consensus.cc:2393] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:37.207384 19513 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:37.208232 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.208825 17598 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:37.209928 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:37.210126 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.210656 17598 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:37.211190 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.212134 17597 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:37.214423 17603 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:37.214757 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:37.215715 17520 raft_consensus.cc:2393] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 6: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:37.219596 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.211349 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.221839 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.138986 19467 consensus_queue.cc:237] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:37.227881 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.228966 17597 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:37.221169 19541 log.cc:927] Time spent T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:18:37.189348 19489 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.246701 19489 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:37.247387 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 142) took 1385 ms. Trace:
I20260709 13:18:37.213765 19358 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:37.187444 18888 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:37.154750 19438 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:37.204514 19401 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:37.154656 19371 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:37.241158 19296 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:37.241914 19415 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:37.245379 19496 consensus_meta.cc:287] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.646s	user 0.009s	sys 0.000s
W20260709 13:18:37.254470 17527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1537) took 1202 ms (client timeout 1533 ms). Trace:
W20260709 13:18:37.700196 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.752362 17453 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:37.655702 18166 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:37.630673 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 156) took 1801 ms. Trace:
W20260709 13:18:37.334600 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:37.534109 17495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.000s	sys 0.054s
I20260709 13:18:37.250988 17602 raft_consensus.cc:2410] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:37.528736 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 1210) took 1180 ms. Trace:
I20260709 13:18:37.253070 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1206) took 1473 ms. Trace:
W20260709 13:18:37.450700 17351 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.010s	sys 0.028s
W20260709 13:18:37.762253 17351 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.294s	user 0.010s	sys 0.040s
I20260709 13:18:37.249516 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:37.624776 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1534) took 1573 ms. Trace:
I20260709 13:18:37.779839 17529 rpcz_store.cc:276] 0709 13:18:36.051658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.132955 (+ 81297us) service_pool.cc:224] Handling call
0709 13:18:36.133204 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.157627 (+1024423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.624407 (+466780us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400170a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:37.624688 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2345405696}
I20260709 13:18:37.612874 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:37.422241 17448 raft_consensus.cc:2410] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:18:37.763785 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.537845 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 160) took 1520 ms. Trace:
I20260709 13:18:37.783885 17600 rpcz_store.cc:276] 0709 13:18:36.017414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.020486 (+  3072us) service_pool.cc:224] Handling call
0709 13:18:36.020729 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.020939 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:37.042312 (+1021373us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.537325 (+495013us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:37.537394 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:37.537456 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.537585 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.537763 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1127360,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":137,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":19043,"thread_start_us":1509739,"threads_started":2}
I20260709 13:18:37.790977 19416 consensus_queue.cc:1059] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:37.792100 19416 consensus_queue.cc:1243] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:37.792641 19416 raft_consensus.cc:3055] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:37.793030 19416 raft_consensus.cc:740] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:37.794466 19416 consensus_queue.cc:260] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:37.535255 17567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.008s	sys 0.023s
W20260709 13:18:37.796260 17567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.012s	sys 0.033s
I20260709 13:18:36.976191 17449 rpcz_store.cc:276] 0709 13:18:35.827454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.009666 (+182212us) service_pool.cc:224] Handling call
0709 13:18:36.009945 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.010173 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:36.010441 (+   268us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.945304 (+934863us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.971375 (+ 26071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.971457 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:36.971520 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.974890 (+  3370us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.975151 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48294,"prepare.queue_time_us":1327,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":4941,"raft.queue_time_us":78,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":21328,"thread_start_us":916103,"threads_started":1}
I20260709 13:18:37.796666 19416 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.760075 17523 rpcz_store.cc:276] 0709 13:18:36.348608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.474241 (+125633us) service_pool.cc:224] Handling call
0709 13:18:37.528422 (+1054181us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54001def54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:37.528648 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271705344}
W20260709 13:18:37.758142 17495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.289s	user 0.008s	sys 0.055s
W20260709 13:18:37.797758 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 1.33907e+06us
I20260709 13:18:37.798565 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:37.798858 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:37.800216 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:37.800773 19561 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:37.321621 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 109) took 1494 ms. Trace:
I20260709 13:18:37.770510 17598 raft_consensus.cc:1240] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:37.802685 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:37.803778 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:37.804881 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:37.801906 19561 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:18:37.806828 19561 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:37.802429 17445 rpcz_store.cc:276] 0709 13:18:35.827056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.005186 (+178130us) service_pool.cc:224] Handling call
0709 13:18:36.039968 (+ 34782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.040232 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:36.925467 (+885235us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.321137 (+395670us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:37.321224 (+    87us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:37.321291 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.321393 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.321553 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":117346,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":6152,"raft.queue_time_us":35526,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":4554,"thread_start_us":1175304,"threads_started":2}
I20260709 13:18:37.807322 19561 raft_consensus.cc:697] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:37.807740 19451 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:37.808241 19561 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:37.255934 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:37.767410 17527 rpcz_store.cc:269] 0709 13:18:36.052468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.055405 (+  2937us) service_pool.cc:224] Handling call
0709 13:18:37.254254 (+1198849us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b54000ffd54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:37.254400 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2027848960}
I20260709 13:18:37.188609 19486 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:37.809751 17520 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:37.810310 19486 consensus_queue.cc:1059] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:37.811404 19486 consensus_queue.cc:1059] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:37.760470 17450 rpcz_store.cc:276] 0709 13:18:35.779963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.780460 (+   497us) service_pool.cc:224] Handling call
0709 13:18:35.780760 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:35.981920 (+201160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.981964 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:35.982728 (+   764us) log.cc:844] Serialized 52 byte log entry
0709 13:18:36.935002 (+952274us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:36.935063 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.935162 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.252830 (+317668us) raft_consensus.cc:1685] finished
0709 13:18:37.252854 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.253009 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200679,"raft.queue_time_us":201599,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":118,"thread_start_us":951804,"threads_started":1,"wal-append.queue_time_us":1266996}
I20260709 13:18:37.812561 19486 consensus_queue.cc:1059] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:37.813073 17568 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:37.248523 19532 log.cc:927] Time spent T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.110s	user 0.001s	sys 0.001s
I20260709 13:18:37.785719 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.814857 17600 raft_consensus.cc:2393] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:37.815444 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1196) took 2581 ms. Trace:
I20260709 13:18:37.815821 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.815939 17528 rpcz_store.cc:276] 0709 13:18:35.234005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.376707 (+142702us) service_pool.cc:224] Handling call
0709 13:18:35.391563 (+ 14856us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:35.395807 (+  4244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.395856 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:35.396412 (+   556us) log.cc:844] Serialized 52 byte log entry
0709 13:18:36.465872 (+1069460us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:36.465928 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.466016 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.815142 (+1349126us) raft_consensus.cc:1685] finished
0709 13:18:37.815170 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.815340 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4440,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":29021,"thread_start_us":1024108,"threads_started":1,"wal-append.queue_time_us":1663936}
I20260709 13:18:37.817353 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:37.257922 19430 consensus_meta.cc:287] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.025s	user 0.005s	sys 0.004s
I20260709 13:18:37.808429 19451 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:37.811504 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:37.250490 19543 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:18:37.250075 19540 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:18:37.249531 19549 log.cc:927] Time spent T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:18:37.450500 19290 consensus_meta.cc:287] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 1.070s	user 0.004s	sys 0.009s
W20260709 13:18:37.237479 19555 log.cc:927] Time spent T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:18:37.743542 19413 consensus_meta.cc:287] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.005s
I20260709 13:18:37.855392 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1202) took 1582 ms. Trace:
I20260709 13:18:37.855967 17520 rpcz_store.cc:276] 0709 13:18:36.272569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.833470 (+1560901us) service_pool.cc:224] Handling call
0709 13:18:37.854719 (+ 21249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.854958 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.854994 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:37.855048 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:37.855091 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.855162 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.855319 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:37.818228 17528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:37.857304 17528 raft_consensus.cc:606] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:37.801050 17523 raft_consensus.cc:2410] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:18:37.739701 19560 log.cc:927] Time spent T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:18:37.782130 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:37.862483 18201 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:37.862702 17529 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:37.363966 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1200) took 2021 ms. Trace:
I20260709 13:18:37.820389 17600 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
W20260709 13:18:37.450564 17521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.031s
I20260709 13:18:37.820794 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:37.865504 17521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.002s	sys 0.034s
I20260709 13:18:37.865823 17599 raft_consensus.cc:2393] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:37.821079 17527 raft_consensus.cc:1240] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:37.866233 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1185) took 2635 ms. Trace:
I20260709 13:18:37.866581 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1201) took 1594 ms. Trace:
I20260709 13:18:37.824438 19415 raft_consensus.cc:3055] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:37.822945 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:37.271100 19490 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:37.755590 17601 rpcz_store.cc:276] 0709 13:18:35.829722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.888047 (+ 58325us) service_pool.cc:224] Handling call
0709 13:18:35.888397 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.990179 (+101782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.990221 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.996266 (+  6045us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.508014 (+511748us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:37.179187 (+671173us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.179430 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.179509 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.628010 (+448501us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b18000929e0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:37.630355 (+  2345us) raft_consensus.cc:1685] finished
0709 13:18:37.630466 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.630610 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96775,"prepare.queue_time_us":660215,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":106171,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":10778,"spinlock_wait_cycles":14051200,"thread_start_us":1077014,"threads_started":2,"wal-append.queue_time_us":1159393}
I20260709 13:18:37.872409 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:37.611581 19557 log.cc:927] Time spent T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.551s	user 0.003s	sys 0.000s
W20260709 13:18:37.544296 19341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.019s
I20260709 13:18:37.825312 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.875447 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:37.875681 17596 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:37.843039 19358 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:37.829916 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:37.876919 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.831013 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:37.831147 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.831193 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:37.268961 19514 raft_consensus.cc:3055] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:37.614745 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:37.366657 19428 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.232914 19508 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:37.774240 19458 consensus_meta.cc:287] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.412s	user 0.009s	sys 0.023s
I20260709 13:18:37.254999 19411 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:37.271247 19526 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:37.757941 19495 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:37.777091 18935 raft_consensus.cc:3055] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:37.265615 19538 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:37.859651 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:37.861034 19413 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:37.805526 17598 raft_consensus.cc:2393] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:37.910146 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.911098 17598 raft_consensus.cc:2393] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:37.843390 19430 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.827672 19486 raft_consensus.cc:3055] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:37.825744 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.877704 17596 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:37.765456 19496 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:37.865895 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.915800 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.884438 19514 raft_consensus.cc:740] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:37.920192 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.877534 18198 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:37.778451 18888 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:37.877596 19341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.009s	sys 0.026s
I20260709 13:18:37.899292 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:37.912320 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 157) took 2082 ms. Trace:
I20260709 13:18:37.932439 17594 rpcz_store.cc:276] 0709 13:18:35.830127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.922436 (+ 92309us) service_pool.cc:224] Handling call
0709 13:18:35.945526 (+ 23090us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.010431 (+ 64905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.010463 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.010900 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.945452 (+934552us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:36.945504 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.945585 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.912040 (+966455us) raft_consensus.cc:1685] finished
0709 13:18:37.912069 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.912244 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57402,"raft.queue_time_us":57632,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":11117,"thread_start_us":844444,"threads_started":1,"wal-append.queue_time_us":1085937}
I20260709 13:18:37.934721 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.935813 17594 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:37.913697 18193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42548 (request call id 258) took 1522 ms (client timeout 1610 ms). Trace:
I20260709 13:18:37.869041 19415 raft_consensus.cc:740] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:37.916533 17596 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:37.944303 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.945168 17596 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:37.885185 17602 raft_consensus.cc:2393] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:37.858544 19290 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:37.887148 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.914685 19486 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:37.924026 17595 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:37.895700 19443 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:37.929230 19430 consensus_queue.cc:1059] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:37.896325 19489 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:37.916496 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.955577 17600 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:37.956727 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:37.957455 17600 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:37.963922 19310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.035s	sys 0.046s
W20260709 13:18:37.964395 19310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.035s	sys 0.046s
I20260709 13:18:37.965857 19580 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:37.968803 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.939177 19413 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:37.904516 19508 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:37.904824 18935 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:37.901459 19458 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:37.907346 19411 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.889267 19358 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:37.949618 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:37.974710 18200 raft_consensus.cc:2368] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6.
I20260709 13:18:37.900774 19428 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:37.950277 18192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.034s	sys 0.059s
I20260709 13:18:37.908291 19495 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:37.942806 18193 rpcz_store.cc:269] 0709 13:18:36.391363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.401782 (+ 10419us) service_pool.cc:224] Handling call
0709 13:18:37.614531 (+1212749us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5800003c98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:37.913621 (+299090us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31727872}
W20260709 13:18:37.979545 18192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.035s	sys 0.059s
I20260709 13:18:37.971016 19430 consensus_queue.cc:1243] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:37.991606 19428 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:37.991065 19570 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:37.992677 19490 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:37.992897 19563 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:37.993366 19490 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:37.993856 19490 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:37.981689 19413 consensus_queue.cc:1059] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:18:37.975630 19411 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:37.994509 19576 raft_consensus.cc:3055] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:37.971187 19514 consensus_queue.cc:260] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:37.994310 19490 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.989364 19568 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 13:18:38.020944 19573 log.cc:927] Time spent T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:18:38.022835 19508 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:38.004256 19564 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:38.023862 19564 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:38.026895 19496 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:38.004427 19576 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:38.028725 19576 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.031886 19495 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:37.993997 19563 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.034789 19563 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:38.037389 19514 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.042459 19576 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.025003 19564 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.046798 19564 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:37.886204 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.080775 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.867142 17527 rpcz_store.cc:276] 0709 13:18:36.272300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.820101 (+1547801us) service_pool.cc:224] Handling call
0709 13:18:37.820876 (+   775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.866328 (+ 45452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.866522 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:38.092296 17524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.585s	user 0.019s	sys 0.055s
W20260709 13:18:38.092836 17524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.586s	user 0.019s	sys 0.055s
W20260709 13:18:38.091193 17454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.167s	user 0.023s	sys 0.034s
W20260709 13:18:38.094272 17454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.024s	sys 0.034s
I20260709 13:18:38.093849 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.095646 17527 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:38.096473 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.097712 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 147) took 2199 ms. Trace:
I20260709 13:18:38.098078 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:37.888150 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60446 (request call id 3) took 1522 ms. Trace:
I20260709 13:18:38.099086 17450 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:18:38.099546 17528 rpcz_store.cc:276] 0709 13:18:36.356470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.818043 (+1461573us) service_pool.cc:224] Handling call
0709 13:18:37.878399 (+ 60356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:37.887974 17522 raft_consensus.cc:1240] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:38.103350 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1203) took 1830 ms. Trace:
I20260709 13:18:38.098999 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1204) took 1826 ms. Trace:
I20260709 13:18:38.103922 17522 rpcz_store.cc:276] 0709 13:18:36.272784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.887454 (+1614670us) service_pool.cc:224] Handling call
0709 13:18:37.887734 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.102589 (+214855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.103077 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.104514 17527 rpcz_store.cc:276] 0709 13:18:36.272992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.097154 (+1824162us) service_pool.cc:224] Handling call
0709 13:18:38.097778 (+   624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.098555 (+   777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.098577 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.098669 (+    92us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:38.098721 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.098799 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.098919 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:37.863370 17525 rpcz_store.cc:276] 0709 13:18:35.342744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.382458 (+ 39714us) service_pool.cc:224] Handling call
0709 13:18:35.386936 (+  4478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.387102 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:35.966634 (+579532us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b180034b640. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab570e4bc 00007f5ab2a5c48b 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a76455 00007f5ab955e3c7 00007f5ab5b709a7 00007f5ab5b800bf
0709 13:18:35.966780 (+   146us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.253469 (+1286689us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b480021c258. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abaa8faa1 00007f5abaa86b37 00007f5abaa869ca 00007f5abab7e26f 00007f5abab7df37 00007f5abab9255c 00007f5abab92508 00007f5abab92488 00007f5abab92443 00007f5abab916ec 00007f5ab9abba96
0709 13:18:37.362471 (+109002us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:37.362582 (+   111us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:37.362650 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.362775 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.363870 (+  1095us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":228108,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2875,"raft.queue_time_us":137589,"raft.run_cpu_time_us":2051,"raft.run_wall_time_us":185970,"spinlock_wait_cycles":116753152,"thread_start_us":1596258,"threads_started":3,"wal-append.queue_time_us":1229950}
I20260709 13:18:38.107191 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1548) took 1754 ms. Trace:
W20260709 13:18:37.869648 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 46772.9us
I20260709 13:18:38.108079 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1549) took 1745 ms. Trace:
I20260709 13:18:38.108669 17525 rpcz_store.cc:276] 0709 13:18:36.362998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.106647 (+1743649us) service_pool.cc:224] Handling call
0709 13:18:38.107151 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.107616 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.107647 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.107722 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:38.107773 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.107842 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.107941 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:37.951762 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:38.110008 17495 leader_election.cc:400] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6.
I20260709 13:18:38.110530 17495 leader_election.cc:403] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:18:38.111104 17594 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:37.866730 17521 rpcz_store.cc:276] 0709 13:18:35.230944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.234431 (+  3487us) service_pool.cc:224] Handling call
0709 13:18:35.298758 (+ 64327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.299351 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:36.016688 (+717337us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.865841 (+1849153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:37.865891 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:37.865930 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.865990 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.866162 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16852,"prepare.queue_time_us":299419,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":24,"raft.queue_time_us":136273,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":19849,"thread_start_us":2520155,"threads_started":3,"wal-append.queue_time_us":1181620}
I20260709 13:18:38.113265 17521 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:37.247884 17526 rpcz_store.cc:276] 0709 13:18:35.862241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.863725 (+  1484us) service_pool.cc:224] Handling call
0709 13:18:35.864055 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.864366 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.864392 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.864905 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.464452 (+599547us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:36.464504 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.464630 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.247092 (+782462us) raft_consensus.cc:1685] finished
0709 13:18:37.247122 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.247312 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24123,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":260,"thread_start_us":558630,"threads_started":1,"wal-append.queue_time_us":1119771}
I20260709 13:18:38.116505 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1214) took 1715 ms. Trace:
I20260709 13:18:38.117022 17526 rpcz_store.cc:276] 0709 13:18:36.401422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.114714 (+1713292us) service_pool.cc:224] Handling call
0709 13:18:38.115347 (+   633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.115884 (+   537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.115919 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.116010 (+    91us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:38.116090 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.116164 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.116310 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.113879 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1550) took 1736 ms. Trace:
I20260709 13:18:38.119015 17521 rpcz_store.cc:276] 0709 13:18:36.377877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.112317 (+1734440us) service_pool.cc:224] Handling call
0709 13:18:38.112822 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.113646 (+   824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.113823 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:37.951891 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.949457 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:38.121147 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.917889 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:38.121815 17596 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:38.122253 17594 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:38.122777 17598 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:38.123255 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:38.123837 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:38.124429 17596 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:38.125185 17598 raft_consensus.cc:2410] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:37.974997 17602 raft_consensus.cc:2410] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:18:38.126355 17603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.039s	sys 0.030s
W20260709 13:18:38.126928 17603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.039s	sys 0.030s
I20260709 13:18:37.953097 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:38.121369 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:38.132762 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.125746 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:38.138863 17596 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:38.143666 17528 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:38.144745 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1206) took 1841 ms. Trace:
I20260709 13:18:38.145262 17528 rpcz_store.cc:276] 0709 13:18:36.303274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.101459 (+1798185us) service_pool.cc:224] Handling call
0709 13:18:38.143301 (+ 41842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.144389 (+  1088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.144636 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.098929 17520 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:38.151189 17599 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:38.123490 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:37.982539 18195 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:37.995147 18935 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:38.155560 18935 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.155841 18888 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:38.156046 19290 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:38.156634 17594 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:38.139381 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1215) took 1676 ms. Trace:
I20260709 13:18:38.163419 17525 rpcz_store.cc:276] 0709 13:18:36.462849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.134199 (+1671350us) service_pool.cc:224] Handling call
0709 13:18:38.134688 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.138801 (+  4113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.138849 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.138921 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:38.139000 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.139096 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.139272 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.147482 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.107699 17527 rpcz_store.cc:276] 0709 13:18:36.353041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.105790 (+1752749us) service_pool.cc:224] Handling call
0709 13:18:38.106398 (+   608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.106832 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.106857 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.106912 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:38.106946 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.107014 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.107136 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.160741 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1205) took 1880 ms. Trace:
I20260709 13:18:38.218078 17520 rpcz_store.cc:276] 0709 13:18:36.280099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.098045 (+1817946us) service_pool.cc:224] Handling call
0709 13:18:38.098554 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.148438 (+ 49884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.160659 (+ 12221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.221536 17528 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:38.222378 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1553) took 1038 ms. Trace:
I20260709 13:18:38.232401 17520 rpcz_store.cc:276] 0709 13:18:37.183492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.220792 (+1037300us) service_pool.cc:224] Handling call
0709 13:18:38.221439 (+   647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.221887 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.221927 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.222000 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:38.222098 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.222172 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.222311 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:37.984355 19486 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.225679 19296 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.227164 19473 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:38.226305 19489 consensus_queue.cc:1059] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:37.982642 19415 consensus_queue.cc:260] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.224555 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:38.150664 17569 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.239006 17602 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:38.257727 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1208) took 1928 ms. Trace:
I20260709 13:18:38.263788 19572 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:38.278337 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1209) took 2497 ms. Trace:
I20260709 13:18:38.278915 17454 rpcz_store.cc:276] 0709 13:18:35.780711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.004947 (+224236us) service_pool.cc:224] Handling call
0709 13:18:36.005263 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.053508 (+ 48245us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:36.923568 (+870060us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.095168 (+1171600us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.096632 (+  1464us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.096969 (+   337us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:38.097016 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.099153 (+  2137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.277896 (+178743us) raft_consensus.cc:1685] finished
0709 13:18:38.277926 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.278203 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125979,"prepare.queue_time_us":170126,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":177095,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":5423,"thread_start_us":1942228,"threads_started":2,"wal-append.queue_time_us":1033702}
I20260709 13:18:38.285095 19411 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:38.290777 17598 raft_consensus.cc:2410] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:18:38.293061 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.293952 19430 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:38.291879 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.294727 19430 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.297322 19430 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:38.298566 17527 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:38.299173 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1216) took 1827 ms. Trace:
I20260709 13:18:38.299525 17527 rpcz_store.cc:276] 0709 13:18:36.471758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.233565 (+1761807us) service_pool.cc:224] Handling call
0709 13:18:38.298125 (+ 64560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.298938 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.299102 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.302335 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1061) took 1047 ms. Trace:
I20260709 13:18:38.259439 17522 rpcz_store.cc:276] 0709 13:18:36.329417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.105168 (+1775751us) service_pool.cc:224] Handling call
0709 13:18:38.105761 (+   593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.257233 (+151472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.257279 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.257348 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:38.257404 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.257493 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.257647 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.302850 17602 rpcz_store.cc:276] 0709 13:18:37.208920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.129451 (+920531us) service_pool.cc:224] Handling call
0709 13:18:38.217105 (+ 87654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.256088 (+ 38983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.256412 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.240181 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:38.315409 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.327546 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 355563us
I20260709 13:18:38.004508 19451 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:38.098337 17524 rpcz_store.cc:276] 0709 13:18:35.898654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.899825 (+  1171us) service_pool.cc:224] Handling call
0709 13:18:35.900155 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.900380 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:36.057433 (+157053us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.093501 (+2036068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.093671 (+   170us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:38.093839 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.094007 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.097588 (+  3581us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118909,"prepare.queue_time_us":251806,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":499295,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13205,"thread_start_us":2035270,"threads_started":2,"wal-append.queue_time_us":1051552}
I20260709 13:18:38.347177 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.012727 19458 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:38.351099 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 241564us
I20260709 13:18:38.360567 19296 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:38.362118 19358 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:38.367046 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 166) took 1111 ms. Trace:
I20260709 13:18:38.368040 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.369072 17527 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:38.374593 19570 raft_consensus.cc:3055] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:38.375272 19570 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:38.376744 19570 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.377409 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:38.378371 17526 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:38.378471 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 228058us
I20260709 13:18:38.379602 17569 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.386677 19569 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6.
I20260709 13:18:38.381779 19458 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.387697 18200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42548 (request call id 260) took 1910 ms (client timeout 1532 ms). Trace:
W20260709 13:18:38.388172 18200 rpcz_store.cc:269] 0709 13:18:36.477449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.480444 (+  2995us) service_pool.cc:224] Handling call
0709 13:18:38.387225 (+1906781us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54006cf054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:38.387471 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3411347200}
I20260709 13:18:38.388232 19458 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.388761 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.390434 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:38.391945 19473 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:38.392225 17568 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:38.392477 19473 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.393247 18192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42538 (request call id 243) took 2058 ms. Trace:
I20260709 13:18:38.394259 17522 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:38.394564 19572 raft_consensus.cc:3055] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:38.395176 19572 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:38.393792 18192 rpcz_store.cc:276] 0709 13:18:36.334917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.339780 (+  4863us) service_pool.cc:224] Handling call
0709 13:18:36.485984 (+146204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.846138 (+360154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.856996 (+ 10858us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.993489 (+136493us) log.cc:844] Serialized 26 byte log entry
0709 13:18:37.200075 (+206586us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab2a5c0ac 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b
0709 13:18:38.135655 (+935580us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:38.135842 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.136040 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.392685 (+256645us) raft_consensus.cc:1685] finished
0709 13:18:38.392707 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.393002 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":217031,"raft.queue_time_us":320428,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":27434,"spinlock_wait_cycles":3768064,"thread_start_us":872424,"threads_started":1,"wal-append.queue_time_us":1279581}
I20260709 13:18:38.396334 19572 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:38.361891 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.402603 17452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1531) took 1486 ms (client timeout 1518 ms). Trace:
W20260709 13:18:38.403173 17452 rpcz_store.cc:269] 0709 13:18:36.916078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.944360 (+ 28282us) service_pool.cc:224] Handling call
0709 13:18:38.402204 (+1457844us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54000d89d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:38.402375 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3249605888}
I20260709 13:18:38.367666 17595 rpcz_store.cc:276] 0709 13:18:37.255875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.365509 (+1109634us) service_pool.cc:224] Handling call
0709 13:18:38.366017 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.366449 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.366480 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.366535 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:38.366579 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.366650 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.366798 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.406502 19526 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:38.407087 19526 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.407769 19526 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.408448 17525 raft_consensus.cc:1240] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:38.410594 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1060) took 1202 ms. Trace:
I20260709 13:18:38.411907 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.411051 17603 rpcz_store.cc:276] 0709 13:18:37.208442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.129259 (+920817us) service_pool.cc:224] Handling call
0709 13:18:38.129888 (+   629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.134734 (+  4846us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:38.136742 (+  2008us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.410161 (+273419us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.410237 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:38.410272 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.410372 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.410510 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61919,"prepare.queue_time_us":84805,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":63479,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"thread_start_us":204745,"threads_started":1,"wal-append.queue_time_us":273769}
I20260709 13:18:38.412894 19508 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:38.415908 19411 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.416740 19411 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:38.380147 19296 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:38.423712 19486 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.425047 19310 raft_consensus.cc:3055] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:38.425653 19310 raft_consensus.cc:740] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:38.426460 19458 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:38.428367 19415 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:38.430279 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.431352 18166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.014s	sys 0.022s
W20260709 13:18:38.431828 18166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.014s	sys 0.022s
I20260709 13:18:38.407032 17568 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:38.432761 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:38.439152 17495 leader_election.cc:400] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:38.444802 17454 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:38.435438 19572 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.427352 19310 consensus_queue.cc:260] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.454372 19570 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:38.458685 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 51828.1us
W20260709 13:18:38.463452 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 105667us
W20260709 13:18:38.455873 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 800211us
I20260709 13:18:38.467474 19310 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.467365 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:38.472527 17569 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.473856 19508 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.474273 19594 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.495214 19594 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:38.504829 17566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.014s
W20260709 13:18:38.506760 17597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.002s	sys 0.020s
W20260709 13:18:38.512270 17566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.001s	sys 0.015s
W20260709 13:18:38.514154 17420 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.009s	sys 0.030s
I20260709 13:18:38.500890 19594 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:38.522739 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.523465 17420 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.010s	sys 0.030s
I20260709 13:18:38.522739 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:38.524303 17603 raft_consensus.cc:2410] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:18:38.528178 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.494216 19358 consensus_queue.cc:1059] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:18:38.529603 19438 raft_consensus.cc:3055] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:38.529989 19438 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:38.531177 19438 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.532501 19438 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.534252 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:38.535172 19576 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:38.538039 19496 consensus_queue.cc:1059] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:38.538924 19416 consensus_meta.cc:287] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.741s	user 0.005s	sys 0.015s
I20260709 13:18:38.539572 19416 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.540128 19416 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.540369 19496 consensus_queue.cc:1059] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:38.541666 19438 raft_consensus.cc:3055] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:38.542057 19438 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:38.543551 19411 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.544294 19411 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.544410 19438 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.545871 19438 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.546664 18935 raft_consensus.cc:3055] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:38.547107 18935 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:38.548123 18935 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:38.549072 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 703236us
I20260709 13:18:38.551194 17600 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:38.553092 17526 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:38.460450 17525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:38.557893 17525 raft_consensus.cc:606] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:18:38.560925 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 88790.2us
I20260709 13:18:38.558423 17525 raft_consensus.cc:614] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:38.563108 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:38.569293 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 54132.5us
I20260709 13:18:38.567878 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1221) took 1177 ms. Trace:
I20260709 13:18:38.575812 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:38.577853 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1057) took 1371 ms. Trace:
W20260709 13:18:38.579419 19597 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:18:38.578358 17597 rpcz_store.cc:276] 0709 13:18:37.206810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.229507 (+ 22697us) service_pool.cc:224] Handling call
0709 13:18:37.828123 (+598616us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b58001a1398. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab3ffc0 00007f5abab2a929 00007f5abab2a3d2 00007f5ab40a1bd4
0709 13:18:37.828363 (+   240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.828812 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.828851 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:37.844925 (+ 16074us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.565573 (+720648us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:38.571269 (+  5696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.575603 (+  4334us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.575653 (+    50us) raft_consensus.cc:1685] finished
0709 13:18:38.575665 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.577773 (+  2108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75458,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8653,"spinlock_wait_cycles":46785792,"thread_start_us":626963,"threads_started":1,"wal-append.queue_time_us":535103}
I20260709 13:18:38.583475 19568 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:38.586870 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1065) took 1324 ms. Trace:
W20260709 13:18:38.588515 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.572585 17529 rpcz_store.cc:276] 0709 13:18:37.382794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.297679 (+914885us) service_pool.cc:224] Handling call
0709 13:18:38.298061 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.300492 (+  2431us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:38.354314 (+ 53822us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.559557 (+205243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.559618 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:38.559659 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.559730 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.559856 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":111743,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":40363,"thread_start_us":116639,"threads_started":2}
I20260709 13:18:38.609879 17602 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.582793 19576 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:38.618317 17525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:38.626396 17525 raft_consensus.cc:606] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:38.626935 17525 raft_consensus.cc:614] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:38.619182 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:38.623617 19490 consensus_meta.cc:287] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.590s	user 0.005s	sys 0.010s
I20260709 13:18:38.587356 17596 rpcz_store.cc:276] 0709 13:18:37.262573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.148415 (+885842us) service_pool.cc:224] Handling call
0709 13:18:38.157876 (+  9461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.158233 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:38.350327 (+192094us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.581040 (+230713us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.581138 (+    98us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:38.586681 (+  5543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.586731 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.586821 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104308,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":47,"raft.queue_time_us":5479,"thread_start_us":321113,"threads_started":2}
I20260709 13:18:38.632965 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.633384 17569 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.634608 19580 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:38.635079 17569 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.635378 19580 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:38.635535 19526 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.636662 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:38.603320 19416 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:38.638463 19451 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:38.637818 17569 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.643209 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:38.638734 19416 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.631930 19576 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:38.658654 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 115288us
W20260709 13:18:38.659511 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 123076us
I20260709 13:18:38.659669 19581 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:38.660835 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:38.660619 19581 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:38.664382 17602 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:18:38.665206 17454 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.662531 19428 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:38.641347 19451 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:38.656549 19576 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.644474 19490 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.677762 19538 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:38.681113 19526 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:38.682112 17601 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
W20260709 13:18:38.708585 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 47911.8us
W20260709 13:18:38.682451 17420 leader_election.cc:336] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.523s (SENT)
I20260709 13:18:38.682927 19341 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.683550 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 95545.3us
I20260709 13:18:38.684070 19514 raft_consensus.cc:2764] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:18:38.688095 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 50362.7us
I20260709 13:18:38.690523 19580 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:38.690964 19564 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.725682 19564 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:38.726337 19564 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.728466 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:38.729128 17527 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.697170 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1218) took 1315 ms. Trace:
I20260709 13:18:38.730185 17520 rpcz_store.cc:276] 0709 13:18:37.381776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.256837 (+875061us) service_pool.cc:224] Handling call
0709 13:18:38.359489 (+102652us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:38.382627 (+ 23138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.382673 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:38.412889 (+ 30216us) log.cc:844] Serialized 52 byte log entry
0709 13:18:38.522409 (+109520us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:38.574200 (+ 51791us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.585397 (+ 11197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.585483 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.696902 (+111419us) raft_consensus.cc:1685] finished
0709 13:18:38.696926 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.697112 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46157,"prepare.queue_time_us":53119,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":11847,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":257,"spinlock_wait_cycles":447232,"thread_start_us":108942,"threads_started":1,"wal-append.queue_time_us":191127}
I20260709 13:18:38.698469 19610 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.732712 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1069) took 1469 ms. Trace:
I20260709 13:18:38.732607 19610 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.733191 17599 rpcz_store.cc:276] 0709 13:18:37.263697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.153852 (+890155us) service_pool.cc:224] Handling call
0709 13:18:38.237066 (+ 83214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.238648 (+  1582us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:38.493393 (+254745us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.708660 (+215267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.708710 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:38.718508 (+  9798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.718607 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.732647 (+ 14040us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24293,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":39,"raft.queue_time_us":83,"thread_start_us":441265,"threads_started":2}
I20260709 13:18:38.734614 19489 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:38.735705 19610 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:38.656213 19411 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:38.702759 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.703320 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.737735 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.738242 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.667554 19428 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.738922 19451 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.740677 19411 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:38.741309 19411 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:38.738927 19428 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.713691 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.644848 19594 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.747979 19490 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:38.748980 19594 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:38.749081 17524 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:38.717813 17522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c40484b7a540a9b32947573409178a"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:38.718780 19341 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:38.749982 17522 raft_consensus.cc:606] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:38.651065 19473 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.751494 19341 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:38.753134 19473 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:38.754393 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:38.755020 17529 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.760995 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:38.764357 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.765556 19538 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:38.765053 19411 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:38.766553 17569 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.768589 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.769191 19538 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:38.769809 19538 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:38.770812 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.771160 19538 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.773694 19416 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.776062 17522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:38.777706 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:38.778821 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 96409.7us
I20260709 13:18:38.776793 17522 raft_consensus.cc:606] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:38.780452 17522 raft_consensus.cc:614] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:38.782527 19606 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:18:38.791306 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:38.792189 19457 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:38.794960 17454 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:18:38.796073 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:38.792806 19457 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.799852 19581 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:38.802747 19564 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:38.807160 19428 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:38.815179 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1092) took 1037 ms. Trace:
I20260709 13:18:38.844548 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:38.851485 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.897490 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.851465 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.858464 18935 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:38.858741 17420 leader_election.cc:336] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.542s (SENT)
I20260709 13:18:38.860777 17529 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:38.859345 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:38.862582 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:38.863318 19489 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:38.875684 17419 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:38.874248 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:38.875988 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 194134us
I20260709 13:18:38.882496 19568 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.886436 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:38.889839 17527 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:38.896096 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:38.909224 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:38.906834 17420 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:38.904330 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 193395us
I20260709 13:18:38.900906 17568 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:38.896445 17601 rpcz_store.cc:276] 0709 13:18:37.778112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.968461 (+190349us) service_pool.cc:224] Handling call
0709 13:18:38.814916 (+846455us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54003e9c54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:38.815100 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1351602432}
I20260709 13:18:38.913168 18200 raft_consensus.cc:2410] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:38.913821 19428 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:38.914043 19568 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:38.914392 19587 consensus_queue.cc:1059] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:38.915759 19428 raft_consensus.cc:3055] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:38.916173 19428 raft_consensus.cc:740] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:38.916355 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:38.916620 19568 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:38.917213 19428 consensus_queue.cc:260] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:38.918876 19428 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:38.919150 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 125174us
I20260709 13:18:38.920090 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.920964 19514 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:38.921519 19514 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:38.922343 19607 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:38.923044 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:38.923956 19580 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.923678 19514 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:38.924516 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.926980 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:38.930867 17568 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:38.933472 19580 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:38.933631 17598 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:38.909283 19489 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.940045 17599 raft_consensus.cc:2410] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:38.942126 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:38.942802 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:38.941119 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.944782 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.909551 18192 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 2.
I20260709 13:18:38.948935 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:38.934417 19581 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:38.950397 17524 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:38.934840 19607 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:38.949337 17520 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:38.942363 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:38.937369 19526 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:38.934122 19580 raft_consensus.cc:697] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:38.959138 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:38.958413 18166 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:38.962554 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:38.964675 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:38.966751 17600 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:38.946269 19358 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:38.968550 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 48555.1us
I20260709 13:18:38.973357 17452 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:38.954936 19581 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.960340 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:38.979643 17449 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.969974 19341 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:38.968711 19526 raft_consensus.cc:697] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:38.986342 19580 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:38.966565 19607 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:39.030107 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:39.030876 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.946367 19576 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:18:39.032810 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 174129us
I20260709 13:18:38.976284 19581 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:39.034196 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 51409.4us
W20260709 13:18:39.036651 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 54836.1us
I20260709 13:18:39.037271 17419 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:39.038450 19564 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:39.030766 19341 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.047178 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:39.046932 17420 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.614s (SENT) [suppressed 43 similar messages]
I20260709 13:18:39.049940 17419 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:39.058606 19371 raft_consensus.cc:2804] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:39.064662 19371 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:39.064986 19358 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:39.065272 19371 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:39.065625 19358 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:39.066380 19457 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:39.046352 19341 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.066751 19358 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:39.060539 19526 consensus_queue.cc:237] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:39.074714 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:39.061866 17420 leader_election.cc:336] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.688s (SENT)
I20260709 13:18:39.063447 19576 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:39.050817 19467 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.035158 19572 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:18:39.084831 17450 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 2.
I20260709 13:18:39.084580 17569 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:39.089564 19416 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:39.090399 19606 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:39.091655 19610 raft_consensus.cc:3055] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:39.091138 19489 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:39.098361 17420 leader_election.cc:336] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.814s (SENT)
W20260709 13:18:39.107074 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.087339 19467 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.111630 17528 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:39.116658 19609 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:18:39.123375 17527 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:39.126509 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:39.129036 17522 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:39.134711 17520 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:39.137884 18167 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:39.140411 19296 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:39.140621 19580 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEARNER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:39.146768 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.152536 17449 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:18:39.092140 19610 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:39.166961 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:39.173568 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 127882us
I20260709 13:18:39.112416 19467 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.184168 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:39.177600 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:39.190629 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.099223 19371 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:39.188078 19428 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:39.206301 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 116929us
I20260709 13:18:39.208142 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:39.219568 17595 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:39.187219 19358 consensus_queue.cc:1059] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:18:39.220945 17599 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:39.223019 19612 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:18:39.226186 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:39.234870 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:39.169848 19607 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:39.243079 19371 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:39.244320 19612 raft_consensus.cc:3055] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:39.244794 19612 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:39.245075 19610 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:39.245710 19612 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:39.246323 19610 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:39.212493 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:39.215569 19428 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:18:39.260820 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.261863 18166 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:39.263444 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 292814us
I20260709 13:18:39.265296 18166 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:39.275053 17523 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:18:39.276533 19587 consensus_queue.cc:1059] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:39.277535 19615 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:39.280123 17420 leader_election.cc:336] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.884s (SENT)
I20260709 13:18:39.294178 19473 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:39.294867 19495 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:39.296159 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.298704 19428 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:39.294868 19473 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:39.303089 19473 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:39.308794 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:39.313122 19341 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:39.318938 19489 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:39.322841 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:39.324622 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:39.326078 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 128239us
I20260709 13:18:39.327332 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:39.315127 17522 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:39.317350 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:39.328467 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 183491us
I20260709 13:18:39.328541 17522 pending_rounds.cc:85] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 2
W20260709 13:18:39.343775 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.340659 17522 pending_rounds.cc:107] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:39.361660 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:39.358783 17522 raft_consensus.cc:2889] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:39.279522 19581 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:39.366919 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 92296.2us
I20260709 13:18:39.354295 19296 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:18:39.366678 19411 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:39.374310 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:39.377247 19341 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:39.386934 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 59797.8us
W20260709 13:18:39.389611 17420 leader_election.cc:336] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.891s (SENT)
W20260709 13:18:39.390236 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.393934 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:39.397192 17595 raft_consensus.cc:2393] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:39.397658 17420 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:39.400806 19496 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:39.404081 17420 leader_election.cc:336] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.894s (SENT)
I20260709 13:18:39.373622 19626 consensus_queue.cc:1059] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:18:39.409015 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:39.409633 17523 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.411226 17569 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:39.393304 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:39.407727 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:39.386353 19489 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:18:39.414849 17599 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
W20260709 13:18:39.434624 19625 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:39.435995 19581 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:39.436424 19467 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:39.437608 17449 raft_consensus.cc:2393] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 3: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:18:39.434695 17420 leader_election.cc:336] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.897s (SENT)
I20260709 13:18:39.440083 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:39.441128 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:39.441322 17445 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:39.439922 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:39.444042 17595 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:39.449568 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.452097 17450 raft_consensus.cc:1240] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:39.431519 19411 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:39.453469 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 49624.4us
W20260709 13:18:39.454679 19627 log.cc:927] Time spent T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:18:39.461527 19612 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.464695 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:39.465442 17599 raft_consensus.cc:2393] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:39.463340 19626 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:39.447347 19576 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.466943 19576 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:39.468906 19576 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:39.470335 19371 raft_consensus.cc:3055] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:39.470901 19371 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:39.473045 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:39.475914 17600 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:18:39.479395 17420 leader_election.cc:336] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.048s (SENT)
I20260709 13:18:39.479887 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:39.480608 17420 leader_election.cc:336] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.053s (SENT)
I20260709 13:18:39.481120 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:39.481508 19607 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:39.482131 19296 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:39.483762 19615 raft_consensus.cc:3055] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:39.484170 19615 raft_consensus.cc:740] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:39.485110 19615 consensus_queue.cc:260] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:39.486594 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:39.494333 17599 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:39.494993 17445 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:18:39.495814 17523 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:39.497635 19495 consensus_queue.cc:1059] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:39.497820 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.496285 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
W20260709 13:18:39.496829 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 90665.9us
I20260709 13:18:39.501684 18166 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:39.502812 17595 raft_consensus.cc:2410] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:39.505652 19587 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:39.529093 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:39.529966 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.530777 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:39.531373 17452 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:39.532370 19538 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:39.530789 17450 raft_consensus.cc:2393] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 4: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:39.533764 17454 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:39.534189 19473 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:39.535394 17448 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:39.537072 17453 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:39.537809 17526 raft_consensus.cc:3055] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:39.538220 17526 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:39.538285 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.539103 17526 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:39.539737 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:39.540096 17526 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:39.542889 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.542587 17350 catalog_manager.cc:5697] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 4 to 5, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 5 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.498725 19495 raft_consensus.cc:3055] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:39.532483 17449 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:39.551359 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.562884 17528 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:39.568045 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:39.574632 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 171315us
I20260709 13:18:39.566007 17445 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:39.544996 19615 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:39.501356 19489 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:18:39.471973 19371 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:39.548557 19580 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:39.586922 17526 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:39.619172 17526 pending_rounds.cc:85] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 2
I20260709 13:18:39.619472 17526 pending_rounds.cc:107] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:39.619737 17526 raft_consensus.cc:2889] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:39.547937 19495 raft_consensus.cc:740] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:39.548157 19587 raft_consensus.cc:697] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:39.616204 17447 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:18:39.593502 17495 connection.cc:256] RPC call timeout handler was delayed by -2.5839992730000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
I20260709 13:18:39.616115 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:39.577370 19607 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 13:18:39.657801 17495 connection.cc:256] RPC call timeout handler was delayed by -2.3300224350000462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:18:39.657491 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:39.658272 17495 connection.cc:256] RPC call timeout handler was delayed by -2.3165224350000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 13:18:39.658630 17495 connection.cc:256] RPC call timeout handler was delayed by -1.9196224350000648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 13:18:39.653034 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:39.658905 17495 connection.cc:256] RPC call timeout handler was delayed by -1.9196224350000648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 13:18:39.659492 17495 connection.cc:256] RPC call timeout handler was delayed by -1.8836224350000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
W20260709 13:18:39.659795 17495 connection.cc:256] RPC call timeout handler was delayed by -1.8584224349999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 13:18:39.660058 17495 connection.cc:256] RPC call timeout handler was delayed by -1.80532243499988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
W20260709 13:18:39.660310 17495 connection.cc:256] RPC call timeout handler was delayed by -1.4633224350000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24700000000000003s for a response
W20260709 13:18:39.660588 17495 connection.cc:256] RPC call timeout handler was delayed by -1.3652036290000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
I20260709 13:18:39.670846 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:39.671288 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.661993 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.629405 18194 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:39.679522 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:39.634882 19580 raft_consensus.cc:697] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:39.662751 19576 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.688503 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:39.680023 19489 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:39.700613 19489 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:39.714905 19489 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:39.722498 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.724162 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.725438 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.726606 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.727190 17454 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:39.728814 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:39.735826 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.737211 17446 raft_consensus.cc:2410] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:39.694766 19576 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:39.740788 19576 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:39.693037 19371 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:39.685586 19473 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:18:39.710410 19486 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:39.751202 19486 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:39.751832 19486 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:39.755177 19580 consensus_queue.cc:237] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:39.758554 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 86100.6us
I20260709 13:18:39.759584 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:39.760040 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.766367 19495 consensus_queue.cc:260] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:39.768147 19495 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:39.770352 19587 consensus_queue.cc:237] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:39.777791 19428 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:39.778551 19428 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:39.780045 19640 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:18:39.783473 19428 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:39.785151 19642 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:18:39.787567 19564 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:39.788547 19564 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:18:39.791931 19597 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:18:39.793042 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.792779 18192 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
W20260709 13:18:39.794267 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.798961 19411 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:39.799655 19411 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:39.802196 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:39.803073 17529 raft_consensus.cc:2393] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:39.804234 19648 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:39.804783 19648 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:39.806983 19648 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:39.814668 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.823000 17451 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:39.721603 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
W20260709 13:18:39.831573 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 163747us
I20260709 13:18:39.847247 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.848533 17451 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:18:39.850229 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 128721us
I20260709 13:18:39.851039 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:39.855183 17445 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:39.860750 17453 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:39.865736 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:39.867197 17450 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:39.871165 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:39.872138 17602 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:39.839735 19538 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:39.876878 17596 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:39.858470 19610 raft_consensus.cc:2764] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:18:39.884392 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 211089us
I20260709 13:18:39.880914 19576 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:39.900868 19564 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.901443 19564 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:39.901623 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:39.902691 17522 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:39.903694 19564 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:39.881103 19341 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:18:39.907377 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:39.908713 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:39.887147 19626 raft_consensus.cc:2764] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:39.857561 19411 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:39.923630 19639 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.249s	user 0.000s	sys 0.003s
I20260709 13:18:39.932947 19581 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:39.935457 17420 connection.cc:256] RPC call timeout handler was delayed by -1.1038599049998084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:18:39.936503 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:39.936686 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:39.939169 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.939503 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.939807 17522 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:39.940341 17453 raft_consensus.cc:2410] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:39.940459 17450 raft_consensus.cc:2393] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 6: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
W20260709 13:18:39.935920 17420 connection.cc:256] RPC call timeout handler was delayed by -1.0965562230001069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.5734s for a response
I20260709 13:18:39.941432 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.898963 19467 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:39.883338 19538 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:39.917035 19564 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:39.944367 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 76390.4us
I20260709 13:18:39.918905 19648 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:39.957556 17522 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:39.961360 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.964700 19538 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:39.966573 19411 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:39.968627 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:18:39.970496 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.970865 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:39.971588 17526 raft_consensus.cc:2393] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:39.978914 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:39.979795 17520 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:39.989280 17454 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
W20260709 13:18:39.989711 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.991153 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:39.991531 19538 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:39.991966 17445 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
W20260709 13:18:39.995144 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 51290.2us
W20260709 13:18:39.998880 17420 leader_election.cc:336] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.723s (SENT)
I20260709 13:18:40.003835 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:39.952473 19564 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:40.022635 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.955951 19489 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:18:40.025692 19564 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.027595 18935 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:40.043998 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:40.044814 18194 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:40.032596 19489 consensus_queue.cc:1243] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:40.043742 19486 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:40.051021 17350 catalog_manager.cc:5697] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.052947 19486 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:40.053654 17525 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:40.055683 19576 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.053129 17350 catalog_manager.cc:5697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 4 to 6, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 6 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:40.065587 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 111099us
I20260709 13:18:40.067159 17495 leader_election.cc:400] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6.
I20260709 13:18:39.984839 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:40.069105 17523 pending_rounds.cc:85] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 2
I20260709 13:18:40.073055 17523 pending_rounds.cc:107] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:40.073300 17523 raft_consensus.cc:2889] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:40.029865 19648 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:18:40.076687 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:40.083616 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.086850 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.089519 17420 leader_election.cc:336] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.803s (SENT)
I20260709 13:18:40.091996 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.093192 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:40.096760 17420 leader_election.cc:336] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.124s (SENT)
I20260709 13:18:40.097262 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.098155 19467 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:40.098994 19467 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:40.100623 17420 leader_election.cc:336] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.167s (SENT)
W20260709 13:18:40.103600 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.107115 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:40.107861 17445 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:40.104943 18167 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.114542 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:40.115293 17454 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:40.123278 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:40.124153 17446 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:40.126168 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:40.132407 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:40.133051 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:40.133370 17454 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:40.137012 17420 leader_election.cc:336] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.239s (SENT)
I20260709 13:18:40.137547 17420 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.140599 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:40.141201 17451 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.142982 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:40.143589 17453 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:40.151611 19371 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.137387 19652 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:40.152671 19652 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:40.153015 19652 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:40.155517 17454 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:40.167587 18200 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
W20260709 13:18:40.169276 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.138223 19648 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:40.170475 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 44401.1us
W20260709 13:18:40.171576 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.173996 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.186486 17596 raft_consensus.cc:3055] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:40.186628 19486 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:40.187044 17596 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:40.187566 17522 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:40.187852 17596 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:40.188830 17596 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.193614 17451 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:40.196384 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.192297 18935 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.216784 18935 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:40.198298 19496 consensus_queue.cc:1059] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:18:40.219014 18935 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:40.219337 17569 connection.cc:256] RPC call timeout handler was delayed by -1.8134596449999663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 13:18:40.219530 19508 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:40.219794 17569 connection.cc:256] RPC call timeout handler was delayed by -1.7432596449998528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 13:18:40.220184 17569 connection.cc:256] RPC call timeout handler was delayed by -1.7333596449998367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 13:18:40.220525 17569 connection.cc:256] RPC call timeout handler was delayed by -1.6127596449998691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
I20260709 13:18:40.220223 19508 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:40.220835 17569 connection.cc:256] RPC call timeout handler was delayed by -1.3832596449999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 13:18:40.221446 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:40.222180 19411 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.208961 19538 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:18:40.229635 19496 raft_consensus.cc:3055] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:40.245764 17350 catalog_manager.cc:5697] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 1 to 3, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 3 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.246732 19496 raft_consensus.cc:740] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:40.247627 19496 consensus_queue.cc:260] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.247474 17350 catalog_manager.cc:5697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 2 to 4, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 4 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.229803 19508 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:40.229122 17596 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:18:40.230880 19411 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.226138 19526 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.242497 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.226989 19626 consensus_queue.cc:1059] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 13:18:40.273801 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.244365 17351 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40498 (request call id 188) took 8999 ms. Trace:
I20260709 13:18:40.244695 19564 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.245638 19658 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:40.249204 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:40.281404 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:40.257907 17350 catalog_manager.cc:5697] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 3 to 4, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 4 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:40.252900 17596 pending_rounds.cc:85] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 6
I20260709 13:18:40.282467 17596 pending_rounds.cc:107] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:18:40.282595 17527 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:40.282871 17596 raft_consensus.cc:2889] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:40.253350 19666 log.cc:927] Time spent T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:18:40.281550 17520 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
W20260709 13:18:40.278194 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 56835.3us
I20260709 13:18:40.302421 17527 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:40.303408 17419 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:40.304495 17350 catalog_manager.cc:5697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:40.305358 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 98379.4us
I20260709 13:18:40.308511 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:40.286321 19489 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.296892 18935 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:40.309690 17350 catalog_manager.cc:5697] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:18:40.312788 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 70414.7us
I20260709 13:18:40.296734 19526 consensus_queue.cc:1059] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:18:40.281059 19652 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:40.311764 19626 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:40.313200 19496 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.329025 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.314893 19607 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.344162 17420 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.349191 19648 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:40.349578 19652 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:40.336295 19626 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.350438 19626 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.350481 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:40.351444 17528 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:40.355207 19495 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:40.355792 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:40.364362 17520 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:18:40.365233 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.366554 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.318926 19489 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.374989 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:40.375597 17596 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:40.360874 19538 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:40.335183 19660 consensus_queue.cc:1059] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:18:40.275272 17351 rpcz_store.cc:276] 0709 13:18:31.245038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.245220 (+   182us) service_pool.cc:224] Handling call
0709 13:18:40.244085 (+8998865us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:38.012601 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:38.014794 (+  2193us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:38.014825 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:18:38.014843 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:38.017083 (+  2240us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:38.017186 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:38.017227 (+    41us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:18:38.018653 (+  1426us) tablet.cc:701] Row locks acquired
0709 13:18:38.018680 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:18:38.018881 (+   201us) write_op.cc:270] Start()
0709 13:18:38.019031 (+   150us) write_op.cc:276] Timestamp: P: 1783603118018815 usec, L: 0
0709 13:18:38.019061 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:18:38.019965 (+   904us) log.cc:844] Serialized 4863 byte log entry
0709 13:18:38.623891 (+603926us) op_driver.cc:464] REPLICATION: finished
0709 13:18:38.670129 (+ 46238us) write_op.cc:301] APPLY: starting
0709 13:18:38.708346 (+ 38217us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.859615 (+151269us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.863318 (+  3703us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:39.054398 (+191080us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:39.054895 (+   497us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:18:39.054966 (+    71us) write_op.cc:312] APPLY: finished
0709 13:18:39.055425 (+   459us) log.cc:844] Serialized 89 byte log entry
0709 13:18:39.055649 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.055945 (+   296us) write_op.cc:454] Released schema lock
0709 13:18:39.056037 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:39.059835 (+  3798us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.059867 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11651,"reported_tablets":29,"spinlock_wait_cycles":56064,"child_traces":[["op",{"apply.queue_time_us":45740,"apply.run_cpu_time_us":7315,"apply.run_wall_time_us":389786,"num_ops":12,"prepare.queue_time_us":1544262,"prepare.run_cpu_time_us":21556,"prepare.run_wall_time_us":467464,"raft.queue_time_us":205873,"raft.run_cpu_time_us":19580,"raft.run_wall_time_us":45804,"replication_time_us":604601,"spinlock_wait_cycles":2304,"thread_start_us":1855985,"threads_started":4,"wal-append.queue_time_us":393629,"wal-append.run_cpu_time_us":19268,"wal-append.run_wall_time_us":1642570}]]}
I20260709 13:18:40.368566 18935 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:40.386715 19648 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:40.394235 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 68723.4us
I20260709 13:18:40.395308 17569 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.396813 17569 leader_election.cc:400] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) with higher term. Message: Invalid argument: T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6.
I20260709 13:18:40.383505 19675 consensus_queue.cc:1059] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:18:40.398193 19358 raft_consensus.cc:3055] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:40.398669 19358 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:40.399735 19648 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:40.402715 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:40.406795 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.408241 17596 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
W20260709 13:18:40.410252 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 54545.2us
I20260709 13:18:40.382220 19658 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.419085 19680 raft_consensus.cc:3055] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:40.419760 19680 raft_consensus.cc:740] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:40.420994 19680 consensus_queue.cc:260] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.421730 17445 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:18:40.422129 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.424292 17454 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:40.426095 17569 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.426676 17454 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:40.379703 19428 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:18:40.401816 18935 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.398200 19411 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:40.399534 19358 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.431664 17445 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:40.414081 19607 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.433235 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
W20260709 13:18:40.421940 19672 log.cc:927] Time spent T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.207s	user 0.002s	sys 0.000s
I20260709 13:18:40.434151 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:40.438450 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:40.439064 17450 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:40.439800 17454 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:40.444802 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:40.449330 19607 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:40.449816 19607 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:40.450289 19607 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:40.453167 17447 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:40.430899 19680 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.434211 18935 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:40.453751 19675 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:40.454674 19564 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:40.446777 19411 consensus_queue.cc:1059] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:18:40.470916 17420 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.498281 19587 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.442759 19652 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:18:40.506352 19633 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:18:40.508004 19628 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:18:40.433976 19473 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:40.499888 17453 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
W20260709 13:18:40.509855 19676 log.cc:927] Time spent T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:18:40.509663 19473 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.511035 19665 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:18:40.511900 19473 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:40.513461 19587 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:40.515779 19587 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:40.516230 19438 raft_consensus.cc:3055] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:40.516616 19358 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.518105 19526 raft_consensus.cc:3055] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:40.518425 19508 raft_consensus.cc:3055] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:40.518497 19526 raft_consensus.cc:740] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:40.518857 19508 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:40.519392 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:40.520007 17527 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:18:40.519783 19508 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:40.499527 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:40.471503 19538 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.522716 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:40.464447 19489 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:40.549389 18167 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.538686 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:40.551151 18166 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:40.551183 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 80356.6us
I20260709 13:18:40.516649 19438 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:40.538839 19564 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:40.477505 19626 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:40.561762 17495 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:40.563464 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 139246us
W20260709 13:18:40.564565 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 138531us
W20260709 13:18:40.568151 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.557819 19633 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:40.556079 19652 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:40.561262 19675 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:40.547163 19607 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:40.578208 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.586117 17596 raft_consensus.cc:2393] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:40.578965 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:40.561120 19564 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.577554 17454 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 7: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:40.519688 19526 consensus_queue.cc:260] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.573045 19665 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:40.590930 19675 raft_consensus.cc:697] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:40.591442 19665 raft_consensus.cc:697] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:40.591063 19438 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.592568 19438 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.592351 19665 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.593204 19564 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.580852 19633 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:40.594116 19669 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.117s	user 0.001s	sys 0.001s
I20260709 13:18:40.594394 19633 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.592105 19675 consensus_queue.cc:237] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.598152 19652 raft_consensus.cc:697] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:40.548743 19538 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.608575 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:40.608916 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.608968 19607 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:40.607402 19564 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.610215 19677 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:40.610502 19538 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:40.610780 19677 raft_consensus.cc:697] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:40.611189 19526 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.611804 19564 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:40.611697 19677 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.600764 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:40.614547 17603 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.615577 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.601354 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.618408 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.619221 17598 raft_consensus.cc:2410] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:40.599323 19652 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:40.602910 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.580713 19508 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.607344 19626 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:40.601120 19489 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.608104 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.608419 19486 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:40.620572 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:40.620981 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.626500 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:40.600441 19660 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:40.627723 17598 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:40.632489 17595 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:40.632560 17601 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.633808 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:40.639680 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:40.640218 17596 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:40.638944 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.640867 17597 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:40.643397 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:40.644465 17595 raft_consensus.cc:2393] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:40.644708 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.645251 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.646533 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:40.648289 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.645942 17598 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:40.652264 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.680423 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.687110 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.641011 19489 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.693027 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:40.656008 19486 raft_consensus.cc:697] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:40.697142 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.704339 17595 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:40.709257 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:40.712309 17603 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:40.686765 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:40.714221 17595 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:18:40.718559 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.726318 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.727017 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.694561 19660 consensus_queue.cc:1059] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:18:40.709877 19496 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.715201 19684 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.720145 19648 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.744442 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:40.745025 19660 raft_consensus.cc:3055] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:40.745250 17594 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:40.745486 19660 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:40.746456 19660 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.747850 17594 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:40.748015 19660 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.707469 18935 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:40.761639 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:40.763031 17453 raft_consensus.cc:2393] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:40.756165 19648 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.767243 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:40.768136 17453 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:40.768579 19648 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:40.768981 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:40.771235 17446 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:40.775970 17447 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:40.777210 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:40.779400 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:40.795161 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:40.795429 17447 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:40.796017 17448 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:40.797284 17452 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:40.779628 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 162860us
I20260709 13:18:40.728735 19690 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:18:40.774937 19489 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:40.741820 19684 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.780517 19678 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.836762 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:40.836720 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:40.839583 17453 raft_consensus.cc:2410] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:40.806156 19473 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:40.808871 19682 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:18:40.860909 19688 log.cc:927] Time spent T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:18:40.865892 17596 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:40.879933 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:40.882457 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 45778.6us
I20260709 13:18:40.884528 19690 raft_consensus.cc:2764] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:18:40.803784 19486 consensus_queue.cc:237] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.902410 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:40.908545 17601 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:40.844122 19678 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.875475 19699 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.915284 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.919116 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:40.870779 19473 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:40.917663 19698 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.873185 19682 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:40.922291 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:40.923054 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.982116 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.972699 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:40.995988 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 80794.1us
I20260709 13:18:40.971331 19489 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.982286 19538 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.983810 19693 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.996330 18935 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:40.998986 17420 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:40.921455 19687 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
W20260709 13:18:41.019881 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 98246.9us
I20260709 13:18:41.035152 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:41.047650 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.047291 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:41.011897 19680 consensus_meta.cc:287] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.001s
I20260709 13:18:40.995890 19705 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:40.997670 19698 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.053124 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:41.059296 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.027961 18935 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:41.064378 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 48424.3us
I20260709 13:18:41.083422 17601 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:41.086198 19713 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.086741 19714 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.086956 19713 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:41.087241 19714 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.087467 19713 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:41.050112 19677 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.056648 19684 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:41.090627 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 168399us
I20260709 13:18:41.051541 19538 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.102792 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.097651 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:41.089481 19714 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:41.119272 17420 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.019589 19489 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.127808 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:41.082726 19707 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:41.036759 19699 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:18:41.089493 19713 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:41.138867 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.140275 19630 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:41.140861 19630 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:41.143283 19630 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:41.065589 19705 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.091888 19626 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:18:41.149899 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:41.152874 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:41.153512 19677 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.158648 19680 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:41.159425 19680 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.123906 19486 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:41.170349 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:41.127827 18935 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.177228 19677 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:41.182647 19708 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:18:41.184922 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:41.187366 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.122789 19684 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.124179 19538 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.201826 17420 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.239903 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:41.240156 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.273767 17527 raft_consensus.cc:2393] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:41.189812 19576 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:41.286412 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 174683us
I20260709 13:18:41.280539 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:41.293898 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:41.295022 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.232178 19633 consensus_meta.cc:287] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.006s
I20260709 13:18:41.199714 18935 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.198101 19680 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:41.302170 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 62112.2us
I20260709 13:18:41.214381 19626 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:41.237020 19670 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:41.233748 19538 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:41.239475 19489 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:41.234714 19682 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:41.214114 19473 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:41.139827 19707 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:41.306272 19486 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:41.300937 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:41.307821 17569 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.293195 19687 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.298667 19699 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:41.205284 19684 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.307544 19678 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:41.307931 19670 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:41.303434 19633 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:41.336079 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:41.309988 19626 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:18:41.340685 17419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.008s	sys 0.010s
I20260709 13:18:41.342929 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:41.331475 19699 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.331384 19486 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:41.347199 19702 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:41.337642 19670 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.336565 19648 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:41.353474 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:41.353981 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 55675.1us
I20260709 13:18:41.333416 19687 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:41.351341 17419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.009s	sys 0.010s
W20260709 13:18:41.351226 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 46197us
I20260709 13:18:41.337883 19473 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:41.354120 17601 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:41.361845 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 840130us
I20260709 13:18:41.354955 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.352938 19707 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:41.355561 17600 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:41.355994 19678 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:41.356069 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:41.350085 19699 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.357029 19626 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.357939 17597 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.358098 17603 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.359692 17599 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:41.368568 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:41.363660 17594 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:41.345577 19680 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:41.367789 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:41.375152 17522 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:41.379436 19697 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.520s	user 0.002s	sys 0.000s
I20260709 13:18:41.381712 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:41.349838 19486 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.388236 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:41.395045 17601 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:41.396868 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.399845 17569 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.401206 17569 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.402601 17569 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.407486 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.408769 17601 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.414443 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:41.427426 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:41.412632 19489 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:41.428443 19489 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.428485 17596 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:41.428992 19489 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.429821 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:41.432205 17596 raft_consensus.cc:2393] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:41.420545 17603 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:41.436578 17522 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:41.440987 17569 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.396760 19411 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.398059 19648 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:41.407239 19678 raft_consensus.cc:697] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:41.418749 19473 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:41.418462 19702 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:41.422480 19701 log.cc:927] Time spent T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.560s	user 0.002s	sys 0.003s
I20260709 13:18:41.449033 17419 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:41.458549 17597 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:41.418196 19713 raft_consensus.cc:2764] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:41.418097 19719 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:41.445940 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.475698 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.456041 17420 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.412813 19680 raft_consensus.cc:697] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:41.440440 19467 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.480250 17601 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:41.444711 19707 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:41.461170 19538 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:41.470856 19358 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:41.470436 19660 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.447218 19526 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:18:41.439396 19716 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
W20260709 13:18:41.547454 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.530453 19411 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:41.536489 19722 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:18:41.539003 19710 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.560878 19648 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:41.530287 19707 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:41.568779 19707 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:41.561934 19678 consensus_queue.cc:237] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:41.555611 19358 raft_consensus.cc:697] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:41.570355 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 140) took 1061 ms. Trace:
I20260709 13:18:41.582728 17600 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:18:41.588658 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.565033 17601 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:18:41.589527 17601 pending_rounds.cc:85] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 5
I20260709 13:18:41.589721 17601 pending_rounds.cc:107] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:41.533649 19473 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.570999 19358 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:41.541610 19660 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.606123 19660 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:41.563979 18194 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:41.579473 19486 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.609501 19702 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.609930 19486 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:41.580425 19633 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:41.611496 17523 raft_consensus.cc:1240] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:41.581276 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 125346us
I20260709 13:18:41.536959 19658 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.569645 19680 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:41.589939 17601 raft_consensus.cc:2889] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.582079 17451 rpcz_store.cc:276] 0709 13:18:40.508890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.509131 (+   241us) service_pool.cc:224] Handling call
0709 13:18:40.509956 (+   825us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.523807 (+ 13851us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:40.708391 (+184584us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.776406 (+ 68015us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.805495 (+ 29089us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.805677 (+   182us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:40.805726 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.805820 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.359259 (+553439us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b48003303d8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abaa8faa1 00007f5abaa86b37 00007f5abaa869ca 00007f5abab7e26f 00007f5abab7df37 00007f5abab9255c 00007f5abab92508 00007f5abab92488 00007f5abab92443 00007f5abab916ec 00007f5ab9abba96
0709 13:18:41.386136 (+ 26877us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:41.570107 (+183971us) raft_consensus.cc:1685] finished
0709 13:18:41.570131 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.570267 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":70830,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":579,"raft.run_cpu_time_us":3750,"raft.run_wall_time_us":845479,"spinlock_wait_cycles":35331584,"thread_start_us":198545,"threads_started":2,"wal-append.queue_time_us":132033}
I20260709 13:18:41.628784 19660 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:41.632700 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:41.633787 18192 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:41.636686 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:41.637707 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:41.638695 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:41.651790 17527 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 7: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:41.631229 19660 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.610082 19702 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.632074 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:41.637050 17529 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:41.645612 17526 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:18:41.657927 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 64073.2us
I20260709 13:18:41.660526 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.643603 19657 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.652796 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:41.670171 17523 raft_consensus.cc:2410] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:41.653142 19693 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.519073 19719 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.676872 18195 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:41.668745 19684 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:41.675019 19581 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.672878 19657 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.740767 19709 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.295s
W20260709 13:18:41.755812 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 69946.2us
I20260709 13:18:41.679961 19473 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.741999 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 72818.1us
I20260709 13:18:41.677805 19687 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:41.766922 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:41.768450 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:41.697283 19576 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.822723 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:41.823746 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:41.762383 19728 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:18:41.852617 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:41.857769 17446 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:41.754086 19698 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:41.859062 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:41.862326 17450 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:41.859635 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:41.761098 19486 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:41.761010 19719 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:41.861483 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 202763us
I20260709 13:18:41.681969 19693 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:41.831784 19730 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.155s	user 0.001s	sys 0.001s
I20260709 13:18:41.750000 19358 consensus_queue.cc:1059] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 13:18:41.818246 19675 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:41.867216 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:41.871654 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:41.879531 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 403938us
I20260709 13:18:41.852916 18935 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:18:41.878238 17446 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:41.881969 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:41.880503 17569 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.830684 19473 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:41.916910 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 53150.7us
I20260709 13:18:41.922900 17450 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:41.923569 19655 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:18:41.924007 19729 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:18:41.867609 19682 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:41.924039 17454 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:18:41.886435 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:41.882292 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:41.929505 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:41.932732 17528 raft_consensus.cc:2410] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:41.882596 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:41.933251 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:41.933889 17446 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.934965 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:41.877257 19707 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.891280 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:41.940445 17526 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:41.944880 19607 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:41.945438 19702 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:41.946280 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 65888.6us
I20260709 13:18:41.948187 19665 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.866231 19698 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.927238 19495 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.951145 19698 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:41.951256 19495 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:41.935839 19587 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:18:41.953145 19658 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.957280 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:41.958434 17529 raft_consensus.cc:2410] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:41.965143 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:41.928021 19358 raft_consensus.cc:3055] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:41.979598 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:41.980528 17569 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:41.981570 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:41.974479 17527 raft_consensus.cc:2393] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:41.953397 19736 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.912606 19687 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:41.874444 19486 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.886849 19489 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:41.938978 19719 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.885437 19675 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.025322 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.035501 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:42.036357 17601 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:41.986370 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.047881 17529 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:42.083843 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:41.982419 19626 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.072257 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:42.077471 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 142444us
I20260709 13:18:42.084430 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.141741 17525 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:18:42.091068 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 155193us
I20260709 13:18:42.091938 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:41.985412 19684 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:42.145792 19738 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:18:41.967486 19707 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:42.147451 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.148036 19707 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:41.975646 19607 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 13:18:42.148654 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.038446 19660 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:41.985710 19709 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 13:18:42.149857 19709 consensus_queue.cc:1243] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:42.093602 19719 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.151350 19473 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:42.152559 19719 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.126932 19746 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:42.062402 19495 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.085319 18935 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.049999 19687 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:42.046463 19736 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.126245 19657 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.071380 19715 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:18:42.142596 19748 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:42.143227 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:42.144248 19732 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
W20260709 13:18:42.061221 19734 log.cc:927] Time spent T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:18:42.147670 19735 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:18:42.149255 17527 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:42.191183 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:41.976382 19358 raft_consensus.cc:740] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:42.202965 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.202842 19358 consensus_queue.cc:260] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.203648 17445 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:42.204780 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.154469 17447 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:42.156354 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.161670 17446 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:42.173636 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:42.134581 19581 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:42.154331 19699 consensus_meta.cc:287] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.756s	user 0.008s	sys 0.003s
I20260709 13:18:42.181073 17568 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:42.192880 17524 raft_consensus.cc:2410] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:42.155006 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.196135 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:42.198305 19740 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:18:42.207043 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.186614 19680 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.212548 17520 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:42.212769 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.229725 18166 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:42.214141 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:42.231135 17447 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 5: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:18:42.231207 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 50235us
I20260709 13:18:42.232224 17568 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:42.232620 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.165230 19626 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.189347 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:42.177889 18935 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.233533 17447 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:42.240690 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.235188 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.186894 19665 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:18:42.241040 17568 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:42.192660 19693 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.213157 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.244439 17446 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:42.208070 19486 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.206182 19746 raft_consensus.cc:697] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:42.206001 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.196655 19748 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.242733 19698 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:42.220716 19576 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:42.206914 19742 log.cc:927] Time spent T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
I20260709 13:18:42.227135 19716 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.249531 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.273386 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.274725 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:42.278316 17521 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:42.253459 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.235625 19709 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:42.280821 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 66776.6us
I20260709 13:18:42.284127 17568 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:42.281127 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.281316 17447 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:42.237651 19744 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:18:42.283409 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:42.228793 19699 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.286319 17598 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 3.
I20260709 13:18:42.285073 17445 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:42.247999 19733 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:18:42.284515 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:42.281736 17446 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:42.235963 19680 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.250234 19576 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.296164 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.297365 17447 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:42.288475 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:42.277631 19698 raft_consensus.cc:697] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:42.303807 19576 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.288089 19660 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.315734 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:42.319646 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.286108 18194 raft_consensus.cc:2393] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:42.306602 17420 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:42.354063 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.282388 19495 raft_consensus.cc:2804] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:42.360541 17447 raft_consensus.cc:2410] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:18:42.361912 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 55443.9us
I20260709 13:18:42.363940 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.364337 17420 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:42.364696 17447 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:42.365913 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.366631 17447 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:42.368005 17445 raft_consensus.cc:2410] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:42.348362 19486 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:42.357085 19740 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:42.350605 19473 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.373797 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:42.285386 19716 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.385357 17569 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:42.279938 19684 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
W20260709 13:18:42.374230 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 90170.1us
I20260709 13:18:42.368409 19495 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.371845 19693 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:42.372869 19665 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:18:42.389302 19495 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.376796 19486 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.373088 19737 raft_consensus.cc:2804] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:42.410051 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.413697 19737 raft_consensus.cc:697] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:42.415340 19680 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.416093 19486 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.415493 19737 consensus_queue.cc:237] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:42.421260 18935 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.384796 19473 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.434320 19473 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:42.435873 19670 consensus_meta.cc:287] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.073s	user 0.012s	sys 0.000s
I20260709 13:18:42.436299 19670 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.371240 19660 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:42.438325 17522 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:42.439229 19713 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:42.439759 19713 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:42.440578 19660 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:42.390220 19761 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:18:42.406970 19538 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:42.441701 19713 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:42.428576 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 137685us
I20260709 13:18:42.432006 19699 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.433004 19748 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.394853 19747 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.392701 19607 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:42.441944 19538 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.410183 17568 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:42.477306 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 67208.6us
I20260709 13:18:42.479815 17454 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:42.481984 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.483723 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.443238 19670 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:42.425822 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.390327 19746 consensus_queue.cc:237] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:42.421870 19736 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.455940 19716 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:42.424880 17526 raft_consensus.cc:2410] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:42.462481 17569 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:42.465636 17447 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:18:42.473555 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 98024.2us
I20260709 13:18:42.488148 17454 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:42.484458 17521 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:42.501277 17454 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:42.501194 17569 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:42.505668 17454 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:42.517688 17598 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:42.519457 17598 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:18:42.519877 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.520860 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:42.521768 17602 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:42.522526 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:42.523231 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:42.524117 17602 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:42.474871 19761 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:18:42.520900 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:42.499713 19766 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.536926 17598 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.538297 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:42.540133 17594 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:42.542941 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:42.508424 19716 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:42.503903 19765 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:42.503257 19626 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.526729 19684 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:42.570783 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 64922.5us
I20260709 13:18:42.548346 19716 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.551205 19526 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.492604 19698 consensus_queue.cc:237] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.551005 19765 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.545562 19772 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:42.577715 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 76602.5us
I20260709 13:18:42.561254 19665 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:42.596064 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:42.572786 19680 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:42.581204 19716 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.621042 17569 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:42.546377 19766 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.570856 19626 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:18:42.597884 19765 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.636862 19687 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:42.614485 19772 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.586249 18194 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:18:42.653132 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 79631.2us
I20260709 13:18:42.647953 17598 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:42.632323 18935 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.614877 19665 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.629343 19680 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:42.657384 19687 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.653671 19576 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.672370 19785 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.680460 19684 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:42.664634 19486 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.664356 18935 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:42.740943 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 185603us
I20260709 13:18:42.743788 17420 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:42.728066 19607 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:42.739748 19746 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.688427 19687 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:42.765990 19746 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:42.768358 19687 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:42.692569 19769 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.191s
I20260709 13:18:42.769078 19746 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:42.788013 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 44276.1us
W20260709 13:18:42.795274 19768 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:18:42.836796 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:42.840304 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:42.842057 19576 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.842259 18935 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:42.844239 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1290) took 1382 ms. Trace:
I20260709 13:18:42.844705 17522 rpcz_store.cc:276] 0709 13:18:41.461740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.462102 (+   362us) service_pool.cc:224] Handling call
0709 13:18:41.462410 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.438970 (+976560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.843913 (+404943us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54002021d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:42.844132 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2243872512}
W20260709 13:18:42.846685 19781 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:18:42.848593 19776 log.cc:927] Time spent T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:18:42.848467 19744 consensus_queue.cc:1059] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:42.851336 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:42.852176 17522 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:42.846823 19784 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:18:42.853621 19699 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:42.838378 19793 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:18:42.874771 19699 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:42.875253 19699 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.838253 19670 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:42.839133 19766 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:43.011731 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 390778us
I20260709 13:18:42.857146 19665 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:43.012557 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:43.009871 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 89426.7us
I20260709 13:18:43.016073 17569 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:43.053068 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:43.013794 19538 consensus_meta.cc:287] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.004s
I20260709 13:18:43.069959 19607 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:43.071312 19799 log.cc:927] Time spent T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
W20260709 13:18:43.072424 19792 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 13:18:43.013432 19772 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:43.083714 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:43.089169 19670 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:43.052285 19766 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:43.090520 19766 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:43.090910 19766 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.054836 19682 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:43.091964 19682 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.092814 19665 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:43.093530 19747 consensus_meta.cc:287] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.003s
I20260709 13:18:42.929627 19495 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:43.069950 19800 log.cc:927] Time spent T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:18:43.137676 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 54007.4us
I20260709 13:18:43.065732 19486 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:43.094172 19794 log.cc:927] Time spent T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
W20260709 13:18:43.100703 19473 consensus_meta.cc:287] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.000s
I20260709 13:18:43.123142 19772 raft_consensus.cc:1064] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:18:43.113658 19745 raft_consensus.cc:1064] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
W20260709 13:18:43.121618 19526 consensus_meta.cc:287] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.002s
I20260709 13:18:43.078140 19705 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:43.093912 19747 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:43.195513 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:43.124109 19680 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:43.123844 19648 raft_consensus.cc:3055] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:43.202286 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 186308us
I20260709 13:18:43.088502 19538 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:43.218938 19756 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:18:43.088778 19746 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:43.219683 19746 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.220054 19746 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.220153 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:43.221457 19802 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.222188 19486 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:43.222050 19802 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:43.222731 19486 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:43.223496 19798 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:18:43.224318 19802 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:43.224839 19486 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:43.225452 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:43.226727 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:43.227370 17603 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:43.166518 19607 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.228246 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:43.228403 19607 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:43.228966 17601 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:43.229471 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:43.166745 19778 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:43.208385 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:43.209542 17602 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:43.235001 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:43.237437 17526 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:43.238058 17527 raft_consensus.cc:1240] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.216929 19526 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:43.191447 19687 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:18:43.239574 17524 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:43.220227 19538 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:43.217244 19648 raft_consensus.cc:740] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:43.203192 19473 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:43.243356 19486 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:18:43.244346 19680 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:43.244755 19486 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:43.245590 19486 raft_consensus.cc:3055] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:43.249534 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:43.250773 19747 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:43.252194 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:43.206368 19782 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.259303 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:43.253050 17527 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 2.
I20260709 13:18:43.256142 17495 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:43.208592 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:43.278576 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:43.283774 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:43.300670 17526 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:43.277880 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:43.241798 19765 consensus_meta.cc:287] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.004s
I20260709 13:18:43.306006 17522 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:43.302202 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:43.249486 19783 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:18:43.299430 19716 consensus_meta.cc:287] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.002s
I20260709 13:18:43.245960 19486 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:43.315394 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:43.261351 19793 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:18:43.299008 19782 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:43.318859 19805 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:43.320415 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1580) took 1226 ms. Trace:
I20260709 13:18:43.320463 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:43.325487 19785 consensus_meta.cc:287] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.585s	user 0.002s	sys 0.005s
I20260709 13:18:43.326879 19698 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:43.327538 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1610) took 1385 ms. Trace:
I20260709 13:18:43.328801 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:43.329725 19682 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:43.241798 19648 consensus_queue.cc:260] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:43.274845 19705 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:43.251376 19747 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:43.332165 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.043444 19678 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:44.048534 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:43.333807 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1250) took 1387 ms. Trace:
I20260709 13:18:43.490082 19495 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.054603 17453 rpcz_store.cc:276] 0709 13:18:41.946814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.458501 (+511687us) service_pool.cc:224] Handling call
0709 13:18:42.458853 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.459091 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:42.459400 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.333424 (+874024us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:43.333493 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:43.333548 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.333631 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.333746 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":539126,"prepare.queue_time_us":34284,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":540411,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"spinlock_wait_cycles":19801472,"thread_start_us":333862,"threads_started":1,"wal-append.queue_time_us":423173}
I20260709 13:18:44.056562 19682 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.056907 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:44.057657 17453 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.428056 19680 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:44.074862 19746 consensus_meta.cc:287] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.854s	user 0.013s	sys 0.000s
I20260709 13:18:43.346321 19657 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.334966 19467 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:18:43.525775 19737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.015s	sys 0.024s
I20260709 13:18:44.059959 19705 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.060261 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.060328 19785 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:43.686450 19801 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.349606 17419 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:43.333408 17569 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.114617 17594 raft_consensus.cc:2393] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:44.114724 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 781312us
I20260709 13:18:43.813503 19687 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:44.064910 18200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42538 (request call id 258) took 1518 ms. Trace:
W20260709 13:18:44.050928 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 1.30701e+06us
W20260709 13:18:43.698865 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 396679us
I20260709 13:18:44.053656 17528 rpcz_store.cc:276] 0709 13:18:41.942782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.943159 (+   377us) service_pool.cc:224] Handling call
0709 13:18:41.943419 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.102726 (+159307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.102756 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:42.102798 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:42.102846 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.327182 (+1224336us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54000fe954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:43.327247 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.327460 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365741312}
W20260709 13:18:44.069584 17527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.003s	sys 0.010s
I20260709 13:18:44.118973 18200 rpcz_store.cc:276] 0709 13:18:42.546873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.547256 (+   383us) service_pool.cc:224] Handling call
0709 13:18:43.328639 (+781383us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b5800003c98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:44.064849 (+736210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7935872}
W20260709 13:18:44.119679 17527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.003s	sys 0.010s
I20260709 13:18:44.119415 17420 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.058641 17454 rpcz_store.cc:276] 0709 13:18:42.093820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.516661 (+422841us) service_pool.cc:224] Handling call
0709 13:18:42.517440 (+   779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.517824 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.517856 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.518327 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.579947 (+ 61620us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:42.615410 (+ 35463us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.623919 (+  8509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.624114 (+   195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.249789 (+625675us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b180005b3c0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:43.320109 (+ 70320us) raft_consensus.cc:1685] finished
0709 13:18:43.320211 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.320331 (+   120us) inbound_call.cc:177] Queueing success response
0709 13:18:43.348697 (+ 28366us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b180005b3c0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
Metrics: {"mutex_wait_us":12297,"prepare.queue_time_us":33702,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":17425,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":219,"spinlock_wait_cycles":42753152,"thread_start_us":60200,"threads_started":1,"wal-append.queue_time_us":123872}
I20260709 13:18:43.307183 19761 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:43.451050 19699 consensus_meta.cc:287] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.568s	user 0.012s	sys 0.000s
W20260709 13:18:43.346822 19760 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:18:43.333163 19789 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:43.339459 19726 log.cc:927] Time spent T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 1.585s	user 0.008s	sys 0.016s
I20260709 13:18:44.082010 17603 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:44.136404 17598 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:44.053828 19678 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:43.789456 19731 log.cc:927] Time spent T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 1.630s	user 0.003s	sys 0.005s
I20260709 13:18:43.390350 18192 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:18:44.023301 19769 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.011s	sys 0.020s
I20260709 13:18:43.337450 19741 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.355255 19358 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.106160 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1246) took 2229 ms. Trace:
I20260709 13:18:43.336632 19675 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.108757 19467 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:43.338225 19626 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:44.053068 19805 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:44.148569 19769 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.012s	sys 0.021s
W20260709 13:18:44.107756 19737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.456s	user 0.029s	sys 0.034s
I20260709 13:18:44.076326 19709 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:43.339123 19759 consensus_queue.cc:1059] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.777s
I20260709 13:18:44.050594 19473 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.132983 18167 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:43.316391 19765 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.132754 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.081075 19783 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.069685 19716 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.124293 19682 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.075860 19746 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.075726 19680 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.128683 19761 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.108316 19657 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.198360 19769 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:44.199088 19769 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.200834 19657 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.201320 19769 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.153915 17450 rpcz_store.cc:276] 0709 13:18:41.876550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.422406 (+545856us) service_pool.cc:224] Handling call
0709 13:18:42.422743 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.423080 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:42.516071 (+ 92991us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.649649 (+133578us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.325549 (+675900us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b1800115000. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab29f3c0a 00007f5abc133219 00007f5ab2a7ba40 00007f5ab2a764e4 00007f5ab2a76455 00007f5ab5b5e060 00007f5ab5b70716 00007f5ab5b81287 00007f5ab5b81208
0709 13:18:43.325748 (+   199us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.390221 (+ 64473us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.390712 (+   491us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:43.390749 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.390816 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.105780 (+714964us) raft_consensus.cc:1685] finished
0709 13:18:44.105825 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.106069 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":670080,"prepare.queue_time_us":8101,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":3612,"raft.queue_time_us":693744,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":6969,"spinlock_wait_cycles":4506368,"thread_start_us":179863,"threads_started":2,"wal-append.queue_time_us":128378}
I20260709 13:18:44.165140 19741 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.132006 19698 raft_consensus.cc:697] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:44.132534 19495 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.533396 17525 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:44.201982 19769 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.204340 19741 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.204814 19765 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.204873 19769 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:44.205515 19737 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:44.206070 19769 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.206243 19737 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.208779 19737 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.203341 19495 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.135703 19789 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:44.131412 17453 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:44.214147 17600 raft_consensus.cc:1240] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:44.214296 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:44.214915 17525 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.214982 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.215148 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:44.175632 18167 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.176616 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.168033 18192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42536 (request call id 163) took 1628 ms. Trace:
I20260709 13:18:44.181392 17454 raft_consensus.cc:2410] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:44.135439 19699 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.219630 17602 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:44.161639 19812 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:44.133301 19687 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.192878 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.174197 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.168421 19805 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.141115 19785 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.202093 19761 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.201745 19657 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:44.220585 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.236022 17569 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:18:44.191753 19766 consensus_meta.cc:287] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.100s	user 0.011s	sys 0.004s
I20260709 13:18:44.178953 19675 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:44.178705 19813 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:44.220592 18198 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:44.228509 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:44.202876 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.128394 19801 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.170667 19626 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.204005 19818 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.232481 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1126) took 2247 ms. Trace:
W20260709 13:18:44.234928 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 115603us
I20260709 13:18:44.152580 19486 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.208822 19769 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.234885 19815 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:44.216624 19789 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.260489 17524 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.256420 19495 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:44.262765 19810 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:18:44.185185 19709 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.256556 19473 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:44.297845 19473 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.298934 19783 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.299983 19473 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.302273 19782 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.303030 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.303701 17449 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:44.304600 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:44.305148 17449 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:44.270258 19816 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.307031 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 191) took 1045 ms. Trace:
I20260709 13:18:44.270344 19467 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.271802 19747 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.233254 18193 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:44.307459 17527 rpcz_store.cc:276] 0709 13:18:43.261861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.262949 (+  1088us) service_pool.cc:224] Handling call
0709 13:18:43.263501 (+   552us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:43.276295 (+ 12794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.276335 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:43.305669 (+ 29334us) log.cc:844] Serialized 590 byte log entry
0709 13:18:44.120151 (+814482us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:44.120207 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.120297 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.306786 (+186489us) raft_consensus.cc:1685] finished
0709 13:18:44.306809 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.306970 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54,"raft.queue_time_us":1196,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5711,"thread_start_us":734874,"threads_started":1,"wal-append.queue_time_us":824169}
I20260709 13:18:44.236142 19657 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.236822 17453 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 3.
I20260709 13:18:44.310300 19657 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.311470 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 150) took 2454 ms. Trace:
W20260709 13:18:44.277053 17495 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.513s (SENT) [suppressed 17 similar messages]
I20260709 13:18:44.276962 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.311872 17445 rpcz_store.cc:276] 0709 13:18:41.856902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.379112 (+522210us) service_pool.cc:224] Handling call
0709 13:18:42.388192 (+  9080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.460078 (+ 71886us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:42.491489 (+ 31411us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.554579 (+ 63090us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:42.554628 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:42.554678 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.310708 (+1756030us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b18003bef00. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a472a6 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419
0709 13:18:44.311249 (+   541us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b54003ef8d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:44.311286 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.311413 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74411,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3333,"raft.queue_time_us":110,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9605,"spinlock_wait_cycles":195520384,"thread_start_us":62635,"threads_started":1,"wal-append.queue_time_us":108058}
I20260709 13:18:44.234050 19812 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.262706 19682 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:44.203888 19698 consensus_queue.cc:237] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.284922 19746 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.285499 19626 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.327050 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.265182 19813 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.286675 19687 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.269670 19705 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.268088 19793 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:44.328183 19793 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.328452 19699 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.329149 19813 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.216895 18192 rpcz_store.cc:276] 0709 13:18:42.537647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.537808 (+   161us) service_pool.cc:224] Handling call
0709 13:18:43.389697 (+851889us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b5800003c98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab3ffc0 00007f5abab2a929 00007f5abab2a3d2 00007f5ab40a1bd4
0709 13:18:43.389930 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.148458 (+758528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.166401 (+ 17943us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7420288}
I20260709 13:18:44.330580 19793 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.259248 19766 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.333169 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1352) took 2059 ms. Trace:
I20260709 13:18:44.333551 17601 rpcz_store.cc:276] 0709 13:18:42.273542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.273702 (+   160us) service_pool.cc:224] Handling call
0709 13:18:42.289894 (+ 16192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:43.229371 (+939477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.332916 (+1103545us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54003ae3d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:44.333108 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2158860032}
I20260709 13:18:44.334995 19766 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.289150 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:44.335927 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 209) took 1005 ms. Trace:
I20260709 13:18:44.336181 17528 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:44.289989 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:44.336371 17601 rpcz_store.cc:276] 0709 13:18:43.330804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.334853 (+1004049us) service_pool.cc:224] Handling call
0709 13:18:44.335338 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.335597 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.335624 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.335665 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:44.335702 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.335761 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.335865 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:44.294186 19495 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:44.272940 17599 rpcz_store.cc:276] 0709 13:18:41.978106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.978236 (+   130us) service_pool.cc:224] Handling call
0709 13:18:42.034892 (+ 56656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.095080 (+ 60188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.095137 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.104624 (+  9487us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.270484 (+165860us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:42.350465 (+ 79981us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.352155 (+  1690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.352270 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.074405 (+722135us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b18002aaa80. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:43.304389 (+229984us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b18002aaa80. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:44.225568 (+921179us) raft_consensus.cc:1685] finished
0709 13:18:44.225606 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.225801 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109595,"prepare.queue_time_us":86318,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":4002,"raft.queue_time_us":66820,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":46559,"spinlock_wait_cycles":29435648,"thread_start_us":77961,"threads_started":1,"wal-append.queue_time_us":180873}
I20260709 13:18:44.338590 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 151) took 2481 ms. Trace:
I20260709 13:18:44.294642 19678 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.296267 19801 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.339082 17447 rpcz_store.cc:276] 0709 13:18:41.857207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.390927 (+533720us) service_pool.cc:224] Handling call
0709 13:18:42.391153 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.496048 (+104895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.338356 (+1842308us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b54002008d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:44.338531 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157324672}
I20260709 13:18:44.349563 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 208) took 1019 ms. Trace:
I20260709 13:18:44.350047 17594 rpcz_store.cc:276] 0709 13:18:43.330459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.128887 (+798428us) service_pool.cc:224] Handling call
0709 13:18:44.149273 (+ 20386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.192546 (+ 43273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.192575 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.192623 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:44.192651 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.349341 (+156690us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b54003e9254. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:44.349385 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.349507 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99038464}
I20260709 13:18:44.351918 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 212) took 1020 ms. Trace:
I20260709 13:18:44.352665 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.354619 17597 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:44.296891 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1605) took 2414 ms. Trace:
I20260709 13:18:44.306711 19816 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.355384 19769 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.355450 17523 rpcz_store.cc:276] 0709 13:18:41.882885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.883025 (+   140us) service_pool.cc:224] Handling call
0709 13:18:41.883347 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.101769 (+218422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.101802 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:42.101848 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:42.101894 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.296622 (+2194728us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400230fd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:44.296673 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.296822 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501777792}
I20260709 13:18:44.356797 19812 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.357398 17420 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.357780 19816 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.328379 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1140) took 1132 ms. Trace:
I20260709 13:18:44.359813 17603 rpcz_store.cc:276] 0709 13:18:43.196224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.229223 (+ 32999us) service_pool.cc:224] Handling call
0709 13:18:44.328178 (+1098955us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b5400314f54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:44.328292 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1958947072}
I20260709 13:18:44.295852 19607 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.361884 17525 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
W20260709 13:18:44.263527 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 914031us
I20260709 13:18:44.278894 19818 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.327301 19716 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.394737 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:44.271926 19675 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.332405 19626 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.338716 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 211) took 1007 ms. Trace:
I20260709 13:18:44.400280 17599 rpcz_store.cc:276] 0709 13:18:43.331384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.337905 (+1006521us) service_pool.cc:224] Handling call
0709 13:18:44.338208 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.338387 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.338412 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.338487 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:44.338519 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.338574 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.338664 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:44.236922 19785 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.403070 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:44.403723 17599 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.365559 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:44.366160 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:44.406190 17523 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:44.352358 17594 rpcz_store.cc:276] 0709 13:18:43.331679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.351092 (+1019413us) service_pool.cc:224] Handling call
0709 13:18:44.351358 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.351526 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.351553 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.351605 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:44.351657 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.351726 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.351852 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:44.407469 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:44.408890 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.368054 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.409890 17594 raft_consensus.cc:2393] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:44.377025 17524 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:44.381462 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:44.381669 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:44.382907 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:44.385448 17449 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:44.233318 19765 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:44.326535 19467 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.396615 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.397348 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.398102 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:44.398681 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.399698 19675 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.421260 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1598) took 1075 ms. Trace:
I20260709 13:18:44.441983 17568 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:18:44.430930 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 62940.5us
I20260709 13:18:44.442276 17449 rpcz_store.cc:276] 0709 13:18:43.345925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.304351 (+958426us) service_pool.cc:224] Handling call
0709 13:18:44.421174 (+116823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:44.443753 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.442934 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.444975 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.445477 17594 raft_consensus.cc:2393] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:44.445636 17449 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
W20260709 13:18:44.446959 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 271421us
I20260709 13:18:44.447481 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:44.458099 17449 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:44.394855 19769 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:44.458457 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 90498.4us
I20260709 13:18:44.458930 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:44.459107 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.459991 17446 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:44.396271 19682 raft_consensus.cc:697] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:44.466713 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.461762 17419 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.467880 17449 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:44.429409 19607 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.465221 18167 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.475529 17569 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:44.473318 19820 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.480206 17568 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.481666 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.443866 19813 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:44.484386 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 207346us
I20260709 13:18:44.484495 17594 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:44.411074 19371 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:18:44.488122 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:44.488174 17568 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:44.467061 19660 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.474367 19769 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:44.463649 19815 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.463390 19675 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:44.472743 19526 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.441236 19765 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:44.541095 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 76117.2us
I20260709 13:18:44.492062 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:44.551913 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 59996.3us
I20260709 13:18:44.492548 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.508410 19820 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:44.479661 19467 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.554172 19660 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.484125 19607 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.491194 19746 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:44.476670 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.564236 17449 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
W20260709 13:18:44.558084 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 65519.6us
W20260709 13:18:44.558226 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 82782.3us
I20260709 13:18:44.482517 19687 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:44.475656 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.508723 19678 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:44.563825 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.560515 19526 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.572867 19526 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.494305 19813 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.493520 19716 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:44.568886 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.568833 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.565738 17569 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.581223 17449 raft_consensus.cc:2410] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:44.580375 17448 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:44.582623 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.508136 19473 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:44.555682 19765 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.576696 19813 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.566941 19687 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.603714 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:44.583348 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:44.605031 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:44.637802 17449 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.638616 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:18:44.639823 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 145772us
I20260709 13:18:44.640105 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:44.559538 19793 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:44.558349 19815 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.564843 19822 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:44.565409 19699 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:44.543332 19657 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.565280 19805 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.563910 19746 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:44.615051 19607 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.658126 19818 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.608075 19473 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.658744 19473 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:44.661696 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.555052 19820 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.662958 17603 raft_consensus.cc:2393] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:44.664467 19820 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.579903 19682 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.665328 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.613404 19761 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.618337 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.669021 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:44.669736 17521 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:44.670926 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:44.641350 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:44.577822 19678 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.624167 19783 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:44.621460 19787 log.cc:927] Time spent T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.605s	user 0.001s	sys 0.012s
I20260709 13:18:44.584530 19706 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:44.565696 19698 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:18:44.653872 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.685613 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:44.656062 19657 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.656219 19489 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.658272 19746 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.618146 19785 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.563019 19675 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.642321 19687 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:44.559342 19769 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.649830 17449 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:44.609175 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.652143 19766 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:44.643090 19793 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:44.649262 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.651894 19716 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:44.691834 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.623679 19782 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:18:44.653112 19822 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.652629 19765 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:44.780956 19765 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:44.781419 19765 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.778378 18199 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:44.688265 17448 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:44.694015 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 116785us
I20260709 13:18:44.679872 19678 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.791131 18167 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.619282 19789 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.796449 17450 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:44.714660 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.716054 19675 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:44.672369 19699 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.844890 19678 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.719503 19815 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.692304 19783 raft_consensus.cc:697] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:44.846275 17527 raft_consensus.cc:2393] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:44.701150 19526 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:44.719561 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.730715 19761 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.693254 19826 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:18:44.731189 19805 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.734500 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1588) took 2492 ms. Trace:
I20260709 13:18:44.739701 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1637) took 1382 ms. Trace:
I20260709 13:18:44.741389 19680 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.863670 17447 rpcz_store.cc:276] 0709 13:18:42.242337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.340336 (+2097999us) service_pool.cc:224] Handling call
0709 13:18:44.340767 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.349128 (+  8361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.349160 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.349633 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.483992 (+134359us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:44.484051 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.484124 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.734154 (+250030us) raft_consensus.cc:1685] finished
0709 13:18:44.734186 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.734412 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7869,"raft.queue_time_us":8001,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":134020,"threads_started":1,"wal-append.queue_time_us":382868}
I20260709 13:18:44.741479 17599 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:44.743366 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1139) took 1547 ms. Trace:
I20260709 13:18:44.865963 17597 rpcz_store.cc:276] 0709 13:18:43.195925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.304243 (+108318us) service_pool.cc:224] Handling call
0709 13:18:44.743178 (+1438935us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54000780d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:44.743304 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679575296}
I20260709 13:18:44.743723 19746 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.745141 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1245) took 2882 ms. Trace:
I20260709 13:18:44.866463 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.745302 19741 raft_consensus.cc:3055] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:44.759693 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:44.774871 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 210317us
I20260709 13:18:44.775940 17521 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:44.869176 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:44.776397 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 197587us
I20260709 13:18:44.780511 19822 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.838943 19789 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.839617 19817 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:44.873620 19817 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:44.874470 19797 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.806s	user 0.008s	sys 0.008s
I20260709 13:18:44.876008 19817 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.841209 19769 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:44.851538 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 60475.8us
I20260709 13:18:44.861960 19526 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.880303 19699 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:44.880589 18166 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:44.881721 19775 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 2.248s	user 0.000s	sys 0.017s
I20260709 13:18:44.863341 19785 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.882386 19785 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.882786 19826 raft_consensus.cc:2804] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:44.883316 19826 raft_consensus.cc:697] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:44.883471 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1130) took 2903 ms. Trace:
I20260709 13:18:44.853060 19473 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.883874 17595 rpcz_store.cc:276] 0709 13:18:41.979653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.979886 (+   233us) service_pool.cc:224] Handling call
0709 13:18:42.280360 (+300474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.291417 (+ 11057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.291466 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.299089 (+  7623us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.500896 (+201807us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:42.531418 (+ 30522us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.817713 (+1286295us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b18003a3600. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a76455 00007f5ab5b5e060 00007f5ab5b70716 00007f5ab5b81287 00007f5ab5b81208
0709 13:18:44.073916 (+256203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.074004 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.881109 (+807105us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:44.883266 (+  2157us) raft_consensus.cc:1685] finished
0709 13:18:44.883288 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.883415 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15740,"prepare.queue_time_us":29113,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":3168,"raft.queue_time_us":100504,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":21869,"spinlock_wait_cycles":32864384,"thread_start_us":400963,"threads_started":2,"wal-append.queue_time_us":277392}
I20260709 13:18:44.759378 19766 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:44.861418 18197 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:44.891548 19766 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.891604 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.892333 17597 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:44.775472 19793 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.863839 17522 rpcz_store.cc:276] 0709 13:18:43.356909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.030686 (+673777us) service_pool.cc:224] Handling call
0709 13:18:44.051595 (+ 20909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.211396 (+159801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.211418 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.211448 (+    30us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:44.211471 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.739476 (+528005us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54003c0ad4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:44.739525 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.739643 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367110912}
I20260709 13:18:44.888298 19771 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:18:44.867731 17452 rpcz_store.cc:276] 0709 13:18:41.863015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.416494 (+553479us) service_pool.cc:224] Handling call
0709 13:18:42.416865 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.417100 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.417139 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.417682 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.741153 (+323471us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:42.741193 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.741256 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.620855 (+1879599us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:44.744855 (+124000us) raft_consensus.cc:1685] finished
0709 13:18:44.744875 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.745082 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55992064,"thread_start_us":260486,"threads_started":1,"wal-append.queue_time_us":368597}
I20260709 13:18:44.899156 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.899775 17452 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:44.900722 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.846833 19675 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:44.865264 19489 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:44.870000 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:44.847394 19716 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:44.868925 19741 raft_consensus.cc:740] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:44.878119 19769 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:44.884718 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.886471 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.906147 19489 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.915683 19489 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.846632 19783 consensus_queue.cc:237] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.916348 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.862744 19815 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:44.857046 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:44.889580 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:44.889968 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:44.894265 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.919551 17447 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:44.894870 17568 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.884157 19826 consensus_queue.cc:237] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:44.895794 17446 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1255) took 2598 ms (client timeout 2033 ms). Trace:
I20260709 13:18:44.897522 19473 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:44.904009 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:44.904495 19811 log.cc:927] Time spent T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.735s	user 0.003s	sys 0.000s
I20260709 13:18:44.905357 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.907577 17449 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:44.854435 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:44.906066 19675 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:44.911659 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:44.913183 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1361) took 2394 ms. Trace:
I20260709 13:18:44.919778 17595 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:44.944041 17600 rpcz_store.cc:276] 0709 13:18:42.518398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.523696 (+  5298us) service_pool.cc:224] Handling call
0709 13:18:42.524112 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.216532 (+1692420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.912942 (+696410us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54003e8d54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:44.913125 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3886039808}
I20260709 13:18:44.921092 17568 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:44.928396 17452 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.946863 19838 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:44.947451 19838 raft_consensus.cc:697] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:44.947813 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:44.948323 19838 consensus_queue.cc:237] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.948984 17568 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.950342 19682 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:44.950770 19682 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.951112 19682 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.951426 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:44.953127 19698 consensus_queue.cc:1059] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:18:44.923408 17446 rpcz_store.cc:269] 0709 13:18:42.290972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.291794 (+   822us) service_pool.cc:224] Handling call
0709 13:18:44.889443 (+2597649us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54000d7ad4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:44.889541 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4659775232}
I20260709 13:18:44.953970 19698 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:44.954190 19705 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.954531 19698 raft_consensus.cc:697] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:44.955443 19698 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.956327 19670 raft_consensus.cc:3055] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:44.957094 19670 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:44.957891 19670 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.958962 19670 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:44.959393 17452 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:18:44.961124 17452 raft_consensus.cc:1217] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-7.4]   Dedup: 3.2->[5.3-7.4]
I20260709 13:18:44.961716 17452 pending_rounds.cc:85] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 2
I20260709 13:18:44.961485 19682 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.962211 17452 pending_rounds.cc:107] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:44.964332 17448 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:44.966316 17452 raft_consensus.cc:2889] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.966678 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1254) took 2687 ms. Trace:
I20260709 13:18:44.970803 17568 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.967018 17448 rpcz_store.cc:276] 0709 13:18:42.279180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.963586 (+2684406us) service_pool.cc:224] Handling call
0709 13:18:44.963905 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.966355 (+  2450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.966623 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:44.973203 17568 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:44.974799 17595 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:44.922933 19782 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.981302 17449 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:44.923977 19815 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:18:44.988083 19703 raft_consensus.cc:670] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:44.943974 19699 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.990924 17595 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 7. Ops: []
I20260709 13:18:44.984570 17568 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:44.997265 17447 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
W20260709 13:18:45.002581 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.011586 17596 raft_consensus.cc:1275] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:44.977730 19473 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.023767 18201 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:44.989310 19489 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:45.025638 17454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1595) took 1681 ms (client timeout 1734 ms). Trace:
W20260709 13:18:45.032955 17454 rpcz_store.cc:269] 0709 13:18:43.344716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.132453 (+787737us) service_pool.cc:224] Handling call
0709 13:18:45.021322 (+888869us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b5400215054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:45.025574 (+  4252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16453504}
I20260709 13:18:44.986133 19815 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:45.027760 17602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1137) took 1832 ms (client timeout 2313 ms). Trace:
W20260709 13:18:45.034463 17602 rpcz_store.cc:269] 0709 13:18:43.195470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.258928 (+ 63458us) service_pool.cc:224] Handling call
0709 13:18:45.027566 (+1768638us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b54003ea654. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:45.027699 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204629248}
I20260709 13:18:44.965298 19687 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:44.990188 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:44.998879 19705 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:44.991075 18194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42548 (request call id 268) took 1800 ms (client timeout 1974 ms). Trace:
W20260709 13:18:45.115280 19848 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:18:45.115983 17447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55872
I20260709 13:18:45.116590 17447 raft_consensus.cc:606] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:18:45.116883 17447 raft_consensus.cc:614] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:45.117311 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55872 (request call id 70) took 2572 ms. Trace:
I20260709 13:18:45.117620 17447 rpcz_store.cc:276] 0709 13:18:42.554591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.018084 (+2463493us) service_pool.cc:224] Handling call
0709 13:18:45.117216 (+ 99132us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:45.118916 19811 log.cc:927] Time spent T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:18:45.120618 17596 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:45.120712 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1583) took 2941 ms. Trace:
I20260709 13:18:45.018606 19771 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:45.020416 19607 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:45.121168 17451 rpcz_store.cc:276] 0709 13:18:42.179748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.250974 (+1071226us) service_pool.cc:224] Handling call
0709 13:18:43.251293 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.251503 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.251529 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.251946 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.728108 (+476162us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:43.861997 (+133889us) log.cc:844] Serialized 14 byte log entry
0709 13:18:44.153190 (+291193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.153269 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.900928 (+747659us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b18003a2940. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a472a6 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db
0709 13:18:44.903944 (+  3016us) spinlock_profiling.cc:243] Waited 7.29 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:45.120512 (+216568us) raft_consensus.cc:1685] finished
0709 13:18:45.120531 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.120657 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136386,"prepare.queue_time_us":133575,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":329093,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":31107584,"thread_start_us":521498,"threads_started":2,"wal-append.queue_time_us":822214}
W20260709 13:18:45.136204 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 127455us
I20260709 13:18:45.124119 19678 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:45.122313 18194 rpcz_store.cc:269] 0709 13:18:43.190833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.197141 (+  6308us) service_pool.cc:224] Handling call
0709 13:18:44.905198 (+1708057us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b5800003c98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:44.989476 (+ 84278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15633664}
I20260709 13:18:45.030366 19716 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.012557 19741 consensus_queue.cc:260] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.147727 19741 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:45.155424 17599 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:45.127548 19682 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:45.120064 19687 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:45.168287 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.133257 19670 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.126931 19489 raft_consensus.cc:697] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:45.188211 19670 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:45.191334 19777 log.cc:927] Time spent T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 2.558s	user 0.005s	sys 0.012s
I20260709 13:18:45.165062 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:45.163611 19699 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:45.220532 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.242944 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 245706us
I20260709 13:18:45.130504 19771 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.247565 17521 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:45.247768 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.248706 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.220989 19680 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:45.250160 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.295755 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 210) took 1964 ms. Trace:
I20260709 13:18:45.337841 17420 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:45.257956 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.369287 17520 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:45.278414 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.368016 17601 rpcz_store.cc:276] 0709 13:18:43.331080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.337581 (+1006501us) service_pool.cc:224] Handling call
0709 13:18:44.337917 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.458243 (+120326us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:44.899869 (+441626us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b18001f0f00. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a76455 00007f5ab955e3c7 00007f5ab5b709a7 00007f5ab5b800bf 00007f5ab5b80038
0709 13:18:44.976250 (+ 76381us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.235806 (+259556us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.243689 (+  7883us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.243843 (+   154us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:45.244091 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.244280 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.244356 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.289486 (+ 45130us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b18001f0f00. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a79522 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:45.295437 (+  5951us) raft_consensus.cc:1685] finished
0709 13:18:45.295471 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.295673 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100971,"prepare.queue_time_us":489768,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":105315,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":33494,"spinlock_wait_cycles":64284672,"thread_start_us":278426,"threads_started":2,"wal-append.queue_time_us":297694}
I20260709 13:18:45.372695 17525 raft_consensus.cc:2393] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:45.282349 19675 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:45.282562 19851 log.cc:927] Time spent T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:45.276341 19854 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:45.338508 19814 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:45.367127 19680 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.210855 19699 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.285583 19670 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:45.398463 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:45.338708 19759 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.369088 19660 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:45.389719 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:45.404819 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:45.438966 17450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1596) took 2094 ms (client timeout 1747 ms). Trace:
I20260709 13:18:45.407287 17520 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:45.439420 17450 rpcz_store.cc:269] 0709 13:18:43.345186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.202571 (+857385us) service_pool.cc:224] Handling call
0709 13:18:45.438795 (+1236224us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54002003d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:45.438884 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232191232}
I20260709 13:18:45.281493 19489 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.336550 19358 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:18:45.377298 19716 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.398677 17597 raft_consensus.cc:2955] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:45.413367 19759 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.400303 19815 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:45.415516 19648 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.246541 19766 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:45.422721 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.405622 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.276512 19843 raft_consensus.cc:2955] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:45.400146 19854 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.474077 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 153) took 1281 ms. Trace:
I20260709 13:18:45.607715 17568 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:45.443974 17529 raft_consensus.cc:2393] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:45.594936 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1368) took 2851 ms. Trace:
I20260709 13:18:45.467670 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1586) took 3246 ms. Trace:
W20260709 13:18:45.608632 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.603749 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.453030 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:45.408448 19680 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.610625 17527 raft_consensus.cc:2410] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:45.441388 17528 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:45.609349 17598 rpcz_store.cc:276] 0709 13:18:42.743562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.743983 (+   421us) service_pool.cc:224] Handling call
0709 13:18:42.744337 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.137232 (+1392895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.594542 (+1457310us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400328a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:45.594841 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3200753920}
I20260709 13:18:45.609289 17568 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:45.407964 19821 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.610385 17453 rpcz_store.cc:276] 0709 13:18:42.221451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.310710 (+2089259us) service_pool.cc:224] Handling call
0709 13:18:44.311118 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:44.311534 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.311565 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:44.312163 (+   598us) log.cc:844] Serialized 52 byte log entry
0709 13:18:44.462440 (+150277us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:44.483744 (+ 21304us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.316833 (+833089us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b18003a2880. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab29f3c0a 00007f5abc133219 00007f5ab2a7ba40 00007f5ab2a764e4 00007f5ab2a76455 00007f5ab5b5e060 00007f5ab5b70716 00007f5ab5b81287 00007f5ab5b81208
0709 13:18:45.317291 (+   458us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.465715 (+148424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.465831 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.465992 (+   161us) raft_consensus.cc:1685] finished
0709 13:18:45.466016 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.467566 (+  1550us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11675,"prepare.queue_time_us":21792,"prepare.run_cpu_time_us":175,"prepare.run_wall_time_us":174,"raft.queue_time_us":875216,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":245,"spinlock_wait_cycles":35258624,"thread_start_us":270148,"threads_started":2,"wal-append.queue_time_us":182679}
W20260709 13:18:45.615633 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 277907us
I20260709 13:18:45.618503 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:45.619170 17527 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:45.436255 19765 consensus_meta.cc:287] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.002s
I20260709 13:18:45.623246 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:45.623908 17529 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:45.626667 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:45.629808 17527 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:45.494442 19857 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.630798 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 177899us
I20260709 13:18:45.632045 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:45.636512 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:45.675707 18167 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:45.676282 17527 raft_consensus.cc:2393] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:45.633268 19854 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:45.602703 19746 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:45.407634 19814 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:45.633811 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:45.718604 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:45.565832 19793 consensus_meta.cc:287] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.665s	user 0.004s	sys 0.007s
I20260709 13:18:45.667382 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:45.608433 19822 consensus_meta.cc:287] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.000s
I20260709 13:18:45.677354 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:45.749024 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 124605us
I20260709 13:18:45.581347 19486 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.622563 19702 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:45.672209 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 54056.6us
I20260709 13:18:45.719746 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:45.759220 17527 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.623067 19670 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:45.622359 19682 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:45.737865 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:45.739631 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.768606 17522 raft_consensus.cc:2393] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:45.667722 19703 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:45.769567 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.744922 17529 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:45.636041 19801 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:45.758097 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:45.679203 19826 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:45.628649 19789 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.615185 19747 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
W20260709 13:18:45.762197 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 145090us
I20260709 13:18:45.500977 19607 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:45.771524 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.770402 17522 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:45.719009 19771 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:45.624807 19716 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.776575 17453 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:45.777948 17527 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:45.783691 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:45.779255 17568 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:45.636126 19765 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:45.778704 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:45.774732 19816 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.785202 17447 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.779234 18198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42538 (request call id 264) took 1221 ms. Trace:
I20260709 13:18:45.651186 19821 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.786624 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.787933 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:45.788599 17522 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:45.783377 17597 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:45.786625 18198 rpcz_store.cc:276] 0709 13:18:44.562549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.562759 (+   210us) service_pool.cc:224] Handling call
0709 13:18:45.737675 (+1174916us) spinlock_profiling.cc:243] Waited 945 us on lock 0x7b5800003c98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:45.779174 (+ 41499us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2174208}
I20260709 13:18:45.784606 17453 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.793332 17529 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:45.775473 19670 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.796275 19670 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:45.797003 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:45.797829 19765 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:45.799100 17419 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:45.799400 19709 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:45.800040 17419 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:45.803571 19821 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:45.804155 19821 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:45.804628 19821 raft_consensus.cc:697] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:45.804773 19657 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:45.804889 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.805372 19657 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.805783 17524 raft_consensus.cc:2410] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:45.805951 19657 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:45.806524 19861 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 13:18:45.807403 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.808145 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1144) took 1128 ms. Trace:
I20260709 13:18:45.808722 17521 raft_consensus.cc:1240] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:45.810616 19699 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:45.774830 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:45.775184 19801 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.812592 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:45.753422 19793 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:45.817956 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.808681 17595 rpcz_store.cc:276] 0709 13:18:44.680197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.992163 (+311966us) service_pool.cc:224] Handling call
0709 13:18:44.999419 (+  7256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.152560 (+153141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.152609 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.153243 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.342779 (+189536us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:45.385706 (+ 42927us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.386005 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.386156 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.801538 (+415382us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b18003a4f80. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:45.807772 (+  6234us) raft_consensus.cc:1685] finished
0709 13:18:45.807888 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.808064 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72401,"prepare.queue_time_us":43357,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2239,"raft.queue_time_us":18434,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":9634,"spinlock_wait_cycles":12340096,"thread_start_us":305417,"threads_started":2,"wal-append.queue_time_us":268438}
I20260709 13:18:45.829258 17529 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:18:45.822953 17447 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:45.823128 17522 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:45.783386 19607 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.805419 19821 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.839020 19759 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:45.843466 17520 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 7. Ops: []
I20260709 13:18:45.788967 19783 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:45.840976 17525 raft_consensus.cc:2410] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:45.846006 19783 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:45.851511 19783 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.852708 19783 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:45.830565 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 51378.1us
I20260709 13:18:45.829939 17453 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:45.854271 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:45.845299 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:45.855413 17447 raft_consensus.cc:2368] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:45.855520 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:45.856403 17453 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:45.829663 17419 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:45.857231 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:45.857244 19759 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:45.858913 17419 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:45.859043 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.859441 19759 consensus_queue.cc:1059] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:45.861099 19769 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:45.861217 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.861521 19769 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.861912 19769 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:45.866010 17568 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:45.866667 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.722383 19857 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.867225 17522 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:45.783927 19789 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.881158 19865 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:45.881373 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:45.882916 19789 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:45.840780 19785 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:45.825419 19736 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:45.757187 19822 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.884021 19736 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.885581 19822 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:45.838325 19838 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:45.608325 17448 rpcz_store.cc:276] 0709 13:18:44.192366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.972962 (+780596us) service_pool.cc:224] Handling call
0709 13:18:44.973298 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.973495 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:44.985165 (+ 11670us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.473637 (+488472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:45.473693 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:45.473745 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.473815 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.473949 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":314644,"prepare.queue_time_us":15138,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":455249,"thread_start_us":173414,"threads_started":1,"wal-append.queue_time_us":279948}
I20260709 13:18:45.794234 19816 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.880592 19766 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:45.886425 19736 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:45.783056 19863 consensus_queue.cc:1059] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:18:45.887238 17595 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:45.888231 19857 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:45.888612 19793 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:45.888252 19868 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:45.889436 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:45.948917 17601 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:45.889853 19814 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:45.890647 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:45.955874 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:45.891821 19864 log.cc:927] Time spent T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
I20260709 13:18:45.892222 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:45.894451 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:45.958595 17602 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:45.829641 19801 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:45.897091 19687 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:45.919319 19838 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:45.974722 19838 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.970798 19868 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:45.977089 19826 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:45.785622 19824 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:18:45.899583 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.896355 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:45.900447 17453 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:45.902374 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.906174 19785 consensus_queue.cc:1059] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:45.907337 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:45.907876 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:45.901902 17450 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
W20260709 13:18:45.919631 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.987753 17495 leader_election.cc:336] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.535s (SENT)
I20260709 13:18:45.988363 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:45.985875 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:45.919708 17568 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:45.890884 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:45.881742 19865 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:45.897756 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:45.977896 18193 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:46.029531 17603 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:46.003167 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.034650 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:18:46.035511 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 47804.7us
W20260709 13:18:46.046893 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 91086.4us
I20260709 13:18:46.047111 18198 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.047746 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:46.032678 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:46.048985 17447 raft_consensus.cc:2376] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6. Re-sending same reply.
W20260709 13:18:46.047963 17495 leader_election.cc:336] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.665s (SENT)
W20260709 13:18:45.985831 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 89134.6us
I20260709 13:18:46.050220 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:46.011919 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.057721 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:46.033432 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.059201 17602 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:46.061825 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.062489 17601 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
W20260709 13:18:46.064916 17495 leader_election.cc:336] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.814s (SENT)
I20260709 13:18:46.065582 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:46.045517 17448 raft_consensus.cc:2376] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5. Re-sending same reply.
I20260709 13:18:46.067432 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.072265 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.092163 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.092494 17569 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:46.093303 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.093808 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:46.094395 19716 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:46.068133 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 148501us
I20260709 13:18:46.097321 17599 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:46.070353 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:46.088865 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.067648 19687 raft_consensus.cc:697] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:46.066969 19699 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.090216 19747 raft_consensus.cc:3055] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:46.072598 19824 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.079087 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.069092 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.107363 17448 raft_consensus.cc:2376] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5. Re-sending same reply.
I20260709 13:18:46.108210 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.094873 19816 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:46.095017 19716 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.095041 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.115317 17450 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:46.116550 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:46.117982 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.075961 19665 consensus_queue.cc:1059] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:46.096520 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:46.115334 17448 raft_consensus.cc:2410] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:46.101533 19709 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:46.066653 17453 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:46.096395 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.060914 19812 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.144747 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:46.006454 19863 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.071669 19864 log.cc:927] Time spent T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:18:46.100917 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:46.106737 19747 raft_consensus.cc:740] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:46.078132 19670 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:46.098430 19857 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:46.118008 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.096496 19868 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:46.129573 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.028213 19789 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.103734 19358 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.143323 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.098783 17569 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:46.111842 19865 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:46.166990 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.167969 17450 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:46.169181 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.104298 17599 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:46.151925 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:46.153494 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 52669.1us
I20260709 13:18:46.161816 17447 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:46.171003 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:46.170008 17450 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:46.171886 17522 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.171240 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:46.175875 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:46.176931 17529 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
W20260709 13:18:46.166703 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.142850 19783 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:46.132066 19840 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.179703 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:46.133069 19709 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:18:46.184046 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 85337.6us
I20260709 13:18:46.125916 19648 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:18:46.206913 17599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "810ba5585281416bb8f23e88267d049b"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:18:46.207876 17599 raft_consensus.cc:606] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:46.208357 17599 raft_consensus.cc:614] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:46.187855 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.209728 17450 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:46.150703 19665 raft_consensus.cc:3055] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:46.161238 19759 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:46.187737 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:46.193724 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:46.194389 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:46.192152 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:46.162441 19857 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:46.226189 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:46.226986 17527 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:46.222397 17451 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.226119 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:46.229224 17447 raft_consensus.cc:2376] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7. Re-sending same reply.
I20260709 13:18:46.230728 17527 raft_consensus.cc:3055] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:46.231457 17527 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:46.233713 17527 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.235510 17522 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:46.236279 17527 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.203660 19709 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.191763 19865 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:46.249364 19857 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.252036 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:46.233506 17568 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:46.186447 19873 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.260717 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.187579 19741 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:46.220176 19871 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.082s	user 0.003s	sys 0.002s
I20260709 13:18:46.152966 19863 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:46.274343 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 184773us
I20260709 13:18:46.278998 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:46.279385 17527 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:46.209187 19783 raft_consensus.cc:697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:46.183290 19766 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:18:46.226097 19759 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:46.281320 17522 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:46.215947 19665 raft_consensus.cc:740] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:46.283864 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:46.296509 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:46.217615 19789 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.302536 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.294471 17451 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:46.304277 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.305058 17451 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:18:46.260174 19785 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:46.306267 19785 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:46.306864 19785 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.267383 19868 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:46.309804 18198 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:46.313212 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.192265 19687 consensus_queue.cc:237] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.318269 17451 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:46.321620 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:46.261094 19769 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.331396 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.316310 19812 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:18:46.328521 19665 consensus_queue.cc:260] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.311829 19702 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.299643 19759 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:46.317569 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 146364us
I20260709 13:18:46.204610 19840 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:18:46.316843 19874 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.179s	user 0.004s	sys 0.001s
I20260709 13:18:46.281571 19741 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.337548 19765 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:46.380755 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 146018us
I20260709 13:18:46.382328 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:46.344129 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:46.315467 19868 raft_consensus.cc:697] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:46.262228 19747 consensus_queue.cc:260] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:46.276177 19873 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:46.317129 19801 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.427043 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1591) took 4173 ms. Trace:
W20260709 13:18:46.403071 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 59074.1us
I20260709 13:18:46.431612 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.330456 19833 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:18:46.394466 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:46.439026 19680 consensus_meta.cc:287] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.803s	user 0.011s	sys 0.000s
W20260709 13:18:46.439193 19878 log.cc:927] Time spent T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:18:46.439373 19657 consensus_meta.cc:287] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.000s
I20260709 13:18:46.439666 19680 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:46.439920 19657 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.440196 19868 consensus_queue.cc:237] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.441016 17521 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:46.348119 19702 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.393405 19665 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.442826 19863 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:46.429944 17452 rpcz_store.cc:276] 0709 13:18:42.279263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.960376 (+2681113us) service_pool.cc:224] Handling call
0709 13:18:44.960845 (+   469us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:45.472992 (+512147us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:45.473354 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.622491 (+149137us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:45.637619 (+ 15128us) log.cc:844] Serialized 52 byte log entry
0709 13:18:45.637792 (+   173us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:45.671071 (+ 33279us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.671415 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.671578 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.671659 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.891312 (+219653us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:46.338878 (+447566us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b1800339040. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:46.426760 (+ 87882us) raft_consensus.cc:1685] finished
0709 13:18:46.426787 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.426963 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":587870,"prepare.queue_time_us":110562,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":127,"raft.queue_time_us":557229,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":7947,"spinlock_wait_cycles":60291072,"thread_start_us":99686,"threads_started":1,"wal-append.queue_time_us":273441}
I20260709 13:18:46.381651 19765 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.449543 17448 raft_consensus.cc:2368] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7.
I20260709 13:18:46.430647 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:46.451675 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:46.452862 19747 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.458189 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:46.429395 19892 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:46.462494 17446 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.016s
W20260709 13:18:46.463200 17446 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.000s	sys 0.016s
I20260709 13:18:46.453722 19765 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.443140 19702 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:46.464381 17452 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:46.350656 19783 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.460331 17569 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:46.470650 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1600) took 2099 ms. Trace:
I20260709 13:18:46.472129 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:46.473444 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.475113 17449 rpcz_store.cc:276] 0709 13:18:44.371010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.986189 (+615179us) service_pool.cc:224] Handling call
0709 13:18:44.986421 (+   232us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:45.614120 (+627699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.614148 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:45.614695 (+   547us) log.cc:844] Serialized 52 byte log entry
0709 13:18:46.099380 (+484685us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:46.194493 (+ 95113us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.469891 (+275398us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.470150 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.470259 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.470333 (+    74us) raft_consensus.cc:1685] finished
0709 13:18:46.470354 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.470567 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":540988,"prepare.queue_time_us":232278,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":715951,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":24568,"spinlock_wait_cycles":41344,"thread_start_us":739404,"threads_started":3,"wal-append.queue_time_us":484278}
I20260709 13:18:46.467185 19865 raft_consensus.cc:697] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:46.459827 19789 raft_consensus.cc:2764] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:46.481052 17449 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:46.484290 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:46.464956 19813 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:46.485948 17447 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:46.463793 19526 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:46.488435 17452 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:46.475071 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1589) took 4232 ms. Trace:
I20260709 13:18:46.500702 17446 rpcz_store.cc:276] 0709 13:18:42.242734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.954067 (+2711333us) service_pool.cc:224] Handling call
0709 13:18:44.954493 (+   426us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:45.472714 (+518221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.472759 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:45.616330 (+143571us) log.cc:844] Serialized 52 byte log entry
0709 13:18:45.847110 (+230780us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:46.463594 (+616484us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.466275 (+  2681us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.474710 (+  8435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.474790 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.474849 (+    59us) raft_consensus.cc:1685] finished
0709 13:18:46.474863 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.475012 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":529040,"prepare.queue_time_us":437113,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":3865,"raft.queue_time_us":530738,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":16207,"spinlock_wait_cycles":26673408,"thread_start_us":701055,"threads_started":2,"wal-append.queue_time_us":222537}
W20260709 13:18:46.488526 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 192083us
I20260709 13:18:46.510232 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:46.486088 19702 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.478700 19890 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.511682 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:46.478111 19821 consensus_queue.cc:1059] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:18:46.514181 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:46.518798 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:46.512575 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 279099us
I20260709 13:18:46.513417 17452 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:46.520295 19812 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:46.497305 19863 consensus_queue.cc:1059] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:18:46.529147 19812 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:46.529758 19812 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.512148 19893 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.520881 19898 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.531615 19657 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:46.543624 19657 raft_consensus.cc:3055] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:46.544018 19657 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:18:46.545193 19607 consensus_meta.cc:287] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.681s	user 0.006s	sys 0.009s
W20260709 13:18:46.545459 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.545218 19865 consensus_queue.cc:237] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.520413 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:46.505549 19892 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:18:46.535230 19901 raft_consensus.cc:3055] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:46.536082 19801 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:46.525542 19769 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:46.538332 17568 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:46.518294 17446 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:46.517360 19526 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:46.528789 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:46.581373 17452 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.541800 18198 raft_consensus.cc:1240] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:46.550278 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:46.532968 19857 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.552078 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.552332 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:46.522614 19705 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:46.590917 19705 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:46.591320 19705 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.552997 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.594961 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.553836 19900 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:46.596072 17601 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:46.596356 19900 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:46.596876 19900 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.597195 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.554487 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:46.554853 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:46.598349 17597 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.599398 17523 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:46.599900 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.544791 19657 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.600261 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1324) took 1162 ms. Trace:
I20260709 13:18:46.600711 17523 rpcz_store.cc:276] 0709 13:18:45.437772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.437974 (+   202us) service_pool.cc:224] Handling call
0709 13:18:46.598910 (+1160936us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b58000f5a98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab3ffc0 00007f5abab2a929 00007f5abab2a3d2 00007f5ab40a1bd4
0709 13:18:46.599121 (+   211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.599873 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.600197 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8283520}
I20260709 13:18:46.525720 19885 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:18:46.596065 19840 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:46.520828 19873 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:46.548959 17495 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:46.603035 17569 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:46.603611 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 54742.8us
I20260709 13:18:46.604318 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:46.604761 19822 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:46.605659 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 67441.5us
I20260709 13:18:46.606015 17597 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:46.607046 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.608074 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.608588 17597 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:46.609329 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.563908 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.612454 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:46.613818 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:46.614993 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:46.615610 17529 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:46.625557 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.631711 17523 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:46.565320 19901 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:46.582688 17594 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.564590 19741 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:46.545748 19607 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:46.583364 19526 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:46.589802 19857 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:46.590386 17602 raft_consensus.cc:2393] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:46.554222 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.573619 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:46.580307 19891 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:46.636044 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:46.719574 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.751291 17600 raft_consensus.cc:2410] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:46.711647 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:46.705732 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.752637 17449 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
W20260709 13:18:46.753070 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 179554us
I20260709 13:18:46.753798 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:46.754191 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 149013us
I20260709 13:18:46.665638 17523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:46.641515 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.871107 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1275) took 1060 ms. Trace:
I20260709 13:18:46.797557 17420 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:46.794690 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:46.872349 17447 raft_consensus.cc:2376] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5. Re-sending same reply.
I20260709 13:18:46.754561 17449 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:46.880509 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 83061.4us
I20260709 13:18:46.923161 17528 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:47.055852 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:47.120326 17528 pending_rounds.cc:85] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 2
I20260709 13:18:47.120462 17420 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:47.120828 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:46.920297 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1269) took 1113 ms. Trace:
W20260709 13:18:47.034938 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 279960us
I20260709 13:18:46.912145 17594 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:46.795899 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:47.072158 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1333) took 1270 ms. Trace:
I20260709 13:18:47.124266 17594 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 7. Ops: []
W20260709 13:18:46.702378 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.810052 17452 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
I20260709 13:18:47.123044 17420 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:46.919201 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.974781 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:47.126504 17420 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:46.921165 17525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1657) took 1317 ms (client timeout 1506 ms). Trace:
I20260709 13:18:46.935036 17569 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:47.127909 17525 rpcz_store.cc:269] 0709 13:18:45.603792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.613137 (+  9345us) service_pool.cc:224] Handling call
0709 13:18:46.920883 (+1307746us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54003412d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:46.921062 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258596096}
W20260709 13:18:47.128885 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 193962us
I20260709 13:18:47.130046 19660 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.630848 19885 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:46.639994 19716 consensus_meta.cc:287] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.004s
W20260709 13:18:46.808861 19709 consensus_meta.cc:287] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.002s
W20260709 13:18:46.857506 19759 consensus_meta.cc:287] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.001s
I20260709 13:18:46.939651 17527 raft_consensus.cc:1240] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:47.120927 17528 pending_rounds.cc:107] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 13:18:47.151476 17526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 1322) took 1744 ms (client timeout 1995 ms). Trace:
W20260709 13:18:47.015177 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 59818.8us
W20260709 13:18:47.152751 17526 rpcz_store.cc:269] 0709 13:18:45.406974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.410178 (+  3204us) service_pool.cc:224] Handling call
0709 13:18:46.974588 (+1564410us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b58000f5a98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:47.151414 (+176826us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4631936}
I20260709 13:18:47.152850 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:47.072865 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1587) took 4835 ms. Trace:
I20260709 13:18:47.151945 17528 raft_consensus.cc:2889] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:47.124042 17524 rpcz_store.cc:276] 0709 13:18:45.801636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.806538 (+  4902us) service_pool.cc:224] Handling call
0709 13:18:45.813919 (+  7381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.814124 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.814148 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:45.814186 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:45.814215 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.814373 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.071973 (+1257600us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b540013a950. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:47.072092 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16276736}
W20260709 13:18:46.879644 19785 consensus_meta.cc:287] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.572s	user 0.019s	sys 0.000s
I20260709 13:18:46.975986 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1331) took 1363 ms. Trace:
I20260709 13:18:47.174860 17520 rpcz_store.cc:276] 0709 13:18:45.612204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.803596 (+191392us) service_pool.cc:224] Handling call
0709 13:18:45.843291 (+ 39695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.848748 (+  5457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.975741 (+1126993us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b5400090950. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:46.975917 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90631424}
I20260709 13:18:46.904138 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.879390 17523 raft_consensus.cc:606] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:47.133469 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.176935 17523 raft_consensus.cc:614] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:46.783254 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:46.872154 19526 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.122184 17453 rpcz_store.cc:276] 0709 13:18:45.806847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.856994 (+ 50147us) service_pool.cc:224] Handling call
0709 13:18:46.920047 (+1063053us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b54000dc5d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:46.920218 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97910144}
I20260709 13:18:47.168927 17527 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.750617 19891 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:47.187108 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.809202 19793 consensus_queue.cc:1059] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.375s
I20260709 13:18:46.800613 19741 consensus_queue.cc:1059] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.387s
I20260709 13:18:46.905686 19822 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:46.630438 19898 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:47.150621 19892 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:47.178234 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:46.872174 17448 rpcz_store.cc:276] 0709 13:18:45.810572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.129118 (+318546us) service_pool.cc:224] Handling call
0709 13:18:46.828076 (+698958us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54000d7ad4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:46.871001 (+ 42925us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":670053120}
I20260709 13:18:47.193011 17526 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.773607 19863 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:47.182122 17495 leader_election.cc:336] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.874s (SENT)
I20260709 13:18:47.193378 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:47.193953 17448 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.154352 19868 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:46.899358 18197 raft_consensus.cc:1240] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:46.897396 19702 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.977653 19769 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.185057 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:47.207374 17453 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:47.212476 17526 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:18:47.185189 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:47.214128 17526 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:46.919612 19901 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.184528 19785 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.827219 19812 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:46.881907 19766 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:47.187265 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:47.187377 19922 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:46.953226 19626 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:46.797160 19895 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:47.073939 18193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42548 (request call id 277) took 1340 ms. Trace:
I20260709 13:18:47.067142 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:47.188838 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 62417.8us
I20260709 13:18:47.189235 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:46.905566 19903 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:47.237596 17601 raft_consensus.cc:1240] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:46.917476 19911 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:47.156334 17445 rpcz_store.cc:276] 0709 13:18:42.237789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.313688 (+2075899us) service_pool.cc:224] Handling call
0709 13:18:44.326513 (+ 12825us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.464594 (+138081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.464623 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.480838 (+ 16215us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.623409 (+142571us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18003a2820. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab57060d1 00007f5ab5b21a0f
0709 13:18:44.860544 (+237135us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:44.870478 (+  9934us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.610975 (+740497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.072558 (+1461583us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540036a954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:47.072610 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.072654 (+    44us) raft_consensus.cc:1685] finished
0709 13:18:47.072671 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.072799 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1441233,"prepare.queue_time_us":9783,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":632328,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":9917,"spinlock_wait_cycles":267486336,"thread_start_us":236535,"threads_started":1,"wal-append.queue_time_us":364774,"wal-append.run_cpu_time_us":2752,"wal-append.run_wall_time_us":1088265}
W20260709 13:18:46.717064 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.240047 17568 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:46.739058 19813 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:47.190642 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:46.911141 19607 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:47.194474 17495 leader_election.cc:336] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.926s (SENT)
W20260709 13:18:47.243165 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.242944 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:46.764611 19913 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:46.776464 19705 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:47.154930 19716 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:47.247603 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:46.630646 19893 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.558s
I20260709 13:18:47.234836 19901 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:47.019918 19821 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.173s
I20260709 13:18:46.927599 19900 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:47.179268 19885 raft_consensus.cc:697] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:46.916052 19765 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.188446 19793 raft_consensus.cc:3055] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:47.219769 17453 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:18:47.261178 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:47.220341 19769 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.155431 19759 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.196280 19868 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.155256 19709 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:47.289229 19759 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:47.282174 19898 raft_consensus.cc:697] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:47.233891 19895 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.234890 17420 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:47.291007 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 56393.9us
I20260709 13:18:47.291164 19785 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:47.235389 17525 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:47.290601 19898 consensus_queue.cc:237] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.291802 17420 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:47.228626 19923 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.292346 19895 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:47.246202 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:47.192519 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:47.259054 19910 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:47.295184 17599 raft_consensus.cc:2393] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:47.295928 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:47.205473 17527 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:47.297065 17598 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:47.262440 19793 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:47.298981 17527 raft_consensus.cc:1240] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:47.248790 17597 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:47.249145 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 54723.5us
I20260709 13:18:47.250294 17594 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:47.251935 19772 raft_consensus.cc:1068] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Unable to promote non-voter 2158c0f750fd4b21afe24135c52167b2: Illegal state: Replica ddfe9cca0741489b994f8b0178c54fe7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:47.252200 19705 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:47.301260 17495 leader_election.cc:336] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.980s (SENT)
I20260709 13:18:47.247706 19913 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:47.256160 19920 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:18:47.257377 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 67747.4us
I20260709 13:18:47.233968 19922 raft_consensus.cc:697] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:47.261951 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:47.228848 17523 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:47.307912 17453 raft_consensus.cc:2410] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:18:47.269987 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 96712.6us
I20260709 13:18:47.231235 19892 consensus_queue.cc:1059] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:18:47.244846 19486 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.232223 19766 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.313908 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:47.281675 17568 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:47.282312 19812 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:47.233752 19626 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.261198 18199 raft_consensus.cc:1240] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:47.323189 19766 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:47.232713 18193 rpcz_store.cc:276] 0709 13:18:45.733884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.747197 (+ 13313us) service_pool.cc:224] Handling call
0709 13:18:45.792938 (+ 45741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.067987 (+275049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.073655 (+1005668us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54004a4a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:47.073876 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381287296}
I20260709 13:18:47.285136 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:47.286375 19868 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.307240 19913 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.290016 19709 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:47.195973 19822 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:47.332039 19822 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:47.293874 17520 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:47.248335 17600 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:47.292424 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:47.292896 19923 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.294329 17529 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:47.244556 19813 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:47.301864 17594 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:47.297437 19821 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:47.339016 19821 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.339425 19821 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.341336 17451 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:47.342259 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1299) took 1480 ms. Trace:
I20260709 13:18:47.342605 17451 rpcz_store.cc:276] 0709 13:18:45.862343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.340897 (+1478554us) service_pool.cc:224] Handling call
0709 13:18:47.341182 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.341995 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.342202 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:47.302409 17495 leader_election.cc:336] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 2.000s (SENT)
I20260709 13:18:47.303542 19769 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:47.263845 18195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42536 (request call id 174) took 1351 ms. Trace:
I20260709 13:18:47.306408 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:47.309383 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:47.312510 19922 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.244763 19903 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:47.296558 19759 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:47.345294 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.346596 17453 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:47.368922 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1298) took 1506 ms. Trace:
I20260709 13:18:47.327368 19793 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.326016 19900 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:47.326537 19626 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:47.349568 17520 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:47.283211 19925 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:47.328687 19486 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.351677 19765 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:47.306871 19741 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.352415 19923 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:47.326411 19885 consensus_queue.cc:237] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.389407 19793 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:47.359549 17448 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:18:47.361626 17597 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:47.366357 17451 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:47.440402 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1300) took 1577 ms. Trace:
I20260709 13:18:47.440881 17451 rpcz_store.cc:276] 0709 13:18:45.862609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.344108 (+1481499us) service_pool.cc:224] Handling call
0709 13:18:47.361167 (+ 17059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.440051 (+ 78884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.440316 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.366398 17445 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:47.369269 17453 rpcz_store.cc:276] 0709 13:18:45.862005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.324576 (+1462571us) service_pool.cc:224] Handling call
0709 13:18:47.346414 (+ 21838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.368601 (+ 22187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.368858 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:47.372817 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 58975.3us
I20260709 13:18:47.312685 19920 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:47.372351 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 90728.9us
W20260709 13:18:47.356665 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.435206 19526 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:47.447117 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.457710 17451 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:47.381851 19930 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:47.360945 18195 rpcz_store.cc:276] 0709 13:18:45.910450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.911244 (+   794us) service_pool.cc:224] Handling call
0709 13:18:47.066952 (+1155708us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5800003c98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:47.261504 (+194552us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46806912}
I20260709 13:18:47.465233 17453 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:47.537108 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1629) took 1018 ms. Trace:
I20260709 13:18:47.537571 17453 rpcz_store.cc:276] 0709 13:18:46.518885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.442771 (+923886us) service_pool.cc:224] Handling call
0709 13:18:47.464751 (+ 21980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.536733 (+ 71982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.537032 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.463661 19705 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:18:47.471782 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.474143 19754 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:47.445254 19709 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:47.637283 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:47.664415 19670 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:47.665234 19670 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:47.560078 19486 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:47.686949 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1626) took 1173 ms. Trace:
I20260709 13:18:47.687163 17522 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:18:47.687512 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 244281us
W20260709 13:18:47.688381 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 313609us
I20260709 13:18:47.689168 19900 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:47.692780 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:47.694730 19900 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:47.689495 19702 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.696817 19702 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.697607 19900 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:47.689827 19626 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:47.698913 19900 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:47.700529 19626 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.702723 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:47.703555 19900 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:47.704268 19900 raft_consensus.cc:697] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:47.704984 19702 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:47.705273 19900 consensus_queue.cc:237] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.694576 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:47.705024 17520 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:47.691978 19657 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:47.693902 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:47.709604 17453 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:47.711283 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.693320 17451 rpcz_store.cc:276] 0709 13:18:46.513351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.441993 (+928642us) service_pool.cc:224] Handling call
0709 13:18:47.457156 (+ 15163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.458392 (+  1236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.686887 (+228495us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.709470 19626 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:47.560737 19928 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:47.712638 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:47.541713 19913 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.718278 19923 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:47.718503 17526 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:47.714164 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:47.718719 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.720081 17453 raft_consensus.cc:2376] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6. Re-sending same reply.
I20260709 13:18:47.716024 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:47.721570 17451 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:47.723678 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:47.726639 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:47.635205 19813 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.727784 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:47.730585 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:47.731254 17522 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:47.559002 19754 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.718732 19486 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:47.736604 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 380551us
I20260709 13:18:47.735407 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:47.718832 19923 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:47.718235 19626 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:47.750664 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:47.750664 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:47.729447 19812 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:47.725515 19896 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:47.753232 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:47.757143 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.738480 19772 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:47.738369 19916 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:47.772027 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:47.751040 19923 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:47.776664 17453 raft_consensus.cc:2376] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7. Re-sending same reply.
I20260709 13:18:47.722774 19928 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.773432 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:47.778076 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:47.787304 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:47.788559 17522 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:47.770617 19772 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:47.757439 19486 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:47.797506 19670 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:47.800873 19682 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.801471 19682 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.802456 19815 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:47.780695 19917 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:47.800050 19772 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.793509 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:47.754456 19903 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:47.739188 19868 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.827243 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:47.807243 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:47.806207 17522 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
W20260709 13:18:47.831203 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.780853 19916 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:47.830188 19917 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:47.843609 19916 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:47.848047 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 110100us
I20260709 13:18:47.845573 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:47.841542 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:47.863449 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:47.763130 19626 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:47.774896 19896 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:47.887385 17600 raft_consensus.cc:1240] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:47.825233 19526 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:47.889056 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:47.837687 19933 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.891237 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1636) took 1347 ms. Trace:
I20260709 13:18:47.840628 19486 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:47.894905 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 387278us
I20260709 13:18:47.860060 19919 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 13:18:47.867537 19670 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:47.977100 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.978557 17453 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:47.895968 17445 rpcz_store.cc:276] 0709 13:18:46.544185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.445131 (+900946us) service_pool.cc:224] Handling call
0709 13:18:47.461831 (+ 16700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.462153 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:47.669906 (+207753us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.890871 (+220965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.890926 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:47.890975 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.891049 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.891176 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":281931,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":1817,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":42255,"thread_start_us":349133,"threads_started":2}
I20260709 13:18:47.986900 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1637) took 1435 ms. Trace:
I20260709 13:18:47.894502 19929 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.972621 19754 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:47.980165 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 116840us
I20260709 13:18:47.989080 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:47.866650 19903 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:18:47.987627 17453 rpcz_store.cc:276] 0709 13:18:46.551114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.913084 (+1361970us) service_pool.cc:224] Handling call
0709 13:18:47.973810 (+ 60726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.986632 (+ 12822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.986835 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.889884 19917 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:47.977491 19526 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:48.003345 19937 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:18:48.003482 19928 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.004989 19896 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:47.976778 19945 consensus_queue.cc:1059] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 13:18:48.006428 19945 raft_consensus.cc:3055] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:48.006780 19945 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:48.008015 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1308) took 1227 ms. Trace:
I20260709 13:18:48.007675 19945 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:48.008381 17453 rpcz_store.cc:276] 0709 13:18:46.780415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.998525 (+1218110us) service_pool.cc:224] Handling call
0709 13:18:48.007361 (+  8836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.007665 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:48.007695 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.007739 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:48.007775 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.007835 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.007951 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:48.009004 19940 log.cc:927] Time spent T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:18:47.991971 19885 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.010104 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1642) took 1153 ms. Trace:
I20260709 13:18:48.010455 17453 rpcz_store.cc:276] 0709 13:18:46.857043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.009300 (+1152257us) service_pool.cc:224] Handling call
0709 13:18:48.009603 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.009762 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.009782 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.009818 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:48.009850 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.009913 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.010052 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:48.011488 19942 log.cc:927] Time spent T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:18:47.977850 19913 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:48.017095 19793 consensus_meta.cc:287] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.571s	user 0.005s	sys 0.003s
I20260709 13:18:48.017123 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.023183 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:48.023728 17597 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:48.009083 19741 consensus_meta.cc:287] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.001s
I20260709 13:18:47.896214 19486 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.895454 19920 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:48.029114 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.997128 19670 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:48.024940 19913 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:48.045696 19821 consensus_meta.cc:287] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.706s	user 0.004s	sys 0.009s
I20260709 13:18:47.891853 19916 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.021718 19928 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:48.046099 19741 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:48.059888 17597 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:48.009838 19885 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.050474 19670 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.062438 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:48.063633 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:48.062937 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.021065 19526 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:48.054234 19813 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:48.049461 19793 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:18:48.047700 19486 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.084438 19486 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.059240 19821 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.087702 17448 raft_consensus.cc:1240] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:48.088014 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1673) took 1919 ms. Trace:
I20260709 13:18:48.088881 17449 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:48.088433 17528 rpcz_store.cc:276] 0709 13:18:46.168961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.170161 (+  1200us) service_pool.cc:224] Handling call
0709 13:18:46.922817 (+752656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.159215 (+236398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.087791 (+928576us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b54003412d0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:48.087949 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1730005248}
I20260709 13:18:48.000090 19929 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.089524 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1301) took 2226 ms. Trace:
I20260709 13:18:48.089920 17448 rpcz_store.cc:276] 0709 13:18:45.862951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.445463 (+1582512us) service_pool.cc:224] Handling call
0709 13:18:47.445869 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.088091 (+642222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.089294 (+  1203us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b5400369554. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:48.089470 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1475583360}
I20260709 13:18:48.091490 17448 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:48.069638 19741 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:48.122618 17449 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:48.077919 19772 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.104039 19955 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:48.128919 19812 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:48.129359 19772 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.064493 19951 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:18:48.095104 19920 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:48.111231 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:48.112157 19680 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:48.101172 19868 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:48.062227 19913 consensus_queue.cc:1059] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:18:47.936420 19933 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.099620 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:48.126609 19949 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.061990 19928 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.079018 19919 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:48.194787 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1335) took 2392 ms. Trace:
W20260709 13:18:48.166378 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.197007 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1346) took 1255 ms. Trace:
I20260709 13:18:48.189035 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:48.170974 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.232980 17521 rpcz_store.cc:276] 0709 13:18:45.802498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.809617 (+  7119us) service_pool.cc:224] Handling call
0709 13:18:45.809922 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.441404 (+631482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.194475 (+1753071us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54002319d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:48.194712 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450724096}
W20260709 13:18:48.175035 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 111496us
I20260709 13:18:48.233774 17523 rpcz_store.cc:276] 0709 13:18:46.941187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.214830 (+273643us) service_pool.cc:224] Handling call
0709 13:18:47.215107 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.307720 (+ 92613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.196684 (+888964us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b54000ff354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:48.196935 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31128448}
I20260709 13:18:48.188406 17419 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:48.236169 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.236847 17520 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:48.131747 17350 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 96) took 12744 ms (client timeout 15000 ms). Trace:
I20260709 13:18:48.237699 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:48.239022 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.239800 17520 raft_consensus.cc:2410] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:18:48.241257 19889 log.cc:927] Time spent T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 1.754s	user 0.007s	sys 0.010s
I20260709 13:18:48.242780 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.243206 18167 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:48.244959 17520 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:18:48.189303 17400 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0480cf54c3cc424ab94b963ef2ff5bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:18:48.249435 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 61120.3us
W20260709 13:18:48.168653 19953 log.cc:927] Time spent T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:18:48.175211 19526 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:48.267839 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:48.195768 19748 raft_consensus.cc:3055] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:48.270256 19748 raft_consensus.cc:740] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:18:48.265374 17400 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:18:48.272320 17520 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:48.272367 17419 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:48.272842 17520 pending_rounds.cc:85] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 2
I20260709 13:18:48.273105 17520 pending_rounds.cc:107] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:18:48.273285 17520 raft_consensus.cc:2889] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:48.265604 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.243383 17523 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:48.132669 19929 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.275360 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.275974 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.278092 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:48.278484 17597 raft_consensus.cc:2393] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 3: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:48.179030 19916 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.168128 19813 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:48.276815 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:48.165277 19657 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.279093 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:48.282280 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.175285 19885 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.135548 19741 raft_consensus.cc:697] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:48.285722 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:48.291673 17521 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:48.292078 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:48.271438 17400 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:18:48.265316 19843 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:48.282516 19748 consensus_queue.cc:260] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:48.296826 19748 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:48.271035 19890 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:48.165299 19923 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:48.237679 17350 rpcz_store.cc:269] 0709 13:18:35.386871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.387024 (+   153us) service_pool.cc:224] Handling call
0709 13:18:48.131655 (+12744631us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:40.576500 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:40.602941 (+ 26441us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:40.602994 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:18:40.603014 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:40.604135 (+  1121us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:40.604232 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:40.604258 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:18:40.604960 (+   702us) tablet.cc:701] Row locks acquired
0709 13:18:40.605009 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:18:40.605173 (+   164us) write_op.cc:270] Start()
0709 13:18:40.605309 (+   136us) write_op.cc:276] Timestamp: P: 1783603120605107 usec, L: 0
0709 13:18:40.605328 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:40.617051 (+ 11723us) log.cc:844] Serialized 3281 byte log entry
0709 13:18:41.378375 (+761324us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:41.662368 (+283993us) op_driver.cc:464] REPLICATION: finished
0709 13:18:42.093707 (+431339us) write_op.cc:301] APPLY: starting
0709 13:18:42.098209 (+  4502us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:42.128154 (+ 29945us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:42.128182 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:42.358968 (+230786us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:42.388566 (+ 29598us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:18:42.398329 (+  9763us) write_op.cc:312] APPLY: finished
0709 13:18:42.418498 (+ 20169us) log.cc:844] Serialized 65 byte log entry
0709 13:18:42.418725 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.418889 (+   164us) write_op.cc:454] Released schema lock
0709 13:18:42.418960 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:42.419708 (+   748us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.419761 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":778196,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":366090,"apply.run_cpu_time_us":5889,"apply.run_wall_time_us":347598,"num_ops":8,"prepare.queue_time_us":161194,"prepare.run_cpu_time_us":20932,"prepare.run_wall_time_us":170134,"raft.queue_time_us":155714,"raft.run_cpu_time_us":74261,"raft.run_wall_time_us":351158,"replication_time_us":985803,"spinlock_wait_cycles":4109696,"thread_start_us":368434,"threads_started":4,"wal-append.queue_time_us":187265,"wal-append.run_cpu_time_us":23104,"wal-append.run_wall_time_us":2587485}]]}
W20260709 13:18:48.298568 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 117573us
I20260709 13:18:48.320019 17419 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:48.279796 19665 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:48.242247 19919 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:48.323846 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:48.280718 19680 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:48.326931 17453 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:48.336956 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.329545 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.279892 19883 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.277064 19793 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:18:48.292275 19754 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:48.331264 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.331666 17419 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:48.332058 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.348762 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.298971 19526 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.335778 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:48.298801 19813 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.242183 19920 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:48.338539 17569 leader_election.cc:336] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.747s (SENT)
I20260709 13:18:48.326511 19890 raft_consensus.cc:697] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:48.244879 19949 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:48.344636 19741 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.346472 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.349205 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:48.391419 17448 raft_consensus.cc:2368] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7.
I20260709 13:18:48.325031 19885 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:48.352623 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.354449 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:48.337805 17520 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 3.
I20260709 13:18:48.392479 17523 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:48.352643 19754 consensus_queue.cc:1059] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:18:48.362092 19680 consensus_queue.cc:1059] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:48.353076 19660 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:48.363041 19920 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:48.282267 19912 consensus_queue.cc:1059] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:18:48.365978 19813 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:48.298805 19670 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:48.361153 19956 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:48.366703 19526 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:48.367712 19702 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:48.355283 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.370168 17598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1160) took 1817 ms (client timeout 2011 ms). Trace:
W20260709 13:18:48.408221 17598 rpcz_store.cc:269] 0709 13:18:46.552620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.552722 (+   102us) service_pool.cc:224] Handling call
0709 13:18:48.369944 (+1817222us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54000753d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:48.370110 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1614949760}
I20260709 13:18:48.409643 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:48.375663 17599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1166) took 1818 ms (client timeout 1500 ms). Trace:
W20260709 13:18:48.410646 17599 rpcz_store.cc:269] 0709 13:18:46.557193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.599663 (+ 42470us) service_pool.cc:224] Handling call
0709 13:18:48.375466 (+1775803us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b54003eb554. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:48.375594 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1595322752}
I20260709 13:18:48.375730 19923 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:48.337148 19922 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:48.314388 19657 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.317958 19892 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:18:48.331413 19933 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:48.340088 19951 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:18:48.348228 19916 consensus_queue.cc:1059] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:18:48.374111 19928 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.411945 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.400796 19885 raft_consensus.cc:697] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:18:48.419301 19877 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 2.135s	user 0.002s	sys 0.000s
I20260709 13:18:48.408120 19813 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:48.420475 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1394) took 2527 ms. Trace:
I20260709 13:18:48.420008 19885 consensus_queue.cc:237] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:48.420634 19813 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:48.420858 17596 rpcz_store.cc:276] 0709 13:18:45.892875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.892993 (+   118us) service_pool.cc:224] Handling call
0709 13:18:45.893288 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.893626 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.893652 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.894079 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:18:46.114115 (+220036us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:46.114160 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.114228 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.418775 (+2304547us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:48.420164 (+  1389us) raft_consensus.cc:1685] finished
0709 13:18:48.420182 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.420416 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27729,"raft.queue_time_us":861,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":12048,"spinlock_wait_cycles":24543104,"thread_start_us":219731,"threads_started":1,"wal-append.queue_time_us":319581}
I20260709 13:18:48.422185 19890 consensus_queue.cc:237] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.422825 19813 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:48.423390 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:48.406369 19660 raft_consensus.cc:697] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:48.424157 17596 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.424887 19660 consensus_queue.cc:237] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.419911 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:48.426174 17599 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:48.424181 19899 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 1.904s	user 0.003s	sys 0.005s
I20260709 13:18:48.417001 19526 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:48.413902 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:48.429661 17597 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:48.412793 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:48.414080 19814 raft_consensus.cc:3055] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:48.413738 19702 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.351271 19883 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.407092 19956 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.400638 19793 raft_consensus.cc:3055] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:48.416476 19670 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:48.433360 19793 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:48.432659 19814 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:48.431860 19922 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:48.433391 19956 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.437624 19949 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.439834 19922 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:48.456041 19883 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.456497 19919 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:48.461933 19956 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.374763 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:48.392524 17446 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:48.506062 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:48.355960 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:48.511792 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 155764us
W20260709 13:18:48.503571 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 153953us
I20260709 13:18:48.514420 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.515599 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:48.515974 17419 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:48.516675 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.432950 17599 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:48.519917 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.520252 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:48.389001 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 50481.3us
W20260709 13:18:48.425101 17602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1404) took 2364 ms (client timeout 1974 ms). Trace:
I20260709 13:18:48.521692 17598 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
W20260709 13:18:48.522092 17602 rpcz_store.cc:269] 0709 13:18:46.061200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.061427 (+   227us) service_pool.cc:224] Handling call
0709 13:18:48.424863 (+2363436us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54000758d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:48.425007 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127769856}
I20260709 13:18:48.523289 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.523789 17602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:18:48.524152 17598 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:48.524767 17602 raft_consensus.cc:606] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:48.525324 17602 raft_consensus.cc:614] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:48.425191 17603 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:48.528410 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:48.529385 17446 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:48.532289 19670 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:48.533537 19670 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.537743 19670 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.521298 17599 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:48.541453 17599 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:48.541591 19680 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:48.516625 17451 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:48.542284 19680 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.542796 19680 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:48.547833 17602 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:48.542335 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:48.550194 17523 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:48.552150 17446 raft_consensus.cc:2368] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4.
W20260709 13:18:48.561558 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45916.6us
I20260709 13:18:48.451032 19814 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.562484 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:48.562908 19814 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:48.556512 19702 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.564325 19702 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:48.564868 19702 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.565260 17419 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:48.565291 19702 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:48.567191 19748 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:48.559397 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:48.553710 17599 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:48.566778 17446 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 2.
I20260709 13:18:48.566445 19660 consensus_queue.cc:1059] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:48.570984 19890 raft_consensus.cc:3055] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:48.447424 19891 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.571955 19748 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:48.583535 17528 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:18:48.583827 19748 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.584374 19748 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.581883 19956 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.582141 19890 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:48.587455 19660 raft_consensus.cc:3055] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:48.588047 19660 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:48.590515 18166 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:48.589455 19660 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:48.577016 19965 log.cc:927] Time spent T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:18:48.591431 19890 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.593040 17599 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:48.550931 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.593251 19890 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:48.833346 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.834157 19660 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.755892 19680 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:48.834859 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.837251 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 223) took 1084 ms. Trace:
I20260709 13:18:48.548693 17596 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:18:48.754143 17451 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
W20260709 13:18:48.822182 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 285704us
I20260709 13:18:48.600878 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1692) took 1354 ms. Trace:
I20260709 13:18:48.583549 19891 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:48.891863 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.894945 17528 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:48.895865 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1706) took 1176 ms. Trace:
I20260709 13:18:48.896257 17528 rpcz_store.cc:276] 0709 13:18:47.719135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.813024 (+1093889us) service_pool.cc:224] Handling call
0709 13:18:48.894595 (+ 81571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.895551 (+   956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.895794 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.902215 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:48.909108 19916 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:48.910137 19916 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.913578 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1644) took 1624 ms. Trace:
I20260709 13:18:48.914141 17453 rpcz_store.cc:276] 0709 13:18:47.130276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.016196 (+885920us) service_pool.cc:224] Handling call
0709 13:18:48.016536 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.337395 (+320859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.589776 (+252381us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54002003d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:48.754162 (+164386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713111808}
I20260709 13:18:48.867533 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 222) took 1121 ms. Trace:
I20260709 13:18:48.918865 17599 rpcz_store.cc:276] 0709 13:18:47.742308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.592134 (+849826us) service_pool.cc:224] Handling call
0709 13:18:48.592662 (+   528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.863502 (+270840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.863706 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.866758 17525 rpcz_store.cc:276] 0709 13:18:47.246710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.336791 (+ 90081us) service_pool.cc:224] Handling call
0709 13:18:47.337085 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.354633 (+ 17548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.354683 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.354739 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:47.354794 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.600457 (+1245663us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b54003c00d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:48.600516 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.600702 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39653760}
I20260709 13:18:48.837760 17602 rpcz_store.cc:276] 0709 13:18:47.752886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.835928 (+1083042us) service_pool.cc:224] Handling call
0709 13:18:48.836282 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.836808 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.836841 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.836916 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:48.836962 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.837030 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.837180 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.839597 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1350) took 1825 ms. Trace:
W20260709 13:18:48.924418 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 85396.9us
I20260709 13:18:48.598830 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 159) took 2974 ms. Trace:
W20260709 13:18:48.926230 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.927037 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1168) took 2369 ms. Trace:
I20260709 13:18:48.924218 19916 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.928287 19702 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:48.930529 19745 raft_consensus.cc:1068] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Unable to promote non-voter 2158c0f750fd4b21afe24135c52167b2: Illegal state: Replica ddfe9cca0741489b994f8b0178c54fe7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:48.596614 19920 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:48.837409 19680 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.927991 19948 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:48.923247 17526 rpcz_store.cc:276] 0709 13:18:47.013621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.222667 (+209046us) service_pool.cc:224] Handling call
0709 13:18:47.229077 (+  6410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.719025 (+489948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.838825 (+1119800us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b540013a1d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:48.839305 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125091712}
I20260709 13:18:48.927611 17601 rpcz_store.cc:276] 0709 13:18:46.557763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.632717 (+ 74954us) service_pool.cc:224] Handling call
0709 13:18:46.711788 (+ 79071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.238104 (+526316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.926346 (+1688242us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b540033b3d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:48.926782 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208579840}
I20260709 13:18:48.936046 19884 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:48.604844 19821 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.944166 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.576630 19922 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.946233 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.948696 17601 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:48.945765 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1710) took 1137 ms. Trace:
I20260709 13:18:48.950574 17528 rpcz_store.cc:276] 0709 13:18:47.805876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.897261 (+1091385us) service_pool.cc:224] Handling call
0709 13:18:48.897747 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.939301 (+ 41554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.939334 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.942948 (+  3614us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:48.942990 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.943064 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.943178 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.955534 17522 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:48.956188 19913 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:48.955930 19748 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.939136 19920 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.957090 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 224) took 1184 ms. Trace:
I20260709 13:18:48.946825 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:48.964996 17601 rpcz_store.cc:276] 0709 13:18:47.765351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.942078 (+1176727us) service_pool.cc:224] Handling call
0709 13:18:48.942543 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.949276 (+  6733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.949534 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.964412 19913 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:48.972558 19748 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:48.972923 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:48.966271 19920 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:48.974092 17448 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:48.975538 19948 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:48.978170 17597 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:48.978863 19626 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:48.980428 17598 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:48.980764 17599 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:48.981273 17601 raft_consensus.cc:2393] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:48.982118 19526 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.982805 19526 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:48.985442 17599 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:48.986806 17599 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:48.997838 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 51705.3us
I20260709 13:18:49.010816 17521 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:48.988616 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1711) took 1157 ms. Trace:
W20260709 13:18:48.990896 17449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1639) took 2427 ms (client timeout 2753 ms). Trace:
W20260709 13:18:49.014173 17449 rpcz_store.cc:269] 0709 13:18:46.563012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.262361 (+699349us) service_pool.cc:224] Handling call
0709 13:18:48.990530 (+1728169us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54000b4354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:48.990712 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754048896}
I20260709 13:18:48.999286 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1714) took 1130 ms. Trace:
I20260709 13:18:48.987691 19925 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:49.016218 17527 rpcz_store.cc:276] 0709 13:18:47.868916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.973114 (+1104198us) service_pool.cc:224] Handling call
0709 13:18:48.973581 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.973981 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.974010 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.998873 (+ 24863us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:48.998914 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.998986 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.999105 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:49.017186 19925 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.017807 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:48.995365 19665 raft_consensus.cc:3055] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:49.018658 19665 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:49.019491 19833 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.019658 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.020064 19665 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.020315 19833 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.004524 19657 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:49.004959 19863 raft_consensus.cc:3055] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:48.999508 19709 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.001950 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 208) took 2262 ms. Trace:
I20260709 13:18:49.013144 17525 rpcz_store.cc:276] 0709 13:18:47.830917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.933542 (+1102625us) service_pool.cc:224] Handling call
0709 13:18:48.988019 (+ 54477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.988271 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.988296 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.988341 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.988374 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.988425 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.988540 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:49.012526 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 212) took 1163 ms. Trace:
I20260709 13:18:48.987303 19920 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.017874 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.020711 17524 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:49.012183 17601 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:49.003418 19948 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:49.009820 19702 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:49.023882 17528 rpcz_store.cc:276] 0709 13:18:47.849550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.958684 (+1109134us) service_pool.cc:224] Handling call
0709 13:18:49.011719 (+ 53035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.012138 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.012167 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.012215 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:49.012246 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.012342 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.012464 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:49.031172 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1707) took 1235 ms. Trace:
I20260709 13:18:49.022925 17529 rpcz_store.cc:276] 0709 13:18:46.739026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.923102 (+184076us) service_pool.cc:224] Handling call
0709 13:18:46.923357 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.338267 (+414910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.001321 (+1663054us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400413054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:49.001727 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852680960}
I20260709 13:18:49.025218 19863 raft_consensus.cc:740] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:49.034111 19840 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:49.035063 17601 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:49.035584 19863 consensus_queue.cc:260] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:49.037949 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.036995 17601 raft_consensus.cc:1240] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:49.041807 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.038302 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.037016 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.033483 17521 rpcz_store.cc:276] 0709 13:18:47.795444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.009302 (+1213858us) service_pool.cc:224] Handling call
0709 13:18:49.010217 (+   915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.025557 (+ 15340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.031081 (+  5524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:49.058296 17602 raft_consensus.cc:2393] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:49.025545 19709 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.067046 17597 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:49.068106 17599 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:49.037647 19863 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.073783 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 225) took 1296 ms. Trace:
I20260709 13:18:49.077157 19922 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:49.067121 19665 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.099059 17602 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:49.099691 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 211) took 1250 ms. Trace:
I20260709 13:18:49.100137 17526 rpcz_store.cc:276] 0709 13:18:47.849196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.957804 (+1108608us) service_pool.cc:224] Handling call
0709 13:18:49.072336 (+114532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.099379 (+ 27043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.099405 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.099444 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:49.099472 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.099535 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.099636 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:49.103672 19920 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:49.074443 17596 rpcz_store.cc:276] 0709 13:18:47.773477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.949356 (+1175879us) service_pool.cc:224] Handling call
0709 13:18:48.967425 (+ 18069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.056545 (+ 89120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.057358 (+   813us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.057419 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:49.069010 (+ 11591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.069108 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.069257 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:49.070509 17419 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:48.925657 17454 rpcz_store.cc:276] 0709 13:18:45.624705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.625323 (+   618us) service_pool.cc:224] Handling call
0709 13:18:45.625592 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.786797 (+161205us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:45.786837 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.787306 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:18:46.032482 (+245176us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:46.032534 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.598148 (+2565614us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54002008d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:48.598227 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.598285 (+    58us) raft_consensus.cc:1685] finished
0709 13:18:48.598296 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.598609 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9295,"raft.queue_time_us":10077,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6301,"spinlock_wait_cycles":348209536,"thread_start_us":134333,"threads_started":1,"wal-append.queue_time_us":346011,"wal-append.run_cpu_time_us":7201,"wal-append.run_wall_time_us":1255501}
I20260709 13:18:49.013751 19793 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.126686 17525 raft_consensus.cc:2393] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:49.133426 19890 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:49.135455 19833 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:49.136543 19833 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:18:49.155758 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.156654 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.156991 19682 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:49.158447 19890 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:49.159366 19890 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.162189 19626 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:49.163028 19626 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.163693 19657 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:49.164449 19657 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.165438 19626 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:49.167392 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:49.168025 17449 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.169656 19913 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:49.170274 17454 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:49.170956 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:49.172614 17524 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:49.172873 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.187789 17453 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:49.179417 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:49.173655 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1709) took 1368 ms. Trace:
I20260709 13:18:49.175976 19925 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:49.176918 17525 raft_consensus.cc:2955] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:49.178550 19893 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.178767 19657 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:49.179195 19890 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:49.183056 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1177) took 1452 ms. Trace:
I20260709 13:18:49.185125 17527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:49.203747 17527 raft_consensus.cc:606] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:49.188746 17522 rpcz_store.cc:276] 0709 13:18:47.804851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.845214 (+ 40363us) service_pool.cc:224] Handling call
0709 13:18:49.173356 (+1328142us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000fdf54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:49.173575 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2503225216}
I20260709 13:18:49.204133 17527 raft_consensus.cc:614] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:49.179922 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.184679 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1173) took 2401 ms. Trace:
I20260709 13:18:49.190281 19581 raft_consensus.cc:3055] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:49.206224 19581 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:18:49.206629 19972 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:18:49.161741 19702 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.207432 19581 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.208280 19702 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.208725 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.209125 19793 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:49.208786 19893 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.210166 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:49.211340 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.212035 17446 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:49.212853 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.213419 17446 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
W20260709 13:18:49.214164 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.215675 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 295891us
I20260709 13:18:49.203240 17598 rpcz_store.cc:276] 0709 13:18:47.730972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.545179 (+814207us) service_pool.cc:224] Handling call
0709 13:18:48.980166 (+434987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.980960 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.182797 (+201837us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54001e4bd0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:49.182948 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999053696}
I20260709 13:18:49.214351 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.231914 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:49.256340 17449 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:49.257079 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.261639 17454 raft_consensus.cc:2410] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:18:49.261720 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 238914us
I20260709 13:18:49.231671 19657 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:49.270678 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:49.205049 17595 rpcz_store.cc:276] 0709 13:18:46.783258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.783388 (+   130us) service_pool.cc:224] Handling call
0709 13:18:46.809205 (+ 25817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.293114 (+483909us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:47.687564 (+394450us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.050705 (+363141us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.050964 (+   259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.051013 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.051073 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.423192 (+372119us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18003ac300. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a79522 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:48.917290 (+494098us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b18003ac300. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a79522 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:49.184263 (+266973us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b540027b0d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:49.184309 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.184503 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7345,"prepare.queue_time_us":180816,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":93,"raft.queue_time_us":171,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":7902,"spinlock_wait_cycles":1129324544,"thread_start_us":569555,"threads_started":2,"wal-append.queue_time_us":388322,"wal-append.run_cpu_time_us":1776,"wal-append.run_wall_time_us":1040608}
I20260709 13:18:49.284251 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:49.285326 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:49.285640 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:49.287355 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:49.287815 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:18:49.291373 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.288622 18193 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:49.296393 17419 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:49.272924 19922 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.309631 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1410) took 2010 ms. Trace:
I20260709 13:18:49.310127 17600 rpcz_store.cc:276] 0709 13:18:47.249617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.334696 (+ 85079us) service_pool.cc:224] Handling call
0709 13:18:47.335045 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.889254 (+554209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.182007 (+1292753us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54003e9c54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:49.260452 (+ 78445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223425280}
I20260709 13:18:49.313385 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1363) took 1039 ms. Trace:
I20260709 13:18:49.316792 17522 rpcz_store.cc:276] 0709 13:18:48.273682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.264483 (+990801us) service_pool.cc:224] Handling call
0709 13:18:49.292761 (+ 28278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.313029 (+ 20268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.313058 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.313105 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:49.313136 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.313202 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.313324 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:49.306931 19890 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:49.327699 17524 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:49.335994 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1360) took 1063 ms. Trace:
I20260709 13:18:49.333220 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1716) took 1310 ms. Trace:
I20260709 13:18:49.337827 17520 rpcz_store.cc:276] 0709 13:18:48.016245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.984916 (+968671us) service_pool.cc:224] Handling call
0709 13:18:48.985366 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.985882 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.985906 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:49.006823 (+ 20917us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.228774 (+221951us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:49.228812 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.228872 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.325028 (+ 96156us) raft_consensus.cc:1685] finished
0709 13:18:49.325050 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.326715 (+  1665us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2004,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":517,"thread_start_us":221451,"threads_started":1,"wal-append.queue_time_us":287121}
I20260709 13:18:49.339226 19815 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:18:49.339922 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:49.339993 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 206470us
W20260709 13:18:49.341034 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 75783.9us
I20260709 13:18:49.341192 17520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:49.341905 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:49.341871 17520 raft_consensus.cc:606] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:49.344483 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1721) took 1066 ms. Trace:
I20260709 13:18:49.344635 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:49.345163 17520 rpcz_store.cc:276] 0709 13:18:48.277959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.343377 (+1065418us) service_pool.cc:224] Handling call
0709 13:18:49.343804 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.344121 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.344156 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.344213 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:49.344243 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.344298 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.344401 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:49.349287 17520 raft_consensus.cc:1240] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:49.351043 19893 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:49.351200 17520 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:49.352842 17520 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:49.355136 17520 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:49.357313 19945 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:49.359030 17452 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:49.360389 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:49.361115 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:49.361971 17447 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:49.362323 18199 raft_consensus.cc:2393] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:49.364111 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.363953 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:49.365270 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:49.367084 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:49.368043 19526 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:49.370488 19958 raft_consensus.cc:3055] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:49.370992 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.371187 19958 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:49.372215 19958 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.373263 19958 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.374866 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.375590 17452 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:49.372821 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:49.377385 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1161) took 2823 ms. Trace:
I20260709 13:18:49.377808 17603 rpcz_store.cc:276] 0709 13:18:46.553789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.553903 (+   114us) service_pool.cc:224] Handling call
0709 13:18:48.425009 (+1871106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.526422 (+101413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.377052 (+850630us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54000758d0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:49.377214 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4302107264}
I20260709 13:18:49.379650 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.380132 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:49.336715 17524 rpcz_store.cc:276] 0709 13:18:48.272914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.259535 (+986621us) service_pool.cc:224] Handling call
0709 13:18:49.310366 (+ 50831us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.335606 (+ 25240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.335914 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:49.381475 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:49.382211 17453 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:49.383478 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:49.389267 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:49.391283 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.393190 19702 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:49.390235 17451 raft_consensus.cc:2376] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9. Re-sending same reply.
W20260709 13:18:49.394140 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 126136us
I20260709 13:18:49.396426 17454 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:49.387667 18193 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:49.398237 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 226) took 1616 ms. Trace:
I20260709 13:18:49.399072 17597 rpcz_store.cc:276] 0709 13:18:47.782355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.979511 (+1197156us) service_pool.cc:224] Handling call
0709 13:18:49.062745 (+ 83234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.067601 (+  4856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.397975 (+330374us) spinlock_profiling.cc:243] Waited 82.7 ms on lock 0x7b54003eb550. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:49.398164 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190141824}
I20260709 13:18:49.398229 19660 consensus_queue.cc:1059] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:18:49.402488 19660 raft_consensus.cc:3055] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:49.402947 19660 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:49.403963 19660 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.405443 19660 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:49.406556 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:49.406795 17452 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:49.407570 17603 raft_consensus.cc:2393] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:49.409365 17452 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:18:49.410007 17452 pending_rounds.cc:85] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 5
I20260709 13:18:49.410310 17452 pending_rounds.cc:107] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:49.410614 17452 raft_consensus.cc:2889] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:49.409729 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:49.412804 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.416376 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:49.418215 17446 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:49.410528 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.419556 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.420212 17446 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:18:49.422099 17446 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:49.423082 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.424033 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:49.425122 18200 raft_consensus.cc:2393] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 5: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:49.427713 17527 raft_consensus.cc:1240] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:49.428447 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1364) took 1154 ms. Trace:
I20260709 13:18:49.428654 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1718) took 1344 ms. Trace:
I20260709 13:18:49.429047 17527 rpcz_store.cc:276] 0709 13:18:48.273850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.290137 (+1016287us) service_pool.cc:224] Handling call
0709 13:18:49.332223 (+ 42086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.428174 (+ 95951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.428376 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:49.429987 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:49.429193 17526 rpcz_store.cc:276] 0709 13:18:48.083895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.101351 (+1017456us) service_pool.cc:224] Handling call
0709 13:18:49.101823 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.143776 (+ 41953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.143827 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:49.205283 (+ 61456us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.314817 (+109534us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:49.314870 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.314960 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.428428 (+113468us) raft_consensus.cc:1685] finished
0709 13:18:49.428452 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.428599 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10808,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":9921,"thread_start_us":109124,"threads_started":1,"wal-append.queue_time_us":221105}
I20260709 13:18:49.431677 18197 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
W20260709 13:18:49.432919 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.433785 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:49.316327 19657 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.436439 17528 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:18:49.437613 19657 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:49.328079 19890 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:49.438519 19890 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:49.428368 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:49.441286 17453 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:49.442077 17451 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:49.441921 18192 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:49.326581 19922 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.370568 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:49.443637 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 99452us
I20260709 13:18:49.370482 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:49.337980 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 88877.2us
I20260709 13:18:49.451653 17447 raft_consensus.cc:2376] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4. Re-sending same reply.
W20260709 13:18:49.457132 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 116308us
I20260709 13:18:49.455358 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:49.462436 17522 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:49.464254 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 75476.6us
I20260709 13:18:49.466460 17448 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:49.470249 19939 consensus_queue.cc:1059] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:18:49.471545 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.473687 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:49.467545 17568 leader_election.cc:336] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Timed out: RequestConsensusVote RPC to 127.15.242.66:40943 timed out after 1.506s (SENT)
I20260709 13:18:49.456703 19913 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:49.466753 17420 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.011s (SENT) [suppressed 25 similar messages]
I20260709 13:18:49.487210 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:49.491195 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1708) took 1692 ms. Trace:
I20260709 13:18:49.472548 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:49.504482 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 45517.5us
I20260709 13:18:49.504979 17597 raft_consensus.cc:2410] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:49.503648 18166 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:49.509209 19979 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:18:49.491727 17523 rpcz_store.cc:276] 0709 13:18:47.798956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.992418 (+1193462us) service_pool.cc:224] Handling call
0709 13:18:48.993037 (+   619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.993495 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:49.260510 (+267015us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.490849 (+230339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.490899 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:49.490938 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.491026 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.491140 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15581,"prepare.queue_time_us":314107,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2727,"thread_start_us":461185,"threads_started":2}
W20260709 13:18:49.521610 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.522675 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 63595.2us
I20260709 13:18:49.475890 19920 consensus_queue.cc:1059] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:18:49.462001 19709 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:49.523415 19948 raft_consensus.cc:2764] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:49.539186 19657 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:49.539794 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.539888 19657 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.540925 19821 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.541503 19821 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:49.541899 19626 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.542299 19581 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.542678 19626 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.543766 19821 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:49.544353 19821 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.544768 19821 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.545253 19626 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:49.559522 19922 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:49.554275 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 89024.4us
I20260709 13:18:49.562390 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:49.547168 19821 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:49.565412 19782 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:49.566123 19782 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:49.567340 19782 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:49.510006 19680 consensus_queue.cc:1059] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 13:18:49.585662 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 47434.7us
I20260709 13:18:49.577615 17522 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:18:49.606434 18166 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:49.548406 17352 catalog_manager.cc:5697] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:49.584154 19890 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.616349 17495 leader_election.cc:400] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7.
I20260709 13:18:49.616765 17495 leader_election.cc:403] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:49.618664 19945 consensus_queue.cc:1059] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:49.619997 19945 raft_consensus.cc:3055] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:49.620357 19945 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:18:49.629845 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.613161 19939 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:49.621331 19945 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.608212 19815 consensus_queue.cc:1059] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:18:49.643325 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 186790us
W20260709 13:18:49.643836 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 120429us
W20260709 13:18:49.645416 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 81368us
I20260709 13:18:49.647641 17568 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:49.649842 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:49.652225 17448 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:49.643074 19680 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7.
I20260709 13:18:49.648962 17352 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 2 to 5, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 5 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.648569 19930 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:49.642117 19657 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:49.649665 19891 consensus_meta.cc:287] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.778s	user 0.006s	sys 0.008s
I20260709 13:18:49.645738 19939 raft_consensus.cc:697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:18:49.676424 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 88844.5us
I20260709 13:18:49.676607 19898 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:18:49.677488 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:49.679245 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:49.679507 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.676470 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.680246 19863 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.680806 19863 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:49.681514 17420 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:49.682899 17568 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:49.668314 19821 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.669342 19930 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:49.689064 17352 catalog_manager.cc:5697] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 3, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 3 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.692317 17450 raft_consensus.cc:2410] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:49.692481 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.692974 19754 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.693519 19754 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.694332 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.696326 19863 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:49.696256 19919 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:49.698760 19919 consensus_queue.cc:1059] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:18:49.699689 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.701443 19822 raft_consensus.cc:3055] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:49.701865 19822 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:49.702873 19993 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:49.702813 19822 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.703981 19822 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:49.704404 19890 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:49.686841 19913 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:49.705372 19913 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.705749 19913 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:49.694473 19489 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:49.706343 19489 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:49.706750 19489 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:49.707363 19948 raft_consensus.cc:3055] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:49.707774 19948 raft_consensus.cc:740] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:49.708678 19948 consensus_queue.cc:260] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.698966 19945 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.710448 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.713078 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:49.713168 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.716050 17522 raft_consensus.cc:1240] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:49.693048 17352 catalog_manager.cc:5697] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 5 to 6, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 6 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.693861 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.684612 19657 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.689978 19766 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:18:49.723024 19657 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.723641 19709 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:49.690848 19680 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:49.724611 19939 consensus_queue.cc:237] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.709908 19948 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.728973 17495 leader_election.cc:400] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4.
I20260709 13:18:49.721431 19930 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:49.726737 17450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1305) took 2947 ms (client timeout 1796 ms). Trace:
I20260709 13:18:49.725409 19657 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:49.734131 17495 leader_election.cc:403] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:49.734355 17450 rpcz_store.cc:269] 0709 13:18:46.779514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.151501 (+371987us) service_pool.cc:224] Handling call
0709 13:18:49.726411 (+2574910us) spinlock_profiling.cc:243] Waited 2.5 s on lock 0x7b54001856d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:49.726640 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5743688576}
I20260709 13:18:49.734071 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:49.742259 17445 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:49.742779 17445 pending_rounds.cc:85] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 2
I20260709 13:18:49.746294 17445 pending_rounds.cc:107] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:49.746620 17445 raft_consensus.cc:2889] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:49.729012 19680 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:49.742290 19891 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:49.755716 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:49.749627 18167 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:49.729293 19821 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.741768 19919 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:18:49.773677 19900 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 3. Current term is 4.
I20260709 13:18:49.774200 19981 raft_consensus.cc:3055] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:49.766590 17522 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.755230 19680 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.761421 17352 catalog_manager.cc:5697] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:49.767997 19709 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:49.770695 19938 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:49.794457 17520 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:49.771531 19920 raft_consensus.cc:3055] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:49.798517 19920 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:49.800117 19920 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.801602 19920 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:49.802445 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.803066 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.804375 18167 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:49.805401 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.806216 17569 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:49.807510 17569 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:49.808212 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1641) took 3053 ms. Trace:
I20260709 13:18:49.808934 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:49.808787 17445 rpcz_store.cc:276] 0709 13:18:46.754382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.997824 (+1243442us) service_pool.cc:224] Handling call
0709 13:18:49.738395 (+1740571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.763538 (+ 25143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.807906 (+ 44368us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54001856d0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:49.808106 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3967030656}
I20260709 13:18:49.772316 19884 raft_consensus.cc:3055] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:49.810901 19884 raft_consensus.cc:740] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:49.812465 19884 consensus_queue.cc:260] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.773065 17528 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:49.775499 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1430) took 1226 ms. Trace:
I20260709 13:18:49.754599 19891 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:18:49.820660 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45348.8us
I20260709 13:18:49.814623 17601 rpcz_store.cc:276] 0709 13:18:48.549072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.072477 (+523405us) service_pool.cc:224] Handling call
0709 13:18:49.154753 (+ 82276us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:49.272128 (+117375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.272160 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:49.310001 (+ 37841us) log.cc:844] Serialized 52 byte log entry
0709 13:18:49.645281 (+335280us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:49.645330 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.645398 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.775249 (+129851us) raft_consensus.cc:1685] finished
0709 13:18:49.775273 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.775437 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5351,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":3922,"thread_start_us":266371,"threads_started":1,"wal-append.queue_time_us":441677}
W20260709 13:18:49.822749 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.825789 19766 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:49.826303 19766 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:49.826745 19766 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:49.826901 19581 consensus_queue.cc:1059] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:49.828550 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:49.774852 19981 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:49.831357 17527 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:49.813625 19489 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.820005 19891 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:49.839449 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 148972us
I20260709 13:18:49.841130 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.842248 17527 raft_consensus.cc:2393] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:49.826954 19652 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:49.824152 19709 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:49.841768 17568 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:49.838762 17352 catalog_manager.cc:5697] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.851020 18167 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:49.840390 19884 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:49.855406 19705 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:49.866495 17568 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:49.844995 19652 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:49.845088 19919 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:49.868183 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:49.859246 19945 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:49.882414 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.843946 19980 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 13:18:49.885164 17522 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:49.867779 19705 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.845773 19782 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:18:49.873456 19652 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:49.894163 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.895581 17522 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:49.855682 19981 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:49.885027 19945 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.896852 19981 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:49.899062 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.881985 19919 raft_consensus.cc:697] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:49.900173 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:49.888650 19705 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:49.894707 19665 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:49.912245 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 56099.5us
I20260709 13:18:49.892926 19709 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:49.874187 17445 raft_consensus.cc:2955] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:49.900794 19945 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:49.925205 19489 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:49.926244 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.912191 19665 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.918581 19958 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:49.925329 19898 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:49.929524 19958 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:18:49.932722 19989 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:18:49.930199 19665 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.938387 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.939026 17520 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:49.941488 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 214) took 1807 ms. Trace:
I20260709 13:18:49.941815 17525 rpcz_store.cc:276] 0709 13:18:48.124541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.133058 (+1008517us) service_pool.cc:224] Handling call
0709 13:18:49.176404 (+ 43346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.176696 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:49.390573 (+213877us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.689629 (+299056us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.691766 (+  2137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.691844 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:49.691894 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.719922 (+ 28028us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.803050 (+ 83128us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b18000bbae0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:49.854377 (+ 51327us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b18000bbae0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a472a6 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4
0709 13:18:49.931393 (+ 77016us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b54000fdf50. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:49.931469 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20448,"prepare.run_wall_time_us":64,"raft.queue_time_us":8313,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":3889,"spinlock_wait_cycles":179385600,"thread_start_us":267687,"threads_started":1,"wal-append.queue_time_us":357801}
I20260709 13:18:49.942910 17352 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 5 to 7, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 7 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:49.948706 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 115334us
I20260709 13:18:49.956148 19958 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.959198 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.937879 19821 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:49.967846 19865 consensus_queue.cc:1059] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:18:49.968514 17450 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:49.969169 19865 raft_consensus.cc:3055] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:49.969626 19865 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:49.980007 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:49.980310 19865 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.982139 19865 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:49.983549 19994 log.cc:927] Time spent T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:18:49.970813 19919 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:49.986846 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.982895 17352 catalog_manager.cc:5697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 2 to 5, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 5 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:49.988780 17352 catalog_manager.cc:5697] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 4, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 4 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
W20260709 13:18:49.990831 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.991899 19930 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:49.994310 19930 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:49.995070 17352 catalog_manager.cc:5697] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 4, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 4 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:49.996726 17352 catalog_manager.cc:5697] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:18:49.998073 18194 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
W20260709 13:18:50.001186 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 73001.7us
I20260709 13:18:49.998136 17352 catalog_manager.cc:5697] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 5, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 5 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.002167 17568 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:50.003466 19930 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:50.007079 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.024149 19930 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.024174 19782 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:50.024930 19930 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.025708 19782 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.026503 19782 raft_consensus.cc:3055] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:50.026894 19782 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:50.027832 19782 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.029135 19782 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.030510 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:50.031209 17521 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:50.031667 17352 catalog_manager.cc:5697] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.033807 17569 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.033324 17352 catalog_manager.cc:5697] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 3 to 6, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 6 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } }
W20260709 13:18:50.035781 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.039812 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.040993 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.051944 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:50.052914 19900 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.053503 19900 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.055786 19900 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.059943 19822 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:50.063390 19626 consensus_queue.cc:1059] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:50.065245 19657 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:50.065984 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:50.068120 17527 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:50.062806 17419 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.071292 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:50.072408 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:50.079581 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:50.077888 17523 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:50.085729 17451 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:50.087239 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:50.087407 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:49.991899 19913 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.082981 17419 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:50.092839 17419 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:50.088838 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 44186.6us
I20260709 13:18:50.097245 17419 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:50.091367 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.100464 19890 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:50.089304 19660 raft_consensus.cc:3055] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:50.100917 19890 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.101220 19660 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:50.101359 19890 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:50.102129 19660 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.103385 19660 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:50.104803 19741 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:50.106725 17569 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.107124 19709 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:50.107787 19709 raft_consensus.cc:697] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:18:50.109002 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.075244 19754 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.088058 19821 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.113673 17526 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:50.110220 19766 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.126201 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1412) took 2832 ms. Trace:
W20260709 13:18:50.143749 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 52486.2us
I20260709 13:18:50.100042 19702 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:50.117794 19766 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:50.130456 19922 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:50.119629 19919 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.145221 19754 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:50.157923 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 58797.1us
I20260709 13:18:50.164947 17419 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:50.146166 19741 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.137838 17594 rpcz_store.cc:276] 0709 13:18:47.259404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.339071 (+ 79667us) service_pool.cc:224] Handling call
0709 13:18:47.339395 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:47.389776 (+ 50381us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:49.139436 (+1749660us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b18003a1500. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a76455 00007f5ab955e3c7 00007f5ab5b709a7 00007f5ab5b795e5 00007f5ab5b79568
0709 13:18:49.304069 (+164633us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.608408 (+304339us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:49.970580 (+362172us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b2c00007508. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446f372 00007f5ab5ba1a01 00007f5ab5b6643a 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2
0709 13:18:49.978450 (+  7870us) log.cc:844] Serialized 52 byte log entry
0709 13:18:49.978636 (+   186us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:50.042912 (+ 64276us) log.cc:844] Serialized 14 byte log entry
0709 13:18:50.060863 (+ 17951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.084630 (+ 23767us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.084679 (+    49us) raft_consensus.cc:1685] finished
0709 13:18:50.084691 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.092005 (+  7314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67502,"prepare.queue_time_us":148085,"prepare.run_cpu_time_us":18939,"prepare.run_wall_time_us":214542,"raft.queue_time_us":67976,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":14071,"spinlock_wait_cycles":17761920,"thread_start_us":479092,"threads_started":3,"wal-append.queue_time_us":358461}
W20260709 13:18:50.173820 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.124418 19705 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.118157 19982 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.152287 19913 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.145085 19657 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:50.161309 19922 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:50.233912 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46770.9us
I20260709 13:18:50.187245 19863 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:50.243637 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 135111us
I20260709 13:18:50.230473 19974 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.231168 19702 raft_consensus.cc:697] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:50.249780 19974 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.250191 17568 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:50.239265 19898 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.250741 19702 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.251338 19898 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.252173 19974 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.253571 19898 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:50.146790 19709 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.231000 19922 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.258673 19891 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:50.267388 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.246282 19863 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.294426 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:50.265779 19958 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.189302 19741 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.315845 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.302423 19782 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:50.306589 19863 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:50.330106 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:50.338732 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:50.339054 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.343465 17599 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:50.336866 20005 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.350881 20005 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.322353 19785 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:18:50.356033 19793 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.356652 19793 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.357273 19665 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.357643 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:50.379802 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.362407 19626 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.380731 19626 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.381364 17522 raft_consensus.cc:2368] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4.
I20260709 13:18:50.361953 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:50.383240 19626 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.358959 19793 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.384294 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:50.384483 19793 consensus_queue.cc:1059] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:50.334626 19766 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:50.384768 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:50.386132 19898 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:50.385650 19793 raft_consensus.cc:3055] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:50.387428 19793 raft_consensus.cc:740] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:50.384969 17602 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:50.388453 19793 consensus_queue.cc:260] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.360008 19705 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:50.389997 19793 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.386785 17520 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:50.390874 19919 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:18:50.391724 17419 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:50.394793 19665 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.395987 19930 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.399287 19821 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.400005 19626 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:50.400435 19626 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.400880 19626 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.374234 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:50.393790 19680 consensus_meta.cc:287] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
W20260709 13:18:50.366161 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.430573 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 73018.8us
I20260709 13:18:50.338493 19782 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:50.321601 19958 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.359157 19891 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:50.367419 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:50.455428 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.461427 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 122754us
I20260709 13:18:50.462484 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.359148 19652 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.487926 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:50.431600 19930 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:50.454550 19782 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:50.494205 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:50.500593 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 336880us
I20260709 13:18:50.502589 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:50.432246 19982 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:18:50.460397 19665 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:50.520433 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:50.432466 19680 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.525548 17520 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:18:50.492908 19945 consensus_meta.cc:287] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
W20260709 13:18:50.531328 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 68941.9us
I20260709 13:18:50.487524 18194 raft_consensus.cc:2376] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6. Re-sending same reply.
I20260709 13:18:50.492515 20008 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:50.500174 19822 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:50.498178 19793 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:50.545750 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:50.537482 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:50.557891 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 68758.9us
I20260709 13:18:50.560644 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.561791 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:50.562062 19657 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:50.531100 19891 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:50.509837 19919 consensus_queue.cc:1059] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:18:50.521827 19890 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.590142 17526 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:18:50.593042 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 60939.8us
I20260709 13:18:50.533346 19665 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.603229 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.611099 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:50.539850 19945 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.615581 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:50.589761 19920 consensus_meta.cc:287] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.773s	user 0.003s	sys 0.009s
W20260709 13:18:50.607290 19884 consensus_meta.cc:287] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.001s
I20260709 13:18:50.600387 19821 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.625155 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:50.635203 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:50.641623 17526 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:50.598495 19657 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.598737 19891 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.588445 19793 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.646620 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:50.632292 19745 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:50.649648 19982 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:50.654572 17603 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:50.654359 19745 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.655858 17524 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.657541 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:50.650502 20009 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:18:50.650601 19665 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.650710 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:50.653033 17527 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:50.657995 17603 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:50.660332 17522 raft_consensus.cc:3055] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:50.676993 17522 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:50.658358 17597 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:50.696012 17594 raft_consensus.cc:2393] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:50.644235 19702 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.693730 17522 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:18:50.702651 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:50.644462 20016 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:50.659588 19891 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:50.674875 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 59376.5us
I20260709 13:18:50.659209 19890 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.675812 19822 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:50.704633 17522 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:50.670982 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.675112 17419 leader_election.cc:400] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4.
I20260709 13:18:50.706205 17521 raft_consensus.cc:2393] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:18:50.713093 17419 leader_election.cc:403] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:18:50.702688 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.711109 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 117138us
I20260709 13:18:50.711566 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:50.705895 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:50.714648 17597 raft_consensus.cc:2393] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:50.661312 19793 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:50.713572 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 44132.8us
I20260709 13:18:50.715951 19822 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.717988 19822 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:50.720682 19945 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:50.722263 19657 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.724042 19958 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.721720 17524 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
W20260709 13:18:50.712173 19981 consensus_meta.cc:287] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.801s	user 0.007s	sys 0.006s
I20260709 13:18:50.700336 20008 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:50.711798 19652 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:50.727519 19891 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.706162 19920 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:18:50.763700 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:50.767083 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 49620.4us
I20260709 13:18:50.769822 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:50.774132 17420 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.737807 19793 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:18:50.782229 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 66908.2us
I20260709 13:18:50.781898 19793 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.783638 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:50.784860 19793 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:50.785079 19884 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:50.756677 19680 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.785454 19884 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:50.785842 19884 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.784886 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:50.786826 19680 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:50.787197 19680 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:50.787566 19680 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.790620 20008 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.791069 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:50.793661 19702 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.804831 19702 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.801641 19766 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:50.806214 19766 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:50.806936 19702 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.807080 19766 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.810433 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:50.812556 19863 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.814492 19680 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.811024 17601 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:50.821913 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 48043.1us
I20260709 13:18:50.822781 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:50.823028 17420 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.824568 20026 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:50.824811 20002 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:50.825215 20026 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:50.825389 20002 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:50.826236 19821 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.826301 20026 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.830338 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:50.825974 20002 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.823205 19745 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.833684 17522 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:18:50.834816 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 43811.2us
I20260709 13:18:50.765951 19657 consensus_queue.cc:1059] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:50.836675 17595 raft_consensus.cc:2393] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:50.809793 20005 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:50.846678 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 76940.2us
I20260709 13:18:50.797595 19626 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.856375 19489 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:50.861387 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.880334 19626 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.880370 18167 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.881410 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:18:50.882961 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.883837 19745 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:50.884434 19745 raft_consensus.cc:697] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:50.885200 19665 consensus_queue.cc:1059] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:50.886476 19793 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:50.882006 19948 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.887920 19793 raft_consensus.cc:3055] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:50.857896 20012 log.cc:927] Time spent T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.295s	user 0.000s	sys 0.003s
I20260709 13:18:50.888384 19898 raft_consensus.cc:3055] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:50.889072 19898 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:50.861095 19782 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:50.863188 19922 consensus_meta.cc:287] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 13:18:50.891016 19922 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:50.866140 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.867105 19863 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.843672 19702 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.869371 17596 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:50.886740 20010 consensus_queue.cc:1059] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:50.893594 17569 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.863368 17568 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:50.895855 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:50.896090 17601 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
W20260709 13:18:50.867946 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.905987 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.906718 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.909453 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:50.910235 17524 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:50.910542 20010 raft_consensus.cc:3055] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:50.910951 20010 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:50.911777 20010 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.915560 17447 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.877454 19884 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:50.920181 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 56882.9us
I20260709 13:18:50.912927 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:50.923226 17526 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:50.924624 19865 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:50.925433 19865 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:50.925166 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:50.926524 19865 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:50.926318 19898 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.927138 19865 raft_consensus.cc:697] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:50.928192 19865 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.929523 20021 raft_consensus.cc:3055] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:50.930002 20021 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:50.928220 19922 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.930920 20021 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.913055 20010 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:50.934094 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:50.888429 19793 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:50.941746 17568 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:50.885489 19745 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.937285 19489 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:18:50.944707 17523 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:50.944177 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:50.917270 19680 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:50.948784 19793 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.947455 19705 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:50.950166 19782 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:50.950565 19705 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:50.950671 20024 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:18:50.902858 19822 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.951130 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:50.946364 20021 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.950196 19793 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.974617 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:50.981431 19884 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:50.969781 19891 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4.
I20260709 13:18:50.984407 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:50.988739 19705 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.989640 18198 raft_consensus.cc:1240] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:50.989866 19680 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:50.990828 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:50.990972 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:50.991496 17600 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.993407 19741 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.971879 20002 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.994390 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:50.994616 19981 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:50.995111 19981 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:50.996088 20002 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:50.989228 18192 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:18:51.003033 19741 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:51.003537 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:51.003677 19741 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:50.998857 19821 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:51.001761 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:50.989326 17602 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:51.016887 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:50.942868 20027 consensus_queue.cc:1059] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:18:51.016721 17529 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:51.022310 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:51.022910 17446 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.022910 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:51.025471 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:51.026314 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:51.026576 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:51.027029 17454 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:51.028059 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:51.028836 17452 raft_consensus.cc:2368] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6.
I20260709 13:18:50.996024 19981 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:50.971505 20008 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:51.013412 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 74715us
I20260709 13:18:51.030414 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:51.013548 17453 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:51.014927 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:51.032207 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:51.018210 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:51.018369 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:51.019098 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:51.019398 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:51.020147 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:51.020782 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:50.966180 19782 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:18:51.033937 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:51.043566 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:51.049722 17600 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:51.012528 19680 raft_consensus.cc:697] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:51.051707 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:51.052610 19741 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:51.053298 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:51.052320 19680 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:51.053778 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:51.053977 17454 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:51.038407 17419 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:51.063664 17449 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:51.067117 17445 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:51.031335 20008 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.076351 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:51.091114 17447 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:51.092115 17453 raft_consensus.cc:1240] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:51.084230 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45898.5us
I20260709 13:18:51.083019 20008 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.083189 17599 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:51.100476 17446 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:51.102399 18167 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:51.115279 17569 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:51.132730 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.133486 17445 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:51.047787 19930 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:18:51.141717 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 180998us
I20260709 13:18:51.144716 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:51.145908 17598 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:51.090418 20016 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.100790 19754 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.150326 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:51.107264 18197 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
W20260709 13:18:51.136430 20011 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:51.082890 19982 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:18:51.167389 17603 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:51.176254 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:51.177404 17445 raft_consensus.cc:2393] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:18:51.180920 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.149016 20027 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:51.180639 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:51.182886 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.183219 17447 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:51.185216 17598 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:51.187264 17569 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:51.190203 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 47128.1us
I20260709 13:18:51.190148 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:51.154642 19754 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.198120 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:51.182682 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.212934 17450 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:18:51.217792 18167 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:51.146945 20025 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.228s
I20260709 13:18:51.200794 19754 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.233393 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:51.232304 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:51.249845 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 62698.6us
I20260709 13:18:51.250747 17569 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:51.165781 20016 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:51.256218 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 223463us
I20260709 13:18:51.259895 17450 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
W20260709 13:18:51.583448 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.911185 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.431221 19974 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.917189 19974 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:51.328583 19919 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:51.918812 19919 raft_consensus.cc:697] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:51.919832 19919 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:51.504117 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.450758 20024 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.324008 20008 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:51.292091 20023 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:51.452566 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:51.545034 17520 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:18:51.926326 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 675608us
I20260709 13:18:51.351692 17451 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:51.974773 17447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.005s	sys 0.019s
W20260709 13:18:51.979658 17447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.005s	sys 0.019s
I20260709 13:18:51.607977 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1438) took 1282 ms. Trace:
I20260709 13:18:51.980507 17595 rpcz_store.cc:276] 0709 13:18:50.325187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.337741 (+ 12554us) service_pool.cc:224] Handling call
0709 13:18:50.763483 (+425742us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b58001a1398. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:18:51.607665 (+844182us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b54000758d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:51.607885 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118651008}
I20260709 13:18:51.951344 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:51.686256 17602 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:51.396678 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.985878 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.974938 17524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.016s	sys 0.008s
W20260709 13:18:51.987007 17524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.016s	sys 0.008s
I20260709 13:18:51.951822 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:51.988291 17449 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.946100 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:51.990077 17446 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:51.949286 17596 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:18:51.926236 17448 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:51.991694 17596 pending_rounds.cc:85] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 6
W20260709 13:18:51.732908 20048 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:18:51.230630 19920 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:51.921990 19754 consensus_meta.cc:287] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
I20260709 13:18:52.083268 17596 pending_rounds.cc:107] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 13:18:51.292002 20039 log.cc:927] Time spent T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:18:51.765686 20017 raft_consensus.cc:3055] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:52.131031 17569 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:51.621771 19900 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.609328 19948 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.249306 19980 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:51.528918 20030 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.699s	user 0.002s	sys 0.002s
W20260709 13:18:51.879721 20010 consensus_meta.cc:287] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.931s	user 0.013s	sys 0.000s
I20260709 13:18:52.152875 20010 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.993630 20016 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:51.462766 20044 log.cc:927] Time spent T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:18:51.622315 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.281513 19822 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:52.108279 17596 raft_consensus.cc:2889] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:52.102268 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 107692us
I20260709 13:18:52.111002 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:52.146265 20055 log.cc:927] Time spent T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.712s	user 0.002s	sys 0.000s
I20260709 13:18:52.140331 20017 raft_consensus.cc:740] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:52.109478 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1340) took 1103 ms. Trace:
W20260709 13:18:51.498960 20026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.002s	sys 0.010s
W20260709 13:18:51.610605 20050 log.cc:927] Time spent T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.453s	user 0.000s	sys 0.002s
W20260709 13:18:51.393735 20037 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.321s	user 0.003s	sys 0.000s
I20260709 13:18:51.870757 19766 raft_consensus.cc:3055] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:51.974216 19981 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:51.529217 19793 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:51.925256 20008 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:51.806459 19958 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.083539 19982 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.998409 19821 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.090389 19898 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.153750 17521 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:51.995062 20023 raft_consensus.cc:697] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:52.106694 19754 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.148231 19948 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:52.153600 19980 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:52.165896 19709 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.174377 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:52.109113 19626 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.151932 20057 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.518908 19785 raft_consensus.cc:3055] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:52.110628 17452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.006s	sys 0.043s
I20260709 13:18:52.183007 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:52.180658 17451 rpcz_store.cc:276] 0709 13:18:51.005619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.005768 (+   149us) service_pool.cc:224] Handling call
0709 13:18:51.021419 (+ 15651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.351490 (+330071us) spinlock_profiling.cc:243] Waited 9.78 ms on lock 0x7b54003ba4a0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5adddc0 00007f5ab5b681c0 00007f5ab5b69231 00007f5ab5b65d8f 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c
0709 13:18:51.977201 (+625711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.109186 (+131985us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b540004fe54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:52.109419 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69997184}
I20260709 13:18:52.186178 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:52.181608 17420 connection.cc:256] RPC call timeout handler was delayed by -1.1743869299998551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 13:18:52.159780 19489 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:18:52.182126 20026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.351s	user 0.002s	sys 0.018s
I20260709 13:18:52.089291 19891 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.283782 19891 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:52.090276 20027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.005s	sys 0.039s
I20260709 13:18:52.211197 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:52.287153 17450 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:52.154578 19900 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:51.923166 20024 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:52.156056 20010 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:51.335837 20051 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:52.188836 19974 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:52.197415 19766 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:52.206172 19793 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.265133 17449 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
W20260709 13:18:52.259639 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 58833.2us
I20260709 13:18:52.267450 17445 raft_consensus.cc:2368] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7.
W20260709 13:18:52.288750 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 102652us
I20260709 13:18:52.307444 17495 leader_election.cc:400] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6.
I20260709 13:18:52.307787 17495 leader_election.cc:403] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:52.259086 19865 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.301062 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 1411) took 1300 ms. Trace:
I20260709 13:18:52.312021 17521 rpcz_store.cc:276] 0709 13:18:51.000615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.004914 (+  4299us) service_pool.cc:224] Handling call
0709 13:18:52.300753 (+1295839us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540014e1d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:52.300952 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2581718784}
W20260709 13:18:52.264945 17452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.007s	sys 0.043s
I20260709 13:18:52.315343 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1347) took 1278 ms. Trace:
I20260709 13:18:52.259557 19785 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:52.267092 19822 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.317068 17452 rpcz_store.cc:276] 0709 13:18:51.036924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.037044 (+   120us) service_pool.cc:224] Handling call
0709 13:18:51.054934 (+ 17890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.065664 (+ 10730us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:51.065704 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.087828 (+ 22124us) log.cc:844] Serialized 26 byte log entry
0709 13:18:52.314901 (+1227073us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:52.314958 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.315045 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.315103 (+    58us) raft_consensus.cc:1685] finished
0709 13:18:52.315120 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.315272 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1164749,"threads_started":1,"wal-append.queue_time_us":1046481}
I20260709 13:18:52.288055 20066 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:52.352540 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 356986us
I20260709 13:18:52.250545 19982 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.256707 19821 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:52.339880 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 48471.3us
I20260709 13:18:52.269011 20006 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:52.295547 20027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.005s	sys 0.039s
I20260709 13:18:52.345323 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:52.347573 17449 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:52.267701 20057 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.349877 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:52.469652 17450 raft_consensus.cc:2393] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:52.217679 19958 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:52.261353 19626 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:52.462178 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 51119.1us
I20260709 13:18:52.310108 19489 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.292520 20060 consensus_queue.cc:1059] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:18:52.501300 17448 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:18:52.463220 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.305584 20069 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:52.466918 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 457542us
I20260709 13:18:52.460016 19891 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:52.266858 20017 consensus_queue.cc:260] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.462242 17445 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:52.341811 19865 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:52.529958 17494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.011s	sys 0.026s
W20260709 13:18:52.513511 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.516983 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:18:52.534785 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.498679 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 191360us
I20260709 13:18:52.534768 18198 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:52.535895 17494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.011s	sys 0.027s
I20260709 13:18:52.536033 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:52.541608 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.528473 18167 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:52.413080 19822 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.550405 18200 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:18:52.518996 20063 log.cc:927] Time spent T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:18:52.568588 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:52.509688 20069 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:52.512306 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:18:52.547492 19705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.025s	sys 0.055s
I20260709 13:18:52.487362 19938 consensus_queue.cc:1059] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:18:52.582749 17522 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:52.567667 19665 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:52.591910 18199 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:18:52.592535 20061 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:18:52.593487 20062 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:18:52.594144 20064 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
W20260709 13:18:52.595054 20068 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:18:52.498837 20006 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.486192 20066 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.568123 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:18:52.602559 19705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.025s	sys 0.056s
I20260709 13:18:52.599452 19821 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:52.601977 20069 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.667156 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:52.672773 17525 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:18:52.657907 20017 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.509938 19766 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.657807 20071 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.674970 18166 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:52.663671 19665 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:52.532225 20023 consensus_queue.cc:237] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:52.664328 19754 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:52.607916 19782 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.680359 19626 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:52.686061 19652 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:52.685938 20071 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:52.706565 19652 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.707021 19652 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.708297 20071 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:52.708873 20071 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.709313 20071 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:52.687539 20021 consensus_meta.cc:287] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.711s	user 0.008s	sys 0.006s
I20260709 13:18:52.710500 20021 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:52.712271 17527 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:52.670405 19948 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:52.713289 19948 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:52.713781 19948 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.714226 19948 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.688802 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1759) took 1487 ms. Trace:
I20260709 13:18:52.718318 17524 rpcz_store.cc:276] 0709 13:18:51.201451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.201973 (+   522us) service_pool.cc:224] Handling call
0709 13:18:51.207694 (+  5721us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.219029 (+ 11335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.219058 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.250338 (+ 31280us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.987584 (+737246us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:51.987639 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.987736 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.688524 (+700788us) raft_consensus.cc:1685] finished
0709 13:18:52.688553 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.688725 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21630,"raft.queue_time_us":11448,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":8594,"thread_start_us":682386,"threads_started":1,"wal-append.queue_time_us":881497}
I20260709 13:18:52.722280 20071 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:52.728677 19948 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:52.698352 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 433826us
W20260709 13:18:52.665961 17566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.006s	sys 0.005s
W20260709 13:18:52.730350 17566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.006s	sys 0.006s
I20260709 13:18:52.730249 19782 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.733238 20027 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:52.735824 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 207464us
W20260709 13:18:52.668397 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.744189 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 241387us
W20260709 13:18:52.748603 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.754973 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:52.755982 17450 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
W20260709 13:18:52.762641 17520 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.002s	sys 0.023s
W20260709 13:18:52.763757 17520 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.003s	sys 0.023s
I20260709 13:18:52.767932 18195 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:52.772215 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:52.734568 20008 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.777304 17452 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:18:52.779906 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 243925us
I20260709 13:18:52.783941 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:52.789354 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:52.774449 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:52.792349 17449 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:18:52.774052 17420 connection.cc:256] RPC call timeout handler was delayed by -1.0159869299998263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
I20260709 13:18:52.733880 20027 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.747084 19980 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:52.799939 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:52.800829 17595 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:18:52.763262 20010 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:52.763844 19900 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:52.768625 20024 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:52.790376 17419 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:52.815924 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:52.811566 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:52.811807 17452 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:52.778064 20016 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:52.821627 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:52.823348 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:52.824528 17447 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.004s	sys 0.030s
W20260709 13:18:52.825017 17447 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.004s	sys 0.030s
I20260709 13:18:52.828979 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1355) took 1549 ms. Trace:
I20260709 13:18:52.745294 20070 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.129s
I20260709 13:18:52.831571 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:52.807016 20026 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:52.853135 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 73694.8us
I20260709 13:18:52.854918 18167 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:52.856392 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:52.857823 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:52.863463 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:52.864305 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:52.864886 17526 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:18:52.819805 19920 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.007s	sys 0.028s
W20260709 13:18:52.874794 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 51631.3us
I20260709 13:18:52.877137 17450 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:52.830868 17447 rpcz_store.cc:276] 0709 13:18:51.279267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.279530 (+   263us) service_pool.cc:224] Handling call
0709 13:18:51.279893 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.280121 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:51.292988 (+ 12867us) log.cc:844] Serialized 14 byte log entry
0709 13:18:52.825700 (+1532712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:52.828536 (+  2836us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:52.828688 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.828776 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.828909 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107967,"prepare.queue_time_us":13226,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5485,"raft.queue_time_us":591867,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":56485,"thread_start_us":1424086,"threads_started":2,"wal-append.queue_time_us":863095}
I20260709 13:18:52.882143 17446 raft_consensus.cc:1240] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:52.882815 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:52.884213 17449 raft_consensus.cc:2410] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:52.876430 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:52.886327 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:52.790663 20008 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:52.893915 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:52.848109 19680 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:52.822923 19782 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:52.818648 19958 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:52.893585 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:52.822306 20024 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:52.894773 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:52.893494 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:52.821080 20071 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:18:52.886361 19489 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:52.931718 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 83451.5us
I20260709 13:18:52.946471 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:52.934473 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:52.940785 20083 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:18:52.906334 20086 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:52.927286 19665 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:52.826378 19900 consensus_queue.cc:1059] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:18:52.949612 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:52.907177 20084 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:52.909104 17521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:52.813467 19980 consensus_queue.cc:1059] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 13:18:52.910480 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 235566us
W20260709 13:18:52.874697 19920 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.008s	sys 0.028s
I20260709 13:18:52.876909 19754 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.913821 17449 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:52.917268 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.851878 19865 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:52.875566 20057 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:52.886148 20010 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:52.950311 17453 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.893956 20073 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:52.931887 19948 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:52.848794 20016 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:52.941643 20077 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:18:52.931270 19626 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:53.024080 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.024434 19626 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:53.025142 19948 raft_consensus.cc:3055] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:53.025561 19948 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:53.026518 19948 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:53.027868 19626 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:53.030330 20093 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:52.974586 17526 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:53.031401 20010 raft_consensus.cc:697] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:52.985662 17525 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:52.909018 19680 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:53.032655 19680 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.939558 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:52.976661 18198 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:18:53.039938 19785 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:53.041160 19785 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:53.042331 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.043051 17522 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:53.006620 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:52.933261 19958 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:52.940552 19709 consensus_meta.cc:287] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.001s
I20260709 13:18:52.934940 20070 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:52.987542 19793 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:53.044759 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.064635 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:53.046192 17447 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:52.991439 17521 raft_consensus.cc:606] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:52.928117 20087 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:53.054139 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:53.058617 18166 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:53.084084 17526 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:53.058944 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:53.013257 19865 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:18:53.058194 19981 consensus_meta.cc:287] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.852s	user 0.007s	sys 0.004s
I20260709 13:18:53.063665 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:53.064307 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:53.064426 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:52.999629 19920 raft_consensus.cc:697] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:52.985335 20084 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.007838 20057 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.064962 19709 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:53.087124 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:52.953508 20024 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:53.062394 17454 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:53.087416 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:53.065214 20070 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:53.084545 20087 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.053391 19891 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:53.091110 17599 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:53.068387 20081 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.151836 17596 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:53.004088 19754 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:53.104444 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.122520 17492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.011s	sys 0.016s
I20260709 13:18:52.930917 20078 consensus_queue.cc:1059] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:18:53.067890 19958 raft_consensus.cc:697] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:53.089547 17594 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:18:53.154296 17594 pending_rounds.cc:85] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 4
I20260709 13:18:53.154606 17594 pending_rounds.cc:107] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:18:53.154942 17594 raft_consensus.cc:2889] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:53.088825 19974 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.032966 20010 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:18:53.136214 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 243951us
I20260709 13:18:53.142817 17526 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:18:53.082906 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.095533 17598 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:53.152971 17492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.011s	sys 0.016s
W20260709 13:18:53.154810 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 95912.6us
I20260709 13:18:53.160727 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.156490 20081 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:53.158857 17521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:53.123759 20084 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:53.128294 20023 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:53.012171 20073 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:53.162470 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:53.129714 20057 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:53.161216 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 102669us
I20260709 13:18:53.143337 20070 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:53.164266 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.093022 19865 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:53.175746 17446 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:53.165565 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.340106 20092 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:53.340437 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:53.341213 17594 raft_consensus.cc:2368] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4.
I20260709 13:18:53.254508 19958 consensus_queue.cc:237] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:53.342053 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.342935 18166 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:53.343096 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.338413 20023 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.198199 17526 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:53.344127 20008 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:53.340718 20092 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:53.164841 17453 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
W20260709 13:18:53.260510 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 59041.6us
W20260709 13:18:53.346093 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.346452 20092 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:53.344105 20023 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:53.254088 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.350232 20026 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6.
I20260709 13:18:53.350884 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.352487 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.353050 17525 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:53.257541 19680 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:53.359954 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.360471 19680 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:53.360637 17595 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
W20260709 13:18:53.361326 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 199009us
I20260709 13:18:53.361596 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.363132 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:53.364336 20092 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:53.364534 17495 leader_election.cc:400] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7.
I20260709 13:18:53.364748 20092 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:53.365015 19982 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:53.165607 20091 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.365257 20092 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:53.365851 20091 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:53.366986 19754 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:53.368213 20024 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:53.369280 20091 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:53.168781 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:53.257472 20017 consensus_meta.cc:287] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.579s	user 0.005s	sys 0.006s
I20260709 13:18:53.200160 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.371255 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.371991 17598 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:53.372785 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.375463 17595 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:53.164041 19974 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:53.372975 20069 consensus_meta.cc:287] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.000s
I20260709 13:18:53.216167 19920 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:53.379935 20094 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:53.380347 20021 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:53.382252 20072 raft_consensus.cc:3055] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:53.382741 20073 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:53.372709 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.383599 18194 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:53.386845 20092 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:53.387457 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.389643 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.384207 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:53.145617 19981 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:53.364912 17495 leader_election.cc:403] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:53.200528 20027 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:53.200992 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.395900 17526 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:53.489857 17525 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:53.490957 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.169409 17599 raft_consensus.cc:2368] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8.
I20260709 13:18:53.396857 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.492089 20022 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7.
I20260709 13:18:53.492717 19766 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:53.457226 19680 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:53.493108 20023 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:53.493906 17603 raft_consensus.cc:2410] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:53.493553 20091 consensus_queue.cc:1059] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:53.454509 20093 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:53.494946 20084 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:53.460095 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 331752us
I20260709 13:18:53.499563 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.664124 17524 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
W20260709 13:18:53.491386 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 126974us
I20260709 13:18:53.196382 17597 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:53.252694 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.147007 20087 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:53.510481 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 126346us
I20260709 13:18:53.511677 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.674674 17526 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
W20260709 13:18:53.353904 19652 consensus_meta.cc:287] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.646s	user 0.007s	sys 0.002s
I20260709 13:18:53.394323 20006 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:53.638422 17527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 1409) took 2512 ms (client timeout 1558 ms). Trace:
W20260709 13:18:53.589046 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 80959.4us
W20260709 13:18:53.536664 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.165218 20075 log.cc:927] Time spent T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
W20260709 13:18:53.251187 20097 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 13:18:53.666467 17566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.011s	sys 0.022s
W20260709 13:18:53.313297 19898 consensus_meta.cc:287] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.063s	user 0.008s	sys 0.004s
I20260709 13:18:53.721067 17449 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:53.671622 20073 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:53.721741 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 56646.2us
I20260709 13:18:53.489595 20072 raft_consensus.cc:740] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:53.495934 19981 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.323123 20081 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:53.647768 19680 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:53.417979 20069 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:53.649557 20094 raft_consensus.cc:697] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:18:53.729648 19785 consensus_meta.cc:287] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.001s
I20260709 13:18:53.250181 20098 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.486092 20017 consensus_queue.cc:1059] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.185s
I20260709 13:18:53.511929 20021 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:18:53.537077 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.764134 17566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.012s	sys 0.022s
W20260709 13:18:53.765187 17520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.027s	sys 0.016s
W20260709 13:18:54.021963 17520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.027s	sys 0.016s
W20260709 13:18:53.730433 19626 consensus_meta.cc:287] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.702s	user 0.007s	sys 0.004s
I20260709 13:18:53.795148 17601 raft_consensus.cc:2410] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:53.672341 20093 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:53.737206 19974 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:54.083604 17521 raft_consensus.cc:606] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:54.084077 17521 raft_consensus.cc:614] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:54.084648 17523 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:53.736171 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:53.739265 19822 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:53.786207 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.755918 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.760017 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:54.090749 17524 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 4.
W20260709 13:18:53.753973 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 79278.5us
W20260709 13:18:54.093591 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.755327 17527 rpcz_store.cc:269] 0709 13:18:51.000085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.015837 (+ 15752us) service_pool.cc:224] Handling call
0709 13:18:53.511882 (+2496045us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400413f54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:53.511993 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3789101824}
I20260709 13:18:53.741540 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:53.732393 19652 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:54.095829 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:54.096170 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:54.097625 17603 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:53.787752 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.098295 17598 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:54.098770 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.099258 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:54.099647 17603 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:54.100350 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.747251 20066 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:54.020552 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:53.831483 17526 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:54.087182 19626 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.101173 20087 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:53.829694 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1682) took 1056 ms. Trace:
I20260709 13:18:54.103052 17445 rpcz_store.cc:276] 0709 13:18:52.772765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.772952 (+   187us) service_pool.cc:224] Handling call
0709 13:18:52.798210 (+ 25258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:52.914781 (+116571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.914830 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.366889 (+452059us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b2c000014c8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446f372 00007f5ab5ba1a01 00007f5ab5b6643a 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2
0709 13:18:53.367355 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.490065 (+122710us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:53.490102 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.490170 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:53.800564 (+310394us) raft_consensus.cc:1685] finished
0709 13:18:53.800586 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.829580 (+ 28994us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18150,"raft.queue_time_us":91165,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":12882,"spinlock_wait_cycles":83809152,"thread_start_us":212163,"threads_started":2,"wal-append.queue_time_us":384967}
W20260709 13:18:53.779862 17420 leader_election.cc:336] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.011s (SENT)
W20260709 13:18:54.105499 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 325624us
W20260709 13:18:53.896456 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.721737 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:53.735252 20089 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.031877 17596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.014s	sys 0.027s
W20260709 13:18:54.109746 17596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.015s	sys 0.027s
W20260709 13:18:53.753131 18194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42536 (request call id 187) took 2736 ms (client timeout 1756 ms). Trace:
W20260709 13:18:54.002537 20105 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:18:53.737462 20084 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:54.117884 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 97424.6us
I20260709 13:18:54.118326 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1681) took 1356 ms. Trace:
I20260709 13:18:53.801496 20073 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:54.119200 19974 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:54.119688 19974 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.120039 19974 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.120863 20073 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:54.029289 20026 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:54.033704 17600 raft_consensus.cc:2410] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:53.800313 20088 consensus_queue.cc:1059] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.259s
I20260709 13:18:53.818794 19981 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:53.735384 20111 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:53.752374 20057 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:54.047278 20098 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.028851 20072 consensus_queue.cc:260] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:53.834410 20067 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.033910 20028 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.743218 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:54.147814 18198 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:53.785871 19821 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.734405 20023 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:54.081861 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 289727us
I20260709 13:18:54.156817 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:53.751951 20016 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:54.082772 20017 raft_consensus.cc:3055] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:54.086179 17525 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:54.100903 17603 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:54.104588 20087 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:54.112118 17524 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:54.100417 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.170619 17598 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:54.111723 18194 rpcz_store.cc:269] 0709 13:18:51.016997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.018101 (+  1104us) service_pool.cc:224] Handling call
0709 13:18:53.752872 (+2734771us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b54005f0854. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:53.753029 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5348044672}
I20260709 13:18:54.122421 17599 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:54.121670 20026 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.123909 17447 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:54.125433 18167 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:54.118731 17451 rpcz_store.cc:276] 0709 13:18:52.761770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.762249 (+   479us) service_pool.cc:224] Handling call
0709 13:18:52.762716 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:52.763162 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:52.899302 (+136140us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.004657 (+105355us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.012770 (+  8113us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.012916 (+   146us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:53.050601 (+ 37685us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.394263 (+343662us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b180037e220. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab29f3c0a 00007f5abc133219 00007f5ab2a7ba40 00007f5ab2a764e4 00007f5ab2a76455 00007f5ab5b5e060 00007f5ab5b70716 00007f5ab5b81287 00007f5ab5b81208
0709 13:18:53.394483 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.394570 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:53.723258 (+328688us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b180037e220. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:53.785641 (+ 62383us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b180037e220. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:54.118126 (+332485us) raft_consensus.cc:1685] finished
0709 13:18:54.118147 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.118267 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57032,"prepare.queue_time_us":299710,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":873759,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":28771,"spinlock_wait_cycles":24739072,"thread_start_us":179042,"threads_started":2,"wal-append.queue_time_us":553863}
I20260709 13:18:53.754318 20078 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.361s
I20260709 13:18:54.142501 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:54.184063 17445 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.097646 19652 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:54.153149 17419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.033s	sys 0.073s
I20260709 13:18:54.165550 17595 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:54.187986 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 62605.2us
W20260709 13:18:54.188321 17419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.034s	sys 0.073s
I20260709 13:18:54.188975 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:54.191159 17599 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.160178 20102 raft_consensus.cc:3055] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:54.193722 20073 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.195258 20084 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:54.197572 20023 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.170773 20094 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:54.196435 17419 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:54.215341 17419 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:54.154762 20092 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:54.126897 20089 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:54.191967 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.226751 17598 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:18:54.228122 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.200976 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.159586 19865 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:54.208196 20057 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.163937 20017 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:54.171847 20069 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:54.231293 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.282810 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:54.288177 17445 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:54.185336 20119 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:54.161751 19821 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.208310 20118 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:54.199692 20102 raft_consensus.cc:740] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:54.159137 20021 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:54.160022 20091 consensus_queue.cc:1175] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:18:54.292938 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:54.152755 20028 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.309600 19680 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:54.155215 20070 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.215674 20016 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:54.248922 20120 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:54.271538 20084 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:54.158866 20067 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.321458 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.322939 17598 raft_consensus.cc:2410] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:54.330570 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.331593 17598 raft_consensus.cc:2368] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8.
I20260709 13:18:54.332720 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.333518 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1697) took 1330 ms. Trace:
I20260709 13:18:54.334049 17449 rpcz_store.cc:276] 0709 13:18:53.002805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.003150 (+   345us) service_pool.cc:224] Handling call
0709 13:18:53.045230 (+ 42080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.783236 (+738006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.333286 (+550050us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54000b5c54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:54.333453 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553786112}
I20260709 13:18:54.344485 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1195) took 1280 ms. Trace:
I20260709 13:18:54.345093 17600 rpcz_store.cc:276] 0709 13:18:53.063934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.064068 (+   134us) service_pool.cc:224] Handling call
0709 13:18:54.344235 (+1280167us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54001e46d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:54.344411 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2167853824}
I20260709 13:18:54.346711 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:54.347635 17524 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:54.349180 19705 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.349756 19705 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.350382 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:54.352093 19705 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:54.358448 19665 raft_consensus.cc:3055] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:54.359088 19665 raft_consensus.cc:740] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:54.360204 19665 consensus_queue.cc:260] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.361589 19665 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:54.365540 20116 log.cc:927] Time spent T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.732s	user 0.002s	sys 0.000s
I20260709 13:18:54.370013 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:54.370880 17597 raft_consensus.cc:2368] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8.
I20260709 13:18:54.371941 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.372742 17597 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:54.374536 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:54.375366 18194 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:54.381666 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1203) took 1285 ms. Trace:
I20260709 13:18:54.382269 17595 rpcz_store.cc:276] 0709 13:18:53.096308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.376181 (+279873us) service_pool.cc:224] Handling call
0709 13:18:53.382066 (+  5885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.188375 (+806309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.381322 (+192947us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54000753d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:54.381579 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1793783680}
I20260709 13:18:54.383891 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.386570 18167 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:54.387491 20087 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:54.388011 20087 raft_consensus.cc:697] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:54.388844 20087 consensus_queue.cc:237] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:54.389860 19898 raft_consensus.cc:3055] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:54.248154 20073 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.394436 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:54.390309 19898 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:54.393915 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:54.403218 17529 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:54.404080 17568 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:54.405515 19705 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:54.405959 19705 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.406328 19705 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.410487 20066 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:54.411001 20066 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.411343 20066 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:54.411926 20113 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.765s	user 0.000s	sys 0.002s
I20260709 13:18:54.414073 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1695) took 1436 ms. Trace:
I20260709 13:18:54.414479 17452 rpcz_store.cc:276] 0709 13:18:52.977266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.977425 (+   159us) service_pool.cc:224] Handling call
0709 13:18:53.007356 (+ 29931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.047032 (+ 39676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.047060 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.047495 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.134341 (+ 86846us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:53.134690 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.765013 (+630323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.765094 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.406774 (+641680us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b1800325480. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a79522 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:18:54.411307 (+  4533us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:54.413828 (+  2521us) raft_consensus.cc:1685] finished
0709 13:18:54.413847 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.413989 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":344144,"prepare.queue_time_us":172,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":794557,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":25387,"spinlock_wait_cycles":261197440,"thread_start_us":198466,"threads_started":2,"wal-append.queue_time_us":405613}
W20260709 13:18:54.416457 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 246910us
I20260709 13:18:54.319798 20069 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:54.278743 20057 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.426651 17525 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:54.421367 17595 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
W20260709 13:18:54.439167 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.333537 17598 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:54.392589 20120 raft_consensus.cc:697] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:54.296372 20092 consensus_queue.cc:1059] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:18:54.325610 20084 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.443356 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:54.444186 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 287409us
I20260709 13:18:54.418390 18194 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:18:54.299443 20119 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.328352 20016 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:54.307837 20118 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.396678 20017 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:54.623445 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.451151 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:54.762313 17522 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:54.597741 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.489639 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.491477 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:54.773718 17600 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:54.721678 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.611950 17599 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
W20260709 13:18:54.546311 17601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1196) took 1482 ms (client timeout 1761 ms). Trace:
W20260709 13:18:54.782334 17601 rpcz_store.cc:269] 0709 13:18:53.064267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.064391 (+   124us) service_pool.cc:224] Handling call
0709 13:18:54.546095 (+1481704us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54000767d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:54.546240 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675335552}
W20260709 13:18:54.786206 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:54.656055 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.545493 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60446 (request call id 12) took 1387 ms. Trace:
I20260709 13:18:54.791360 17521 rpcz_store.cc:276] 0709 13:18:53.158518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.158687 (+   169us) service_pool.cc:224] Handling call
0709 13:18:54.545257 (+1386570us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54003c00d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b60853 00007f5abab2e60a 00007f5ab40b47d4 00007f5ab40b4762 00007f5ab40b4691 00007f5ab40b460c 00007f5ab40b38c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:54.545388 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116135168}
I20260709 13:18:54.523756 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:54.430505 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.797129 17597 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.799373 18194 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:54.799450 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:54.806854 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.807850 17599 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:54.808779 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.810108 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:54.823423 17599 raft_consensus.cc:2410] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:54.812471 17522 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:18:54.819741 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:54.824265 17527 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:54.566007 20093 consensus_meta.cc:287] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
W20260709 13:18:54.520889 20125 log.cc:927] Time spent T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
W20260709 13:18:54.521766 20124 log.cc:927] Time spent T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
W20260709 13:18:54.583382 19766 consensus_meta.cc:287] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.936s	user 0.010s	sys 0.000s
I20260709 13:18:54.828033 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:54.833663 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.837270 17603 raft_consensus.cc:2410] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:54.526944 20072 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.825654 18166 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:54.586684 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:54.505374 20110 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:54.841344 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:54.797173 20084 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.535876 20089 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:54.506800 20123 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:54.557523 20057 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:54.537106 19821 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:54.520110 20026 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:54.573673 20070 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:54.845870 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.521072 19626 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:54.570492 20098 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:54.549638 17351 catalog_manager.cc:5697] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:54.856011 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:54.861865 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:54.863456 17600 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:18:54.881148 17602 raft_consensus.cc:2410] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:54.857208 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:54.880307 20094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.046s	sys 0.120s
I20260709 13:18:54.889142 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:54.889766 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:54.557777 19898 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:54.833326 20093 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:54.550833 20120 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:54.892618 17492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.022s	sys 0.045s
W20260709 13:18:55.300129 17492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.023s	sys 0.046s
I20260709 13:18:55.300359 17601 raft_consensus.cc:2368] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8.
W20260709 13:18:55.006299 17526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.048s	sys 0.155s
W20260709 13:18:55.302304 17526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.065s	sys 0.195s
I20260709 13:18:55.193216 17449 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:55.288039 17352 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40508 (request call id 186) took 15568 ms (client timeout 15000 ms). Trace:
I20260709 13:18:55.017179 17419 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:55.288734 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.305088 17453 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:18:54.988685 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1769) took 2425 ms. Trace:
W20260709 13:18:55.307662 20094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.070s	sys 0.166s
I20260709 13:18:55.022408 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.307286 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:55.308148 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 291061us
I20260709 13:18:55.044716 17597 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:55.318830 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1230) took 1096 ms. Trace:
I20260709 13:18:55.307008 17523 rpcz_store.cc:276] 0709 13:18:52.562996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.569723 (+  6727us) service_pool.cc:224] Handling call
0709 13:18:52.570108 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.088058 (+1517950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.988392 (+900334us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54003c00d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:54.988585 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3482614144}
I20260709 13:18:55.278663 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:55.320013 17452 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.320182 17597 rpcz_store.cc:276] 0709 13:18:54.222501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.373582 (+151081us) service_pool.cc:224] Handling call
0709 13:18:54.523661 (+150079us) spinlock_profiling.cc:243] Waited 9.49 ms on lock 0x7b5c0014660c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab94d0161 00007f5ab9671a79 00007f5abab2b9b6 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:55.318773 (+795112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21826944}
I20260709 13:18:55.307502 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.321511 17446 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:18:54.900346 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:55.248862 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.310952 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.323715 17600 raft_consensus.cc:2410] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:54.967610 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1777) took 1767 ms. Trace:
I20260709 13:18:55.324149 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.324285 17529 rpcz_store.cc:276] 0709 13:18:53.200327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.200462 (+   135us) service_pool.cc:224] Handling call
0709 13:18:53.200747 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.404016 (+1203269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.967183 (+563167us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000fe954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:54.967484 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2650485120}
I20260709 13:18:55.325726 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:55.326833 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:55.327504 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:55.327785 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.328392 17449 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:18:54.857841 20091 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:54.982462 18198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42538 (request call id 279) took 1241 ms. Trace:
I20260709 13:18:55.000135 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.957715 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 249) took 1608 ms. Trace:
I20260709 13:18:55.332270 17596 rpcz_store.cc:276] 0709 13:18:53.349207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.388820 (+ 39613us) service_pool.cc:224] Handling call
0709 13:18:53.389219 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.398983 (+  9764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.399027 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.399531 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.110177 (+710646us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:54.441751 (+331574us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.442018 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.442120 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.957188 (+515068us) raft_consensus.cc:1685] finished
0709 13:18:54.957223 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.957604 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":106525,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":9346,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":69536,"thread_start_us":955429,"threads_started":2,"wal-append.queue_time_us":697889}
I20260709 13:18:55.158957 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:55.335690 17447 raft_consensus.cc:2368] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:55.336814 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:55.337704 17447 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.986151 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.339110 17595 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:54.993333 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 239) took 1990 ms. Trace:
I20260709 13:18:54.971838 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:55.313607 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.343457 17524 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:18:55.193080 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:54.975445 17568 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.15.242.126:39589, user_credentials={real_user=slave}} blocked reactor thread for 74355.5us
I20260709 13:18:55.174880 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.346978 17448 raft_consensus.cc:2410] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:54.995419 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:55.161728 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.348362 17445 raft_consensus.cc:2410] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:54.974927 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1778) took 1774 ms. Trace:
I20260709 13:18:55.304616 17351 catalog_manager.cc:5697] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:18:55.303184 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1791) took 1847 ms. Trace:
W20260709 13:18:54.990526 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.321481 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.351192 17526 rpcz_store.cc:276] 0709 13:18:53.456157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.101870 (+645713us) service_pool.cc:224] Handling call
0709 13:18:54.102214 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.102455 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:54.323847 (+221392us) log.cc:844] Serialized 14 byte log entry
0709 13:18:55.302832 (+978985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.302883 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:55.302954 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.303020 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.303131 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":448350,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":5438,"thread_start_us":1199649,"threads_started":2}
I20260709 13:18:55.352362 17597 raft_consensus.cc:2368] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4.
W20260709 13:18:55.014232 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.354200 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.356019 17598 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:55.289214 19652 raft_consensus.cc:670] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } [suppressed 4 similar messages]
W20260709 13:18:54.980167 20104 log.cc:927] Time spent T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 1.259s	user 0.000s	sys 0.003s
I20260709 13:18:54.998997 19948 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:55.386351 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:55.330682 18198 rpcz_store.cc:276] 0709 13:18:53.740953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.741167 (+   214us) service_pool.cc:224] Handling call
0709 13:18:54.982272 (+1241105us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b5400227254. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:54.982394 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120116480}
I20260709 13:18:55.366915 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.368184 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.369576 17445 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:55.389042 17599 raft_consensus.cc:2393] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:55.389788 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.349398 17528 rpcz_store.cc:276] 0709 13:18:53.200688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.201847 (+  1159us) service_pool.cc:224] Handling call
0709 13:18:53.202234 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.326903 (+124669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.326932 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.572825 (+245893us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.844148 (+271323us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:53.844206 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.844307 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.974693 (+1130386us) raft_consensus.cc:1685] finished
0709 13:18:54.974715 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.974851 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":105126,"threads_started":1,"wal-append.queue_time_us":522531}
I20260709 13:18:55.392050 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:55.370146 17594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1215) took 1565 ms (client timeout 1898 ms). Trace:
W20260709 13:18:55.393313 17594 rpcz_store.cc:269] 0709 13:18:53.805121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.999738 (+1194617us) service_pool.cc:224] Handling call
0709 13:18:55.370055 (+370317us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:54.949460 19705 consensus_meta.cc:287] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.000s
I20260709 13:18:54.952963 20128 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:55.378441 17524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:55.380806 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.381705 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:55.360715 17495 connection.cc:256] RPC call timeout handler was delayed by -2.7643965500001286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260709 13:18:55.356817 19821 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:55.384001 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:55.413751 17523 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:55.385260 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:54.975351 20028 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:55.419328 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.420292 17597 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
W20260709 13:18:55.424600 17495 connection.cc:256] RPC call timeout handler was delayed by -2.3563247310000861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 13:18:55.425209 17495 connection.cc:256] RPC call timeout handler was delayed by -2.2780247310001869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 13:18:55.425669 17495 connection.cc:256] RPC call timeout handler was delayed by -2.2033247310000661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:18:55.426121 17495 connection.cc:256] RPC call timeout handler was delayed by -2.2024247310000646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 13:18:55.426592 17495 connection.cc:256] RPC call timeout handler was delayed by -2.2024247310000646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 13:18:55.427016 17495 connection.cc:256] RPC call timeout handler was delayed by -2.1358247310001843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:18:55.427474 17495 connection.cc:256] RPC call timeout handler was delayed by -2.0386247310000272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 13:18:55.427915 17495 connection.cc:256] RPC call timeout handler was delayed by -1.9549247310001192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 13:18:55.428331 17495 connection.cc:256] RPC call timeout handler was delayed by -1.8757247310002185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 13:18:55.428761 17495 connection.cc:256] RPC call timeout handler was delayed by -1.8289247310001429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
W20260709 13:18:55.429177 17495 connection.cc:256] RPC call timeout handler was delayed by -1.0630247310000414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3022s for a response
I20260709 13:18:55.421752 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:54.888830 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:55.387583 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:55.340287 17520 rpcz_store.cc:276] 0709 13:18:53.002865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.003410 (+   545us) service_pool.cc:224] Handling call
0709 13:18:53.003764 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.067463 (+ 63699us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:53.087293 (+ 19830us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.427702 (+1340409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.427763 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:54.427830 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.993070 (+565240us) spinlock_profiling.cc:243] Waited 63.4 ms on lock 0x7b5400201cd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:54.993119 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.993263 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35951,"prepare.queue_time_us":15275,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":148567,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":15691,"spinlock_wait_cycles":147352320,"thread_start_us":1303291,"threads_started":2,"wal-append.queue_time_us":906695,"wal-append.run_cpu_time_us":1413,"wal-append.run_wall_time_us":1139290}
I20260709 13:18:54.994354 20073 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:55.308462 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:55.351643 17351 catalog_manager.cc:5697] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 3 to 4, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 4 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:18:55.396559 17528 raft_consensus.cc:2410] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:18:55.397394 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.985283 20119 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:54.969847 20118 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:55.240499 20089 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:55.399348 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.458549 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1246) took 1014 ms. Trace:
I20260709 13:18:55.458922 17599 rpcz_store.cc:276] 0709 13:18:54.444035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.399106 (+955071us) service_pool.cc:224] Handling call
0709 13:18:55.458485 (+ 59379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:55.005337 20067 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:55.401921 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.404062 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.469035 17600 raft_consensus.cc:2376] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7. Re-sending same reply.
I20260709 13:18:55.407754 17445 raft_consensus.cc:1240] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:54.983210 20016 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:55.407874 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.408617 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:55.279500 20017 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.488866 20093 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:54.956636 20102 consensus_queue.cc:260] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:55.423826 19821 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:55.442129 17351 catalog_manager.cc:5697] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 2 to 5, term changed from 4 to 5, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:55.451900 19974 consensus_meta.cc:287] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 1.328s	user 0.008s	sys 0.006s
I20260709 13:18:55.412461 18167 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:55.435141 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.436714 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:55.382998 19754 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:55.437907 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:55.436105 17628 heartbeater.cc:646] Failed to heartbeat to 127.15.242.126:39589 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.15.242.126:39589 timed out after 15.000s (SENT)
W20260709 13:18:55.303584 17352 rpcz_store.cc:269] 0709 13:18:39.719447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.719966 (+   519us) service_pool.cc:224] Handling call
0709 13:18:55.287889 (+15567923us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:50.706181 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:50.786388 (+ 80207us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:50.786458 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:18:50.786502 (+    44us) tablet.cc:662] Decoding operations
0709 13:18:50.788262 (+  1760us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:50.788345 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:50.788383 (+    38us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:18:50.860234 (+ 71851us) tablet.cc:701] Row locks acquired
0709 13:18:50.860291 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:18:50.860511 (+   220us) write_op.cc:270] Start()
0709 13:18:50.860677 (+   166us) write_op.cc:276] Timestamp: P: 1783603130860427 usec, L: 0
0709 13:18:50.860701 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:50.863043 (+  2342us) log.cc:844] Serialized 5577 byte log entry
0709 13:18:52.927910 (+2064867us) op_driver.cc:464] REPLICATION: finished
0709 13:18:53.345002 (+417092us) write_op.cc:301] APPLY: starting
0709 13:18:53.345102 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:53.345415 (+   313us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:53.345535 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:53.385232 (+ 39697us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b540001b8d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6332a 00007f5ab5ae8f14 00007f5ab5ae8ec3 00007f5ab5ae8e38 00007f5ab5ae8df3 00007f5ab5ae80dc 00007f5ab5b11e16 00007f5ab5af9cbb 00007f5ab5ae439d 00007f5ab5ae7d75
0709 13:18:53.495294 (+110062us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:53.495746 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:18:53.495807 (+    61us) write_op.cc:312] APPLY: finished
0709 13:18:53.646629 (+150822us) log.cc:844] Serialized 101 byte log entry
0709 13:18:53.646826 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:53.646995 (+   169us) write_op.cc:454] Released schema lock
0709 13:18:53.647066 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:53.752664 (+105598us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:53.752698 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":320214,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":336571,"apply.run_cpu_time_us":13719,"apply.run_wall_time_us":407603,"num_ops":14,"prepare.queue_time_us":265600,"prepare.run_cpu_time_us":25771,"prepare.run_wall_time_us":248721,"raft.queue_time_us":331800,"raft.run_cpu_time_us":19164,"raft.run_wall_time_us":567327,"replication_time_us":2013638,"spinlock_wait_cycles":20158720,"thread_start_us":498264,"threads_started":4,"wal-append.queue_time_us":113608,"wal-append.run_cpu_time_us":56893,"wal-append.run_wall_time_us":3771128}]]}
I20260709 13:18:55.386565 20091 raft_consensus.cc:697] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:55.450330 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:55.411330 19705 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:55.453313 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.908588 20123 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:55.457525 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.574096 17596 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:55.574656 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1242) took 1147 ms. Trace:
I20260709 13:18:55.574944 17596 rpcz_store.cc:276] 0709 13:18:54.427615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.436783 (+1009168us) service_pool.cc:224] Handling call
0709 13:18:55.574598 (+137815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:55.459870 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:55.466964 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
W20260709 13:18:55.468442 17602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1191) took 2459 ms (client timeout 2423 ms). Trace:
W20260709 13:18:55.575819 17602 rpcz_store.cc:269] 0709 13:18:53.008560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.008738 (+   178us) service_pool.cc:224] Handling call
0709 13:18:55.460741 (+2452003us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54000780d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:55.468361 (+  7620us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4174104448}
W20260709 13:18:55.576154 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 116348us
W20260709 13:18:55.405413 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.472819 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:55.472752 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.577236 17452 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:18:55.474357 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:55.476696 19981 consensus_meta.cc:287] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 1.332s	user 0.010s	sys 0.000s
I20260709 13:18:55.473609 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:55.492395 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.582577 17568 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:55.583752 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:54.879828 20110 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:55.410805 17524 raft_consensus.cc:606] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:55.440858 20132 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.522276 17594 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
W20260709 13:18:55.525883 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 113499us
I20260709 13:18:55.598268 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.619935 17598 raft_consensus.cc:2368] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9.
I20260709 13:18:55.619764 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:55.508416 17351 catalog_manager.cc:5697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.376817 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:55.531503 17529 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:55.536713 18197 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:55.541098 20091 consensus_queue.cc:237] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:55.531999 19754 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:55.623410 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:55.544322 20066 consensus_meta.cc:287] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.132s	user 0.011s	sys 0.000s
W20260709 13:18:55.549218 20072 consensus_meta.cc:287] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.695s	user 0.005s	sys 0.005s
I20260709 13:18:55.518757 19821 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.577564 17599 raft_consensus.cc:2376] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7. Re-sending same reply.
I20260709 13:18:55.473562 20016 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:55.579016 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 112146us
I20260709 13:18:55.416621 20128 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:55.467552 20010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.728s	user 0.002s	sys 0.015s
W20260709 13:18:55.502079 20087 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.014s
I20260709 13:18:55.587317 19981 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:55.588930 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.558429 20071 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.543110 17521 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:55.680665 17521 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:55.627055 17524 raft_consensus.cc:614] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:55.594005 17568 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:55.626959 17351 catalog_manager.cc:5697] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.684193 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.626562 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:55.630618 17446 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:55.631160 19754 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:55.681800 17521 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:55.631735 20110 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:55.688776 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 104126us
I20260709 13:18:55.685055 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1235) took 1382 ms. Trace:
I20260709 13:18:55.690236 17594 rpcz_store.cc:276] 0709 13:18:54.302289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.645934 (+1343645us) service_pool.cc:224] Handling call
0709 13:18:55.684982 (+ 39048us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:55.634140 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 315807us
I20260709 13:18:55.637444 17445 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.555279 19898 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.491889 20129 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.135s
I20260709 13:18:55.492188 20089 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:55.639736 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.673691 20072 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:55.553913 20102 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.710999 20067 consensus_queue.cc:1059] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:55.712513 20023 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:55.533187 19652 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:55.714401 19652 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:55.635059 20132 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:55.715751 19652 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:55.582073 20026 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:55.644281 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.717795 20132 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:55.718333 17596 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:55.719265 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.720108 17596 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:55.720834 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.721455 17596 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:55.643596 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:55.698684 20098 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:55.722386 20098 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:55.722436 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 78917.9us
I20260709 13:18:55.722878 20098 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:55.684284 20094 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:18:55.717737 20026 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:55.723927 20026 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.725486 20118 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:55.651460 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.726071 20118 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.726287 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.726620 20118 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:55.726856 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.727564 17597 raft_consensus.cc:2376] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7. Re-sending same reply.
I20260709 13:18:55.728484 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.729048 17597 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:18:55.729861 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.730912 17597 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:55.731243 20123 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:55.735951 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.736670 17596 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:55.652634 17525 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:55.737567 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.655886 17447 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:55.737987 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.660315 17595 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:18:55.624964 19709 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:55.674443 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.618637 20070 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:55.676855 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:55.649745 20010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.910s	user 0.002s	sys 0.015s
I20260709 13:18:55.642097 19938 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.673743 20087 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.000s	sys 0.015s
I20260709 13:18:55.590601 20119 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:55.529536 19974 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:55.699538 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.701182 17602 raft_consensus.cc:2410] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:55.703087 17419 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:55.581622 20021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.170s	user 0.000s	sys 0.018s
I20260709 13:18:55.709373 17445 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:55.648684 20016 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:55.620747 19891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.160s	user 0.009s	sys 0.011s
W20260709 13:18:55.740073 17527 consensus_meta.cc:287] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.901s	user 0.009s	sys 0.000s
I20260709 13:18:55.853591 17527 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
W20260709 13:18:55.854267 17527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 248) took 1402 ms (client timeout 1592 ms). Trace:
W20260709 13:18:55.854660 17527 rpcz_store.cc:269] 0709 13:18:54.451961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.633197 (+181236us) service_pool.cc:224] Handling call
0709 13:18:55.854212 (+1221015us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:55.710862 19665 consensus_meta.cc:287] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.311s	user 0.009s	sys 0.001s
I20260709 13:18:55.741182 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.922313 17596 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:55.923403 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.923799 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.924220 17596 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:55.642462 20066 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:55.924429 17445 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
W20260709 13:18:55.925074 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 201895us
I20260709 13:18:55.759440 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.766116 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.766800 17448 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:55.721556 20084 consensus_meta.cc:287] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.000s
I20260709 13:18:55.930413 20084 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:55.772996 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.933339 17597 raft_consensus.cc:2393] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:55.933777 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 243782us
W20260709 13:18:55.848191 20021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.436s	user 0.000s	sys 0.018s
W20260709 13:18:55.781805 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.940006 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.773579 19938 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:55.799733 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.941115 17599 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
W20260709 13:18:55.802137 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 175643us
I20260709 13:18:55.937263 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.746286 19709 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:55.815876 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.944224 17454 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.019s	sys 0.057s
W20260709 13:18:55.946676 17454 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.019s	sys 0.058s
W20260709 13:18:55.947014 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.688208 20071 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:55.818310 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:55.963361 17598 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:55.698494 20028 consensus_queue.cc:1059] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:18:55.698323 19865 consensus_queue.cc:1059] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:18:55.840867 17446 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:55.701484 20093 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.726936 17594 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:55.920296 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:55.921335 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 218297us
I20260709 13:18:55.775173 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:55.974649 17595 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:18:55.938953 17420 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.819s (SENT) [suppressed 38 similar messages]
I20260709 13:18:55.943176 17596 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:55.942605 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:55.853314 19891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.393s	user 0.009s	sys 0.012s
I20260709 13:18:55.981057 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1247) took 1536 ms. Trace:
W20260709 13:18:55.937772 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 253900us
I20260709 13:18:55.981510 17595 rpcz_store.cc:276] 0709 13:18:54.444388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.739160 (+1294772us) service_pool.cc:224] Handling call
0709 13:18:55.980986 (+241826us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:55.978492 17419 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:55.847872 20119 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:55.983388 17603 raft_consensus.cc:2368] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6.
I20260709 13:18:55.991477 17521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:55.992028 17521 raft_consensus.cc:606] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:55.992412 17521 raft_consensus.cc:614] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:55.992803 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.993882 17596 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:18:55.994576 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52572 (request call id 251) took 1602 ms. Trace:
I20260709 13:18:55.994968 17596 rpcz_store.cc:276] 0709 13:18:54.392481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.936975 (+1544494us) service_pool.cc:224] Handling call
0709 13:18:55.994462 (+ 57487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:55.999058 17598 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:55.986709 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.988336 17599 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:18:56.000144 17599 pending_rounds.cc:85] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 2
I20260709 13:18:56.000451 17599 pending_rounds.cc:107] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:18:56.000735 17599 raft_consensus.cc:2889] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:56.001833 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1225) took 1865 ms. Trace:
I20260709 13:18:56.002315 17599 rpcz_store.cc:276] 0709 13:18:54.136658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.941807 (+1805149us) service_pool.cc:224] Handling call
0709 13:18:55.980899 (+ 39092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.001513 (+ 20614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.001759 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.003078 17419 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:55.988914 17595 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:56.004997 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1459) took 1237 ms. Trace:
I20260709 13:18:56.005354 17595 rpcz_store.cc:276] 0709 13:18:54.767796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.982335 (+1214539us) service_pool.cc:224] Handling call
0709 13:18:55.988730 (+  6395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.004765 (+ 16035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.004945 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.006448 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:56.007242 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:55.980443 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 257784us
I20260709 13:18:55.989163 17600 raft_consensus.cc:1240] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 9. Ops: []
I20260709 13:18:56.008066 17524 raft_consensus.cc:2393] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:56.008394 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1227) took 1835 ms. Trace:
I20260709 13:18:56.008641 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:56.008796 17600 rpcz_store.cc:276] 0709 13:18:54.172914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.941867 (+1768953us) service_pool.cc:224] Handling call
0709 13:18:55.988997 (+ 47130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.008152 (+ 19155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.008338 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:55.989426 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.983973 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.990707 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:55.920533 20087 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:55.934854 19754 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:55.962064 19709 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.009476 17529 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:55.990433 17602 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:56.019500 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1458) took 1252 ms. Trace:
W20260709 13:18:56.012425 17603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1243) took 1570 ms (client timeout 1909 ms). Trace:
I20260709 13:18:56.020155 17445 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:56.019932 17602 rpcz_store.cc:276] 0709 13:18:54.766843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.973788 (+1206945us) service_pool.cc:224] Handling call
0709 13:18:55.981907 (+  8119us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.019168 (+ 37261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.019411 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.013684 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1236) took 1698 ms. Trace:
I20260709 13:18:55.960973 19665 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:18:56.017781 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 75245.7us
W20260709 13:18:56.020467 17603 rpcz_store.cc:269] 0709 13:18:54.442600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.855569 (+412969us) service_pool.cc:224] Handling call
0709 13:18:56.012246 (+1156677us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54003aded4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:56.012372 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1526044928}
I20260709 13:18:56.022053 19665 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.021848 17598 rpcz_store.cc:276] 0709 13:18:54.315381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.964533 (+1649152us) service_pool.cc:224] Handling call
0709 13:18:55.997378 (+ 32845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.013279 (+ 15901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.013598 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.022842 17603 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:56.023183 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:56.024117 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1467) took 1168 ms. Trace:
I20260709 13:18:56.024290 19665 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.024600 17603 rpcz_store.cc:276] 0709 13:18:54.856116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.022254 (+1166138us) service_pool.cc:224] Handling call
0709 13:18:56.022640 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.023877 (+  1237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.024061 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.029081 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 253) took 1636 ms. Trace:
I20260709 13:18:56.031289 17495 leader_election.cc:400] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9.
I20260709 13:18:56.035310 17495 leader_election.cc:403] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:56.031628 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.980928 19891 raft_consensus.cc:697] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:56.033912 17599 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:56.034478 17598 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:55.938150 20026 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.035151 17597 rpcz_store.cc:276] 0709 13:18:54.393048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.971858 (+1578810us) service_pool.cc:224] Handling call
0709 13:18:56.027915 (+ 56057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.028256 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.028313 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.028516 (+   203us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:56.028664 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.028889 (+   225us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.029014 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.043159 17495 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:56.108297 17600 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:18:56.363931 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 320851us
I20260709 13:18:56.364215 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1466) took 1524 ms. Trace:
W20260709 13:18:56.186579 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 247630us
I20260709 13:18:56.365020 17600 rpcz_store.cc:276] 0709 13:18:54.839589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.009567 (+1169978us) service_pool.cc:224] Handling call
0709 13:18:56.042233 (+ 32666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.363963 (+321730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.364163 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.045501 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:56.364722 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:56.367120 17446 raft_consensus.cc:2393] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 6: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:56.367379 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:56.368227 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1463) took 1551 ms. Trace:
I20260709 13:18:56.368618 17599 rpcz_store.cc:276] 0709 13:18:54.817275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.003672 (+1186397us) service_pool.cc:224] Handling call
0709 13:18:56.033592 (+ 29920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.367931 (+334339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.368101 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.241182 17448 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:56.041702 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:56.168740 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:56.365411 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.371237 17527 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:56.372463 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1445) took 1566 ms. Trace:
I20260709 13:18:56.366474 17523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:18:56.375067 17523 raft_consensus.cc:606] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:56.372876 17528 rpcz_store.cc:276] 0709 13:18:54.806375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.457439 (+651064us) service_pool.cc:224] Handling call
0709 13:18:55.457739 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.760427 (+302688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.760477 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.778263 (+ 17786us) log.cc:844] Serialized 26 byte log entry
0709 13:18:55.980033 (+201770us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:55.980186 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.986490 (+  6304us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54003412d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:55.986631 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.193185 (+206554us) raft_consensus.cc:1685] finished
0709 13:18:56.193204 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.372391 (+179187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2196,"raft.queue_time_us":6897,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":30945,"spinlock_wait_cycles":641833728,"thread_start_us":40699,"threads_started":1,"wal-append.queue_time_us":315148}
I20260709 13:18:56.382122 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:56.383051 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.016707 20017 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:56.016245 20141 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:56.386107 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:56.385263 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 401421us
W20260709 13:18:56.255755 20147 log.cc:927] Time spent T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:18:56.012444 19754 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.026435 20089 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.283331 20071 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:56.353911 19948 consensus_meta.cc:287] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.951s	user 0.004s	sys 0.007s
W20260709 13:18:56.253382 20118 consensus_meta.cc:287] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.000s
I20260709 13:18:56.438278 17449 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.439247 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:56.463900 17527 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.402360 17528 raft_consensus.cc:1240] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:56.363005 20084 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.103538 19665 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:56.351928 20150 raft_consensus.cc:3055] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:56.476833 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:56.387462 20017 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.044275 20010 raft_consensus.cc:2764] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:56.372711 20129 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:56.469257 20102 consensus_meta.cc:287] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.758s	user 0.012s	sys 0.000s
I20260709 13:18:56.121012 20127 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:18:56.466284 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:56.497574 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:56.442591 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 173767us
I20260709 13:18:56.385409 20021 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:56.474854 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1382) took 1113 ms. Trace:
I20260709 13:18:56.477324 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1379) took 1161 ms. Trace:
I20260709 13:18:56.477588 17452 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:18:56.029320 20087 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:56.033203 19705 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:56.377063 20123 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.377086 20132 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:56.487486 19938 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.456596 19754 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:56.438002 20142 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:56.105942 20128 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.511544 17449 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:18:56.518275 17527 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:56.541708 17522 raft_consensus.cc:2410] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:18:56.570317 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.472697 20101 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.473651 20111 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.471423 19665 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.538455 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1702) took 1044 ms. Trace:
I20260709 13:18:56.473519 20118 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:56.442255 20070 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:18:56.364893 20119 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:56.554303 20102 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:56.481309 20153 raft_consensus.cc:3055] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:56.545346 20089 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:18:56.565236 20161 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:56.476285 20150 raft_consensus.cc:740] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:18:56.563195 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 179605us
I20260709 13:18:56.583650 19665 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:56.494861 20066 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:56.470937 20110 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.080s
W20260709 13:18:56.593222 20137 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:18:56.492329 20017 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:56.544996 17454 rpcz_store.cc:276] 0709 13:18:55.315691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.380840 (+ 65149us) service_pool.cc:224] Handling call
0709 13:18:55.387176 (+  6336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.387428 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:55.947593 (+560165us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.474846 (+527253us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b1800089260. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab29f3c0a 00007f5abc133219 00007f5ab2a7ba40 00007f5ab2a764e4 00007f5ab2a76455 00007f5ab955e3c7 00007f5ab5b709a7 00007f5ab5b800bf 00007f5ab5b80038
0709 13:18:56.475063 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.476821 (+  1758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.476906 (+    85us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:56.476985 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.477085 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.477244 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107765,"prepare.queue_time_us":605505,"prepare.run_wall_time_us":40,"raft.queue_time_us":43754,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":60710,"spinlock_wait_cycles":40761856,"thread_start_us":562753,"threads_started":2,"wal-append.queue_time_us":284624}
I20260709 13:18:56.578738 17452 rpcz_store.cc:276] 0709 13:18:55.493977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.442075 (+948098us) service_pool.cc:224] Handling call
0709 13:18:56.537946 (+ 95871us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.481980 19974 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.581439 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:56.617053 17449 raft_consensus.cc:2393] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:56.576157 17419 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:56.539490 17448 rpcz_store.cc:276] 0709 13:18:55.361835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.376318 (+ 14483us) service_pool.cc:224] Handling call
0709 13:18:56.474668 (+1098350us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540030ff54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:56.474795 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334930816}
I20260709 13:18:56.565008 20021 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:56.561565 20132 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:56.568567 20142 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:56.495011 20129 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:56.560914 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.594759 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 134854us
I20260709 13:18:56.547143 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1368) took 1379 ms. Trace:
W20260709 13:18:56.590452 17596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.018s	sys 0.026s
I20260709 13:18:56.600886 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:56.564241 19891 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:56.589648 20010 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:56.603678 20152 log.cc:927] Time spent T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.350s	user 0.001s	sys 0.001s
W20260709 13:18:56.604750 20155 log.cc:927] Time spent T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:18:56.604393 20150 consensus_queue.cc:260] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:56.607749 20098 consensus_meta.cc:287] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.884s	user 0.010s	sys 0.000s
I20260709 13:18:56.564633 20123 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:56.616954 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:56.592557 20153 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:18:56.617553 18166 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.000s	sys 0.012s
I20260709 13:18:56.618300 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:56.621619 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1700) took 1139 ms. Trace:
I20260709 13:18:56.595727 20102 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.594807 20087 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:18:56.622422 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 51081.3us
I20260709 13:18:56.601209 20128 raft_consensus.cc:3055] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:56.615002 20070 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
W20260709 13:18:56.686946 18166 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.004s	sys 0.025s
W20260709 13:18:56.627408 17596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.019s	sys 0.026s
I20260709 13:18:56.580524 20101 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.623668 17451 rpcz_store.cc:276] 0709 13:18:55.167906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.239357 (+ 71451us) service_pool.cc:224] Handling call
0709 13:18:55.239737 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.240003 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:55.675649 (+435646us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.540472 (+864823us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b18003ede80. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab570e4bc 00007f5ab2a5c48b 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab570623a
0709 13:18:56.546618 (+  6146us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.546695 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:56.546782 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.546876 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.547061 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5824,"prepare.queue_time_us":695030,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":15242,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8599,"spinlock_wait_cycles":125937024,"thread_start_us":696105,"threads_started":2,"wal-append.queue_time_us":268733}
I20260709 13:18:56.657102 20026 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.623425 20132 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:56.589344 20111 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:56.657925 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 57124.1us
I20260709 13:18:56.628130 20142 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:56.690995 20128 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:56.691640 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:56.695359 17449 rpcz_store.cc:276] 0709 13:18:55.482421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.581048 (+1098627us) service_pool.cc:224] Handling call
0709 13:18:56.621564 (+ 40516us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:56.695380 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 712048us
I20260709 13:18:56.602383 20161 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.696261 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1462) took 1925 ms. Trace:
I20260709 13:18:56.705482 17596 rpcz_store.cc:276] 0709 13:18:54.771312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.999349 (+1228037us) service_pool.cc:224] Handling call
0709 13:18:55.999667 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.695745 (+696078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.695792 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.695860 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:56.695928 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.696027 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.696180 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26670,"raft.queue_time_us":539316,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":17110,"thread_start_us":680703,"threads_started":1}
I20260709 13:18:56.707125 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:56.707840 17451 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
W20260709 13:18:56.697503 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 204613us
I20260709 13:18:56.708329 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1718) took 1010 ms. Trace:
I20260709 13:18:56.708715 17451 rpcz_store.cc:276] 0709 13:18:55.698003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.701884 (+1003881us) service_pool.cc:224] Handling call
0709 13:18:56.708269 (+  6385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.626832 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:56.694451 20166 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.627765 20129 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:56.636560 17569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.001s	sys 0.004s
I20260709 13:18:56.697170 17448 raft_consensus.cc:2410] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:56.658344 20098 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.622398 20168 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.142s
I20260709 13:18:56.709008 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:56.780695 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:56.782501 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1717) took 1094 ms. Trace:
I20260709 13:18:56.782928 17449 rpcz_store.cc:276] 0709 13:18:55.688506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.704992 (+1016486us) service_pool.cc:224] Handling call
0709 13:18:56.782430 (+ 77438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.783450 20123 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:56.784381 17449 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:56.784057 19754 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:56.634675 20010 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.788025 20010 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.760293 17521 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:56.792433 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1701) took 1298 ms. Trace:
I20260709 13:18:56.792944 17449 rpcz_store.cc:276] 0709 13:18:55.493626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.783698 (+1290072us) service_pool.cc:224] Handling call
0709 13:18:56.784038 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.784770 (+   732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.791266 (+  6496us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.797003 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1715) took 1116 ms. Trace:
W20260709 13:18:56.751048 20155 log.cc:927] Time spent T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:18:56.709846 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:56.810639 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:18:56.791189 17569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.004s	sys 0.020s
I20260709 13:18:56.758603 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:56.811296 17526 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.811647 17529 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:56.791453 20066 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.756850 20102 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:56.802791 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 179217us
W20260709 13:18:56.803651 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.701658 19898 consensus_meta.cc:287] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.003s	user 0.006s	sys 0.006s
I20260709 13:18:56.780474 20174 consensus_queue.cc:1059] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:18:56.811892 20093 consensus_meta.cc:287] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.823s	user 0.010s	sys 0.001s
I20260709 13:18:56.691712 20021 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:56.780678 20164 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:18:56.784071 20123 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:18:56.756487 20171 log.cc:927] Time spent T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:56.711051 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1373) took 1525 ms. Trace:
W20260709 13:18:56.825066 19821 consensus_meta.cc:287] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 1.152s	user 0.011s	sys 0.001s
I20260709 13:18:56.751330 20084 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:56.812726 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:56.800652 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1710) took 1304 ms. Trace:
I20260709 13:18:56.878625 17449 rpcz_store.cc:276] 0709 13:18:55.496345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.796337 (+1299992us) service_pool.cc:224] Handling call
0709 13:18:56.799604 (+  3267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.800133 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.800167 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.800222 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:56.800296 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.800403 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.800583 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:56.814077 17569 connection.cc:256] RPC call timeout handler was delayed by -1.7047534119999455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 13:18:56.837262 20098 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:56.757197 18193 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:56.828291 18166 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:18:56.886515 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 58301.1us
I20260709 13:18:56.889287 20017 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.890813 17452 raft_consensus.cc:2393] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:56.892557 20087 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:56.892905 20087 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.893150 20087 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.800372 20175 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 13:18:56.879494 20173 consensus_queue.cc:1059] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:18:56.895563 20173 raft_consensus.cc:3055] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:56.895902 20173 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:56.896817 20173 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.756682 20153 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.877666 20170 raft_consensus.cc:3055] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:56.898757 20170 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:56.898846 20153 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.899660 20170 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.900897 20170 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:56.856956 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 158005us
I20260709 13:18:56.902218 20087 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:56.903319 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:56.906466 20087 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.906819 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:56.908077 20102 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.866077 20016 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.910777 20101 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.911226 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:56.912498 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:56.913069 17529 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.915421 20173 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:56.850155 17420 leader_election.cc:400] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8.
I20260709 13:18:56.917608 20132 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:56.926802 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 76822.5us
I20260709 13:18:56.927103 17525 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:56.929060 20132 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:56.929543 19709 consensus_meta.cc:287] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.900s	user 0.009s	sys 0.002s
I20260709 13:18:56.863188 17601 raft_consensus.cc:2410] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:18:56.865550 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 170571us
W20260709 13:18:56.866833 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.930055 19709 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.931036 20161 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:56.854987 20142 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.863999 20093 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.932067 17419 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:56.809504 17448 rpcz_store.cc:276] 0709 13:18:55.680310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.618055 (+937745us) service_pool.cc:224] Handling call
0709 13:18:56.796918 (+178863us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.933485 17448 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:56.866863 17453 rpcz_store.cc:276] 0709 13:18:55.186324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.319641 (+133317us) service_pool.cc:224] Handling call
0709 13:18:55.357918 (+ 38277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.410770 (+ 52852us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:55.853256 (+442486us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.032063 (+178807us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.120418 (+ 88355us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.120590 (+   172us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:56.120625 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.120691 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.710834 (+590143us) raft_consensus.cc:1685] finished
0709 13:18:56.710853 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.710983 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":439542,"prepare.queue_time_us":610249,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":8767,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":92504,"thread_start_us":433602,"threads_started":2,"wal-append.queue_time_us":616492}
I20260709 13:18:56.870252 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:56.871193 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:56.872080 17598 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:56.872860 19652 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.873988 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:56.814755 20028 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.810639 20166 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:56.815625 19981 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.802253 17451 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:56.835934 19754 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:56.837759 20118 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:56.879944 17569 connection.cc:256] RPC call timeout handler was delayed by -1.6885534120001466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 13:18:56.982151 17569 connection.cc:256] RPC call timeout handler was delayed by -1.5931534119999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
W20260709 13:18:56.982241 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 54404.1us
W20260709 13:18:56.982637 17569 connection.cc:256] RPC call timeout handler was delayed by -1.4446534119999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:18:56.982950 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1711) took 1486 ms. Trace:
W20260709 13:18:56.983076 17569 connection.cc:256] RPC call timeout handler was delayed by -1.395153412000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
I20260709 13:18:56.878662 19821 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.812435 20141 raft_consensus.cc:697] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:56.983619 20178 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:56.984668 20141 consensus_queue.cc:237] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.985515 19821 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:56.813949 20168 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:56.987320 20168 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:56.882819 17449 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:56.825978 19665 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.917536 20129 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.710806 17454 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:18:56.859099 17526 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
W20260709 13:18:57.026562 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 94552us
W20260709 13:18:56.983556 17569 connection.cc:256] RPC call timeout handler was delayed by -1.3465534120000484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 13:18:56.942637 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.934782 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:18:56.978489 17529 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:18:56.978962 17597 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:18:56.977615 20084 raft_consensus.cc:697] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:56.977392 20028 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:56.842531 20066 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:56.976653 17595 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.027287 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 196) took 1015 ms. Trace:
I20260709 13:18:56.988909 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1714) took 1311 ms. Trace:
W20260709 13:18:57.037295 17569 connection.cc:256] RPC call timeout handler was delayed by -1.3465534120000484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 13:18:57.042627 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:57.039352 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 56196.3us
W20260709 13:18:56.997982 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.014252 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:57.055371 17448 rpcz_store.cc:276] 0709 13:18:56.012101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.934201 (+922100us) service_pool.cc:224] Handling call
0709 13:18:56.934504 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.026866 (+ 92362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.026904 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.026953 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:57.027006 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.027086 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.027223 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91983,"raft.queue_time_us":93060,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91}
I20260709 13:18:57.056877 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:57.056783 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:57.057799 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:57.058139 17569 connection.cc:256] RPC call timeout handler was delayed by -1.2934534119999626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 13:18:57.058579 17569 connection.cc:256] RPC call timeout handler was delayed by -1.1557534119999673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
I20260709 13:18:57.058874 18166 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:56.983464 17451 rpcz_store.cc:276] 0709 13:18:55.496772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.798801 (+1302029us) service_pool.cc:224] Handling call
0709 13:18:56.801780 (+  2979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.982704 (+180924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.982894 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.054648 17449 rpcz_store.cc:276] 0709 13:18:55.677330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.879472 (+1202142us) service_pool.cc:224] Handling call
0709 13:18:56.882516 (+  3044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.988642 (+106126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.988848 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.025812 20168 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:56.996234 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:57.027797 20118 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.027565 20101 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:57.028357 20142 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:57.060315 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.064572 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:57.059811 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.043967 17568 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:57.064944 19974 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:57.066952 20101 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:57.067742 19974 raft_consensus.cc:697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:18:57.062995 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 128294us
I20260709 13:18:57.062865 17600 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.933935 20067 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.068421 19665 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:57.060547 19981 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:57.075469 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.060606 19891 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.062247 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:57.079684 17529 raft_consensus.cc:2368] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6.
I20260709 13:18:57.072181 17569 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.081489 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.082855 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:57.083696 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.083946 17595 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:18:57.083654 17597 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:18:57.084780 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:57.078655 20127 consensus_meta.cc:287] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.004s
I20260709 13:18:57.073091 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:57.087357 17420 leader_election.cc:400] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8.
I20260709 13:18:57.070808 20168 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:57.045102 20084 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.106665 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:57.107904 17597 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.085793 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:56.988593 19652 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:57.074946 20183 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.074146 20148 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:18:57.087486 19981 raft_consensus.cc:697] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:57.088346 17568 leader_election.cc:400] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6.
I20260709 13:18:57.121930 17568 leader_election.cc:403] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:57.098163 17600 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:18:57.031056 20166 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:57.089304 19865 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.099587 19898 consensus_queue.cc:1059] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:57.084549 19754 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.100767 20016 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.098804 20132 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.098927 20127 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9.
W20260709 13:18:57.105317 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.083141 20161 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.119602 20168 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:57.107147 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:57.109218 17529 raft_consensus.cc:2393] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 6: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:57.143151 17595 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:57.097107 17569 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:57.145591 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 48552.9us
I20260709 13:18:57.074090 20098 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:57.158370 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 47461.9us
I20260709 13:18:57.116847 17495 leader_election.cc:400] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:57.096822 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.094844 20073 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.094919 19665 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.123260 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:57.098232 19709 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:57.082656 20067 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:57.128832 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 47938.4us
I20260709 13:18:57.075891 19974 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:57.116284 20102 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.119825 20138 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:57.088959 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:57.147531 20066 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:57.140614 20016 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.188228 20138 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.190378 20138 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.147604 19981 consensus_queue.cc:237] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:57.193816 20127 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:57.194743 20127 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:57.141741 20132 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.197865 20127 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:57.199178 20132 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:57.199682 17597 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:18:57.154194 20101 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:57.121155 20070 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:18:57.154081 20148 consensus_queue.cc:1059] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:57.157464 19865 raft_consensus.cc:2764] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 13:18:57.160194 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 63465.2us
I20260709 13:18:57.203426 17420 leader_election.cc:400] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 3 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4.
I20260709 13:18:57.204886 17420 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.160634 17495 leader_election.cc:403] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:57.165084 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.166298 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:57.164503 17598 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:57.171922 17523 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:18:57.177595 18167 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:18:57.208209 17603 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:57.207142 20132 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5.
I20260709 13:18:57.209475 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:57.208273 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:57.161554 20183 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:57.158489 18195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42536 (request call id 191) took 2309 ms (client timeout 1963 ms). Trace:
I20260709 13:18:57.210988 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:57.218962 17603 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:57.213187 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:57.213464 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 48496.7us
I20260709 13:18:57.221993 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.214972 17420 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.224169 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:57.207201 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 90609.5us
I20260709 13:18:57.226990 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:57.187853 20129 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:57.232196 17603 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:57.234954 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.165093 19665 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.211611 20170 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6.
I20260709 13:18:57.242156 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:57.216377 20101 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.179957 20173 consensus_queue.cc:1059] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:18:57.246803 17599 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:57.252364 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:57.230589 19754 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.226366 19865 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.189239 20102 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:57.233208 20066 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.233060 20175 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.242012 20073 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.261530 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:57.263286 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:57.269066 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.241967 20028 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:57.244268 20169 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:57.274704 17526 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.276446 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:57.278225 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:57.282361 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1709) took 1786 ms. Trace:
I20260709 13:18:57.282929 17454 rpcz_store.cc:276] 0709 13:18:55.496101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.612569 (+1116468us) service_pool.cc:224] Handling call
0709 13:18:57.282132 (+669563us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b5400369054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:57.282281 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126260992}
I20260709 13:18:57.256942 20166 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:57.257249 20129 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.279989 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:57.217142 18195 rpcz_store.cc:269] 0709 13:18:54.833211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.839080 (+  5869us) service_pool.cc:224] Handling call
0709 13:18:57.137830 (+2298750us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54005627d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:57.142803 (+  4973us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567403904}
W20260709 13:18:57.316350 17420 connection.cc:256] RPC call timeout handler was delayed by -1.2623982539998906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
I20260709 13:18:57.328485 20193 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.329306 20193 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:57.332521 20193 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:57.333760 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1457) took 2567 ms. Trace:
I20260709 13:18:57.276302 20132 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.335908 17526 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:57.334370 17594 rpcz_store.cc:276] 0709 13:18:54.765999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.973006 (+1207007us) service_pool.cc:224] Handling call
0709 13:18:55.999004 (+ 25998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.999215 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:56.120915 (+121700us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.333141 (+1212226us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b1800443c80. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab570e4bc 00007f5ab2a5c48b 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a76455 00007f5ab5b5e060 00007f5ab5b70716 00007f5ab5b81287
0709 13:18:57.333268 (+   127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.333338 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:57.333423 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.333531 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.333682 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4570,"prepare.queue_time_us":482227,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":53,"raft.queue_time_us":121363,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":2377,"spinlock_wait_cycles":4211584,"thread_start_us":553877,"threads_started":3,"wal-append.queue_time_us":444914}
I20260709 13:18:57.292064 19754 consensus_queue.cc:1059] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
W20260709 13:18:57.395416 17450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1694) took 4418 ms (client timeout 2591 ms). Trace:
W20260709 13:18:57.414700 17450 rpcz_store.cc:269] 0709 13:18:52.976838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.977071 (+   233us) service_pool.cc:224] Handling call
0709 13:18:57.395172 (+4418101us) spinlock_profiling.cc:243] Waited 4 s on lock 0x7b54000d98d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:57.395313 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9188890496}
I20260709 13:18:57.383054 17529 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:18:57.381606 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.340726 19652 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:57.291911 20196 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:57.409106 19865 raft_consensus.cc:3055] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:57.241793 20168 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.292076 20169 raft_consensus.cc:697] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:57.286139 20127 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:57.285806 20070 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:57.339049 17420 leader_election.cc:336] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.789s (SENT)
I20260709 13:18:57.336659 20175 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:57.448873 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 109863us
W20260709 13:18:57.453177 17420 leader_election.cc:336] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.803s (SENT)
W20260709 13:18:57.454249 17420 leader_election.cc:336] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.877s (SENT)
W20260709 13:18:57.455238 17420 leader_election.cc:336] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.898s (SENT)
W20260709 13:18:57.456213 17420 leader_election.cc:336] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.909s (SENT)
I20260709 13:18:57.456655 17420 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:57.379137 20191 log.cc:927] Time spent T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:18:57.383733 20187 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:18:57.336190 20067 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:57.458941 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 281475us
I20260709 13:18:57.389184 20026 raft_consensus.cc:3055] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:57.390305 20151 raft_consensus.cc:3055] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:57.391906 20016 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:57.391281 20102 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:57.391769 19665 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:57.391104 18193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42538 (request call id 280) took 3648 ms (client timeout 1998 ms). Trace:
I20260709 13:18:57.467005 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:57.385951 20111 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:57.468520 17420 leader_election.cc:336] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.945s (SENT)
W20260709 13:18:57.471161 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 239838us
I20260709 13:18:57.486900 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:57.487768 17569 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.436190 19865 raft_consensus.cc:740] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:57.477298 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:57.462378 20127 raft_consensus.cc:697] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:57.479306 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:18:57.482374 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:57.487005 17454 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
W20260709 13:18:57.460487 20153 consensus_meta.cc:287] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.007s
I20260709 13:18:57.468784 20151 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:57.489033 17420 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.458880 20120 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.452217 20196 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:18:57.461395 20110 raft_consensus.cc:3055] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:57.393126 20138 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:57.493400 17450 raft_consensus.cc:2393] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 7: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:57.520521 18198 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.463816 20026 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:18:57.520524 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 197861us
I20260709 13:18:57.488279 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:57.472822 19754 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.471555 20070 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:18:57.539327 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 70859.8us
I20260709 13:18:57.520133 20066 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.492939 20190 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 13:18:57.557097 17420 leader_election.cc:336] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.951s (SENT)
I20260709 13:18:57.531832 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:57.558916 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 106977us
I20260709 13:18:57.532181 20175 raft_consensus.cc:697] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:57.539883 20110 raft_consensus.cc:740] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:57.532896 20161 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:18:57.532543 20203 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:18:57.556231 20101 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:57.494100 18193 rpcz_store.cc:269] 0709 13:18:53.742741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.742904 (+   163us) service_pool.cc:224] Handling call
0709 13:18:57.390904 (+3648000us) spinlock_profiling.cc:243] Waited 2.59 s on lock 0x7b54007b1954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:57.391023 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5962198784}
I20260709 13:18:57.540491 20120 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.552773 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:57.582422 18198 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:18:57.550477 20201 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:18:57.537021 20169 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:57.597628 17420 leader_election.cc:336] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.018s (SENT)
I20260709 13:18:57.598471 17420 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:57.598937 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 65143.2us
I20260709 13:18:57.551414 20153 consensus_queue.cc:1059] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:18:57.605978 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.610991 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:57.612326 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:57.613168 17445 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
W20260709 13:18:57.614161 17420 leader_election.cc:336] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.677s (SENT)
I20260709 13:18:57.614492 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:57.614784 17420 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:57.616235 17420 leader_election.cc:336] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.729s (SENT)
I20260709 13:18:57.618350 17420 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.618768 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:57.619614 17447 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:57.620747 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:57.621764 17447 raft_consensus.cc:2393] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 5: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:57.625205 20212 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:57.631091 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:57.632390 20120 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:57.632776 17448 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:57.633257 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:57.633973 17446 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
W20260709 13:18:57.620388 17420 leader_election.cc:336] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.994s (SENT)
I20260709 13:18:57.635161 17420 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.606770 20101 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:57.564875 19865 consensus_queue.cc:260] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.636564 17569 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:57.636407 17420 leader_election.cc:336] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.075s (SENT)
I20260709 13:18:57.638777 20173 raft_consensus.cc:3055] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:57.639032 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:57.639223 20201 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:57.639495 20120 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.641315 17420 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.604897 20142 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:57.641479 20110 consensus_queue.cc:260] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.617312 20084 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.637509 19754 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.617480 20166 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:18:57.636773 19665 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:18:57.583786 20127 consensus_queue.cc:237] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.729224 20138 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:57.616885 20070 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:57.730541 20206 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:18:57.731930 17526 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:57.687558 17601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1461) took 2917 ms (client timeout 1778 ms). Trace:
I20260709 13:18:57.724185 20142 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:18:57.732867 17601 rpcz_store.cc:269] 0709 13:18:54.769953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.317928 (+547975us) service_pool.cc:224] Handling call
0709 13:18:57.687196 (+2369268us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400314554. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:57.687455 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3341002496}
W20260709 13:18:57.683822 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 47320.6us
I20260709 13:18:57.580348 20026 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.642899 17454 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:57.597520 20196 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:57.718566 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 82171us
I20260709 13:18:57.739740 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:18:57.740350 17420 leader_election.cc:336] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.177s (SENT)
I20260709 13:18:57.740882 17420 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:57.742507 17420 leader_election.cc:336] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.202s (SENT)
I20260709 13:18:57.743113 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:57.725387 17522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 1444) took 3212 ms (client timeout 1901 ms). Trace:
I20260709 13:18:57.725739 17520 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:18:57.721251 20101 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.744349 17520 pending_rounds.cc:85] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 5
I20260709 13:18:57.744762 17520 pending_rounds.cc:107] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:18:57.744249 17522 rpcz_store.cc:269] 0709 13:18:54.513477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.825185 (+311708us) service_pool.cc:224] Handling call
0709 13:18:57.725054 (+2899869us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b5400090454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:57.725287 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3920163072}
I20260709 13:18:57.730451 20017 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:57.732060 20202 log.cc:927] Time spent T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:18:57.686067 20066 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.733238 17526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54542
I20260709 13:18:57.751662 17526 raft_consensus.cc:606] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Received request to transfer leadership
W20260709 13:18:57.714211 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 96386.6us
I20260709 13:18:57.752100 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:57.724514 18195 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 9. Ops: []
I20260709 13:18:57.752708 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:57.753301 17450 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.734668 17569 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.582337 20151 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.715479 20173 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:57.745312 17520 raft_consensus.cc:2889] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:57.727188 20110 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.641340 20175 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:57.748021 17420 leader_election.cc:336] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.455s (SENT)
I20260709 13:18:57.755483 17569 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.735952 19865 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.753659 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:57.752846 20026 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.782603 20151 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.783192 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:57.784340 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:57.785032 17525 raft_consensus.cc:2368] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6.
I20260709 13:18:57.748164 19754 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.787539 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:57.766713 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:57.788844 17420 leader_election.cc:336] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 3.115s (SENT)
I20260709 13:18:57.730569 18197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42538 (request call id 285) took 1802 ms. Trace:
I20260709 13:18:57.791524 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:57.763325 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 197) took 1737 ms. Trace:
I20260709 13:18:57.794709 17525 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:57.794978 17453 rpcz_store.cc:276] 0709 13:18:56.026413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.976196 (+949783us) service_pool.cc:224] Handling call
0709 13:18:57.040202 (+ 64006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.078791 (+ 38589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.078837 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.086104 (+  7267us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.180650 (+ 94546us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:57.180695 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.749838 (+569143us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b54000dbbd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:57.749889 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:57.749937 (+    48us) raft_consensus.cc:1685] finished
0709 13:18:57.749952 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.763257 (+ 13305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2365,"raft.queue_time_us":2279,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5984,"spinlock_wait_cycles":80992000,"thread_start_us":62085,"threads_started":1,"wal-append.queue_time_us":228579}
I20260709 13:18:57.797204 17450 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:57.789417 17420 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.800402 17419 leader_election.cc:400] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6.
I20260709 13:18:57.800740 17419 leader_election.cc:403] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:18:57.804598 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 49237us
I20260709 13:18:57.818555 17569 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.819555 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.820814 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:57.774869 20209 log.cc:927] Time spent T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:57.750404 20183 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.765424 19665 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:57.832118 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:57.775580 20214 log.cc:927] Time spent T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:57.771767 20201 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:57.838317 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.767001 20167 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:57.798939 20073 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.839944 17569 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.803049 20166 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:57.816529 20205 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:57.823189 20066 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.827696 20161 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.816978 20089 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.802631 20017 consensus_queue.cc:1059] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:18:57.816382 20120 consensus_queue.cc:1059] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:18:57.869252 17449 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:57.849586 17569 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.843709 20167 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:57.830677 19754 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.842214 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 254) took 1132 ms. Trace:
I20260709 13:18:57.850178 20166 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:57.770699 20173 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:57.823904 20204 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:18:57.825234 20170 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.866106 18167 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.845062 19665 raft_consensus.cc:697] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:57.878754 20066 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:57.890246 19665 consensus_queue.cc:237] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.890846 20174 raft_consensus.cc:3055] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:57.891287 20174 raft_consensus.cc:740] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:57.892135 20174 consensus_queue.cc:260] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.893388 20174 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.859611 20153 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:57.896258 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1805) took 1137 ms. Trace:
I20260709 13:18:57.896672 17523 rpcz_store.cc:276] 0709 13:18:56.758411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.758660 (+   249us) service_pool.cc:224] Handling call
0709 13:18:57.896087 (+1137427us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400089154. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:57.896200 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843467520}
W20260709 13:18:57.900710 20208 log.cc:927] Time spent T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:18:57.864779 19898 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:18:57.880158 20073 raft_consensus.cc:3055] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:57.906522 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.844928 20205 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.907275 20205 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.884826 20166 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.778870 20142 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:57.882519 20223 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:18:57.915439 20089 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6.
I20260709 13:18:57.846978 20067 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.877368 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:57.827297 20168 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.877013 17527 rpcz_store.cc:276] 0709 13:18:56.709455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.709603 (+   148us) service_pool.cc:224] Handling call
0709 13:18:57.841938 (+1132335us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400020dd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:57.842143 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965710080}
W20260709 13:18:57.879981 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 76288.3us
I20260709 13:18:57.918375 19974 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:57.919595 17445 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:18:57.920208 20190 consensus_queue.cc:1059] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:57.920600 18195 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:57.882335 17420 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:18:57.888617 20132 consensus_meta.cc:287] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.001s
I20260709 13:18:57.922123 20132 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.838948 20201 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:57.922968 20201 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.889791 20066 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.847951 20216 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:57.923830 17529 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:57.906440 20073 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:18:57.928819 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.897873 20111 raft_consensus.cc:3055] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:57.947876 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:57.947360 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 76044.7us
I20260709 13:18:57.950045 17569 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.935454 20110 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.799211 18197 rpcz_store.cc:276] 0709 13:18:55.928651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.936207 (+  7556us) service_pool.cc:224] Handling call
0709 13:18:55.993142 (+ 56935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.584558 (+591416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.590339 (+  5781us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.594223 (+  3884us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:56.595609 (+  1386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.730281 (+1134672us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54003fded4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:57.730330 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.730476 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315990400}
W20260709 13:18:57.955988 17420 leader_election.cc:336] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.824s (SENT)
I20260709 13:18:57.938592 20066 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.963798 20098 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:57.968413 17420 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.938643 20216 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:57.966746 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:57.968528 18198 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 4 LEARNER]: Advancing to term 6
I20260709 13:18:57.946520 20111 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:18:57.976318 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.973131 17569 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:58.002707 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:58.004776 17448 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:58.006696 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:58.007751 17446 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.008252 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:58.009878 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:58.011119 17451 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:18:58.012691 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:58.016495 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:58.017474 17451 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:58.020064 17451 pending_rounds.cc:85] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 3
I20260709 13:18:58.020706 17451 pending_rounds.cc:107] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:18:58.021136 17451 raft_consensus.cc:2889] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:57.968979 20161 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.972429 19754 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:58.000313 20098 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:58.000175 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:58.040727 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:18:58.043483 20224 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:18:58.044955 20219 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:18:57.973147 20216 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.046275 18192 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:58.047489 18193 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:58.008657 20168 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:18:58.049898 20168 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:58.063990 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:57.969765 20067 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:18:58.045835 20161 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:58.038837 18195 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:18:58.099622 20230 log.cc:927] Time spent T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:58.050545 20168 raft_consensus.cc:697] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:58.115391 18198 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:58.120222 17448 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:58.121508 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:58.126327 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:58.127198 17447 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:18:58.130342 17446 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:18:57.959082 20167 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.132557 20167 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.143064 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 250) took 3624 ms. Trace:
I20260709 13:18:58.143555 17520 rpcz_store.cc:276] 0709 13:18:54.518547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.438470 (+919923us) service_pool.cc:224] Handling call
0709 13:18:57.725242 (+2286772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.785139 (+ 59897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.142795 (+357656us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b5400090450. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:58.142961 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5258281856}
I20260709 13:18:58.102768 20111 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:58.145560 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:58.149801 18198 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:18:58.152247 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 255) took 1395 ms. Trace:
I20260709 13:18:58.154974 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1467) took 1164 ms. Trace:
I20260709 13:18:58.155546 17529 rpcz_store.cc:276] 0709 13:18:56.990696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.699575 (+708879us) service_pool.cc:224] Handling call
0709 13:18:57.705448 (+  5873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.941401 (+235953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.154633 (+213232us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400170054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:58.154889 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500215552}
W20260709 13:18:58.157675 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.088073 20073 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:58.166597 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.167351 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.168875 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:58.169724 17603 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.152832 17596 rpcz_store.cc:276] 0709 13:18:56.757342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.760839 (+  3497us) service_pool.cc:224] Handling call
0709 13:18:57.689801 (+928962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.690364 (+   563us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:57.735734 (+ 45370us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.958989 (+223255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.959056 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:57.959119 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.959191 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.151972 (+192781us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b5400314550. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:58.152160 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7006,"prepare.queue_time_us":136966,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":65,"raft.queue_time_us":27016,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":9029,"spinlock_wait_cycles":2135414016,"thread_start_us":243457,"threads_started":2,"wal-append.queue_time_us":273343}
I20260709 13:18:58.181859 17523 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:58.183750 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.187805 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.188759 17599 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:18:58.190456 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.192258 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:58.193240 17601 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.197180 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:58.202088 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.203006 17602 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:58.205121 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:58.206210 17529 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:58.208170 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:58.213986 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:58.214919 17594 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.217131 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:58.219367 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 256609us
I20260709 13:18:58.218102 17528 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:18:58.231794 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:58.233628 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:58.241932 17448 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:58.242797 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.243916 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:58.240604 18166 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:58.247394 17599 raft_consensus.cc:2410] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:58.249806 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.250824 17595 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:58.245123 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:58.255023 17495 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:58.256801 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:58.262414 20232 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:58.263160 20232 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.263595 20232 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.265169 20093 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:58.265597 20093 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:58.265962 20093 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.268740 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1481) took 1340 ms. Trace:
I20260709 13:18:58.274444 20204 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.249681 20087 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:58.277807 17601 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:58.263746 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.258129 17568 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:58.229570 20127 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:58.288554 17602 raft_consensus.cc:2410] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:18:58.294641 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.269331 17597 rpcz_store.cc:276] 0709 13:18:56.927840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.213802 (+285962us) service_pool.cc:224] Handling call
0709 13:18:57.215254 (+  1452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:57.281781 (+ 66527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.281818 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:57.282497 (+   679us) log.cc:844] Serialized 52 byte log entry
0709 13:18:57.538254 (+255757us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:57.609139 (+ 70885us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.641181 (+ 32042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.900126 (+258945us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:18:58.268265 (+368139us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b540027bfd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:58.268342 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.268411 (+    69us) raft_consensus.cc:1685] finished
0709 13:18:58.268434 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.268654 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32934,"prepare.queue_time_us":210565,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":31420,"raft.queue_time_us":37794,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":44842,"spinlock_wait_cycles":161360000,"thread_start_us":196077,"threads_started":2,"wal-append.queue_time_us":379186}
I20260709 13:18:58.295181 17601 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:58.296075 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 283579us
I20260709 13:18:58.295825 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:58.297919 17594 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
W20260709 13:18:58.323939 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.324699 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 46382.6us
I20260709 13:18:58.326164 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:18:58.331163 17452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1706) took 2836 ms (client timeout 3345 ms). Trace:
W20260709 13:18:58.331704 17452 rpcz_store.cc:269] 0709 13:18:55.495267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.612506 (+1117239us) service_pool.cc:224] Handling call
0709 13:18:58.330907 (+1718401us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b5400320354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:58.331087 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205213568}
I20260709 13:18:58.334776 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:58.338517 20067 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:58.339103 20067 raft_consensus.cc:697] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:58.340068 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:58.339949 20067 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.341472 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:58.346196 19898 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.283146 20191 log.cc:927] Time spent T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:58.277050 20222 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:58.281915 20087 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.359889 17495 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:58.349594 20093 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.301631 20223 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:58.362571 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:58.321172 20028 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:58.369342 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:58.346262 20167 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.360109 19865 consensus_meta.cc:287] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.000s
I20260709 13:18:58.375605 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.356355 20138 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:58.365248 20087 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.359259 20222 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:58.402299 20222 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.354425 19898 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.244176 20227 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 13:18:58.406047 20150 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.407416 20066 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:58.412575 17598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1479) took 1506 ms (client timeout 1787 ms). Trace:
W20260709 13:18:58.413045 17598 rpcz_store.cc:269] 0709 13:18:56.905880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.013850 (+107970us) service_pool.cc:224] Handling call
0709 13:18:58.412407 (+1398557us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b5400061b54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:58.412507 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114566912}
I20260709 13:18:58.414310 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.415654 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:58.416365 17598 raft_consensus.cc:2410] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:58.417129 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.418604 17596 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:58.413748 20084 raft_consensus.cc:3055] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:58.419509 20084 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:18:58.419637 20087 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:58.420766 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.420470 20084 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.421610 20084 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.416419 20222 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.423254 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:58.424116 20238 log.cc:927] Time spent T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:18:58.365482 20026 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:58.425662 20026 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:58.426211 20026 raft_consensus.cc:697] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:58.427275 19665 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:58.427150 20026 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.427927 19665 raft_consensus.cc:697] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:58.428908 19665 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.430112 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:58.330125 20127 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.430992 17528 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:18:58.356014 20205 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.286787 20166 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.430685 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.438925 17598 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
W20260709 13:18:58.393790 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.390170 20028 raft_consensus.cc:697] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:58.321350 20168 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:58.367251 20213 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:58.393819 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:58.466686 19898 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:58.467495 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.468202 17602 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:18:58.469134 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:58.389779 20167 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.472599 20167 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:58.469883 17602 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:58.477392 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:58.479095 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:58.350554 20132 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:18:58.401031 20016 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:58.485067 18198 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:58.480711 17528 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:18:58.482781 17603 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:58.504791 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.512777 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.526271 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:58.409840 20066 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:58.540149 17603 raft_consensus.cc:2368] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6.
I20260709 13:18:58.541462 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:58.532441 20201 consensus_meta.cc:287] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.008s
W20260709 13:18:58.524878 20200 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:18:58.541133 20087 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:58.527540 18192 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:58.526173 20151 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.558947 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.531672 20093 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:58.568387 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.569303 17602 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:18:58.488354 20232 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.541378 20110 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:18:58.556030 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:58.574303 17523 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:58.575392 17603 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:58.579546 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 217531us
W20260709 13:18:58.579954 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.581485 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:58.585108 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.558049 20201 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.589226 17602 raft_consensus.cc:2393] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:58.595898 17526 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:58.600307 17603 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
W20260709 13:18:58.601935 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.575062 20136 consensus_queue.cc:1059] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:18:58.566927 20151 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.602867 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:58.600207 20216 consensus_meta.cc:287] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.552s	user 0.024s	sys 0.000s
I20260709 13:18:58.606181 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:58.596515 20175 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:58.608737 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:18:58.621250 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 70541.5us
I20260709 13:18:58.622543 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:58.623180 17526 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.571025 20028 consensus_queue.cc:237] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.625385 20204 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:58.634135 19709 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.634966 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:58.635406 20250 log.cc:927] Time spent T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:18:58.635737 17603 raft_consensus.cc:2393] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:18:58.637118 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.638278 17526 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:18:58.638824 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.639494 17526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54542
I20260709 13:18:58.639973 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:58.640336 17526 raft_consensus.cc:606] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:18:58.641068 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:58.620525 20216 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.644115 20216 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:58.645358 20232 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:58.647312 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.634760 19709 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.648635 20201 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:58.650879 18166 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:58.652405 17596 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:18:58.655333 17603 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
W20260709 13:18:58.656266 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.666455 20138 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:58.667389 20138 raft_consensus.cc:697] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:18:58.669279 20239 log.cc:927] Time spent T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.538s	user 0.005s	sys 0.008s
I20260709 13:18:58.668686 20138 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:58.617030 20199 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:18:58.615435 20252 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:18:58.677157 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:58.678503 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:18:58.679062 20151 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:58.679659 20166 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:18:58.681927 20174 consensus_meta.cc:287] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.745s	user 0.015s	sys 0.005s
W20260709 13:18:58.687409 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.689039 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 82941.6us
I20260709 13:18:58.689595 20142 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:58.690385 20142 raft_consensus.cc:697] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:58.691605 20142 consensus_queue.cc:237] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.695036 20252 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:58.695600 20252 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:58.696777 20252 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:58.699476 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:18:58.702416 17598 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:18:58.704766 17599 raft_consensus.cc:2410] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:58.707190 17520 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:58.709849 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.693675 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:58.725148 20132 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:58.741657 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:18:58.769717 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.768573 20203 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.777252 20203 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.763651 20252 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:58.781934 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.739610 20166 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.822527 20212 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:58.823307 20212 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.792279 20203 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:58.821592 20132 raft_consensus.cc:697] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:58.784600 20170 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:58.846207 20170 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.849328 20170 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:58.856599 20166 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.765196 20151 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:58.859445 20151 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:58.833153 20132 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:58.866056 20212 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:58.871774 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:58.873059 17527 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:58.931905 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:59.002408 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.027376 20170 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.028144 20170 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:59.040359 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:59.041150 17601 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.058894 17529 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:18:59.059386 17529 pending_rounds.cc:85] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 5
I20260709 13:18:59.059618 17529 pending_rounds.cc:107] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:18:59.059865 17529 raft_consensus.cc:2889] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.068325 17601 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:59.073359 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:18:59.079602 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:59.081218 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:59.075359 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:59.081847 17595 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.061369 20173 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.079358 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:18:59.087596 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 141719us
I20260709 13:18:59.088760 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:59.092218 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:59.082715 20252 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:59.084565 20212 raft_consensus.cc:2764] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:59.102222 17595 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:18:59.073263 19665 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:18:59.106328 17595 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:59.092098 20129 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:59.111987 20129 raft_consensus.cc:697] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:18:59.088414 20175 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:18:59.113958 20129 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:59.105461 19665 consensus_queue.cc:1243] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer 2158c0f750fd4b21afe24135c52167b2 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:59.159775 20205 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:59.156558 20170 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:59.092924 17569 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:18:59.108415 17595 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:59.166745 20203 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.267902 20111 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.268540 20173 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:59.212666 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.257697 19865 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.089829 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:18:59.161751 20166 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:59.266809 20161 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.273643 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1506) took 1044 ms. Trace:
I20260709 13:18:59.268656 20203 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:18:59.206828 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.242627 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.291849 17599 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:18:59.292273 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 200382us
I20260709 13:18:59.294049 20205 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:59.298537 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 271) took 1059 ms. Trace:
I20260709 13:18:59.287263 17595 rpcz_store.cc:276] 0709 13:18:58.228741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.107429 (+878688us) service_pool.cc:224] Handling call
0709 13:18:59.107739 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.268238 (+160499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.273428 (+  5190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.301296 17599 rpcz_store.cc:276] 0709 13:18:58.236291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.252561 (+1016270us) service_pool.cc:224] Handling call
0709 13:18:59.253328 (+   767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.294749 (+ 41421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.295490 (+   741us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.302467 20161 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:59.304121 17599 raft_consensus.cc:3055] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:59.304555 17599 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:59.264436 20110 raft_consensus.cc:3055] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:59.305420 20110 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:18:59.254932 20070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.522s	user 0.025s	sys 0.018s
I20260709 13:18:57.532524 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:59.317315 20070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.585s	user 0.029s	sys 0.018s
W20260709 13:18:59.327404 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.327200 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 233874us
I20260709 13:18:59.319756 17599 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:59.331282 20128 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:59.335251 17599 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:59.336089 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.336671 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.337970 19709 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:59.338193 19865 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:59.339337 17600 raft_consensus.cc:2410] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:18:59.341142 20128 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.343067 20161 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:59.344866 20110 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:59.347363 20110 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.348356 20120 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:59.349164 20120 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:59.352054 20120 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:59.354820 18199 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:59.356467 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.356786 20227 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:59.360549 17520 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:59.364094 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:59.366287 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.341291 19865 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:59.369946 17525 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:59.370429 17525 pending_rounds.cc:85] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 3
I20260709 13:18:59.370736 17525 pending_rounds.cc:107] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:59.371037 17525 raft_consensus.cc:2889] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.373034 17523 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:59.364571 20231 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.374979 20028 consensus_queue.cc:1059] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:59.376538 20267 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:59.377339 20028 raft_consensus.cc:3055] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:59.380345 20028 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:59.382534 20028 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:59.377682 17529 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:59.375622 20231 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:59.387161 20017 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.388199 20017 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:59.390220 20267 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.390441 20231 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:59.391057 20267 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:59.385366 20028 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.393399 20267 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:59.368080 20173 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.394225 20173 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:59.397079 20173 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:59.398895 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.406826 18192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42548 (request call id 302) took 1034 ms. Trace:
I20260709 13:18:59.407421 18192 rpcz_store.cc:276] 0709 13:18:58.371857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.373953 (+  2096us) service_pool.cc:224] Handling call
0709 13:18:58.402623 (+ 28670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.570726 (+168103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.406220 (+835494us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b5400227254. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:59.406631 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166014208}
I20260709 13:18:59.410619 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:18:59.410985 17603 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:59.410748 19865 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.411640 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1291) took 1062 ms. Trace:
I20260709 13:18:59.412029 17603 rpcz_store.cc:276] 0709 13:18:58.349313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.409959 (+1060646us) service_pool.cc:224] Handling call
0709 13:18:59.410507 (+   548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.411409 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.411583 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.411744 19865 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:59.415465 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1286) took 1067 ms. Trace:
I20260709 13:18:59.415910 17603 raft_consensus.cc:1240] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:59.416477 17598 rpcz_store.cc:276] 0709 13:18:58.347617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.441639 (+ 94022us) service_pool.cc:224] Handling call
0709 13:18:59.415045 (+973406us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540027bad4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:59.415246 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452559616}
I20260709 13:18:59.426211 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1292) took 1073 ms. Trace:
I20260709 13:18:59.426826 17603 rpcz_store.cc:276] 0709 13:18:58.349476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.415033 (+1065557us) service_pool.cc:224] Handling call
0709 13:18:59.415508 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.422271 (+  6763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.422637 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.478809 20179 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.479773 20179 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:18:59.482154 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.482514 20120 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:59.483196 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1504) took 1285 ms. Trace:
I20260709 13:18:59.483656 17601 rpcz_store.cc:276] 0709 13:18:58.187901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.093338 (+905437us) service_pool.cc:224] Handling call
0709 13:18:59.099740 (+  6402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:59.100211 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.100255 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:59.235625 (+135370us) log.cc:844] Serialized 52 byte log entry
0709 13:18:59.320742 (+ 85117us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:59.320807 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.324100 (+  3293us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.466269 (+142169us) raft_consensus.cc:1685] finished
0709 13:18:59.466296 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.473027 (+  6731us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":4422,"spinlock_wait_cycles":500096,"thread_start_us":84154,"threads_started":1,"wal-append.queue_time_us":176308}
I20260709 13:18:59.416057 20161 consensus_queue.cc:1059] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:18:59.486537 17524 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:59.486750 20161 raft_consensus.cc:3055] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:59.487287 20161 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:18:59.488176 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:59.488782 20161 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:59.490492 20017 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:59.466269 20231 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:18:59.491129 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1290) took 1141 ms. Trace:
I20260709 13:18:59.491555 17594 rpcz_store.cc:276] 0709 13:18:58.349107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.422860 (+ 73753us) service_pool.cc:224] Handling call
0709 13:18:59.490755 (+1067895us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b54000758d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:59.490932 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2134658816}
I20260709 13:18:59.492889 17527 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.493444 17601 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:18:59.493767 17529 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:59.494119 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1296) took 1143 ms. Trace:
I20260709 13:18:59.494240 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:59.494776 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:59.494520 17601 rpcz_store.cc:276] 0709 13:18:58.350596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.485591 (+1134995us) service_pool.cc:224] Handling call
0709 13:18:59.493088 (+  7497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.493830 (+   742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.494016 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.495733 17529 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:18:59.495841 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:59.496590 20161 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.496733 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:59.497834 17529 raft_consensus.cc:2393] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:18:59.486265 17338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 144989us
I20260709 13:18:59.505298 17599 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:18:59.498016 17527 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:59.506289 20222 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:59.508736 20193 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:59.509639 20196 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:59.517263 19865 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:59.488195 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1811) took 2627 ms. Trace:
I20260709 13:18:59.521165 17603 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:59.521766 17599 pending_rounds.cc:85] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 7
I20260709 13:18:59.541131 17599 pending_rounds.cc:107] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:18:59.541517 17599 raft_consensus.cc:2889] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.539487 17524 rpcz_store.cc:276] 0709 13:18:56.860871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.285728 (+424857us) service_pool.cc:224] Handling call
0709 13:18:57.357800 (+ 72072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.486997 (+2129197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.487876 (+   879us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b54003d04d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:18:59.488109 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4865422208}
I20260709 13:18:59.540735 17603 pending_rounds.cc:85] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 3
I20260709 13:18:59.549065 17603 pending_rounds.cc:107] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:59.549448 17603 raft_consensus.cc:2889] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.546911 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:59.563776 17594 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 9. Ops: []
W20260709 13:18:59.569594 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 147523us
I20260709 13:18:59.471531 20267 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:18:59.575325 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1294) took 1221 ms. Trace:
I20260709 13:18:59.575839 17603 rpcz_store.cc:276] 0709 13:18:58.350064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.462591 (+1112527us) service_pool.cc:224] Handling call
0709 13:18:59.517966 (+ 55375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.571062 (+ 53096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.571255 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.574731 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 272) took 1227 ms. Trace:
I20260709 13:18:59.581529 17599 rpcz_store.cc:276] 0709 13:18:58.346990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.303052 (+956062us) service_pool.cc:224] Handling call
0709 13:18:59.303738 (+   686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.574389 (+270651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.574653 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.579196 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1505) took 1230 ms. Trace:
I20260709 13:18:59.599346 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:59.602414 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:18:59.611227 17522 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:59.630656 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.631299 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:59.632380 17445 raft_consensus.cc:2393] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:18:59.596627 17602 rpcz_store.cc:276] 0709 13:18:58.188204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.103172 (+914968us) service_pool.cc:224] Handling call
0709 13:18:59.237935 (+134763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.239025 (+  1090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.239095 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.240313 (+  1218us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.313553 (+ 73240us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:59.313578 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.313625 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.417438 (+103813us) raft_consensus.cc:1685] finished
0709 13:18:59.417459 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.418099 (+   640us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28709,"raft.run_cpu_time_us":411,"raft.run_wall_time_us":411,"thread_start_us":66897,"threads_started":1,"wal-append.queue_time_us":134201}
I20260709 13:18:59.578434 19865 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:59.580725 20179 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:59.635540 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:18:59.633935 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.640671 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:18:59.636368 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:18:59.635005 17603 pending_rounds.cc:85] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 8
I20260709 13:18:59.651683 17603 pending_rounds.cc:107] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:18:59.652099 17603 raft_consensus.cc:2889] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.643554 20267 consensus_queue.cc:1243] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:59.636219 20213 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:18:59.635689 20276 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.292s	user 0.005s	sys 0.000s
I20260709 13:18:59.636238 19865 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:59.681918 17599 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.685410 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:18:59.676450 20111 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:18:59.687719 20267 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:18:59.719594 20267 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:18:59.690208 20028 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.726670 17524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54542
I20260709 13:18:59.727833 17524 raft_consensus.cc:606] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:18:59.734257 20111 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:59.737946 17445 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:59.709031 17602 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:18:59.734304 20120 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:59.749744 20120 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:59.752692 20120 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:18:59.755172 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 108022us
W20260709 13:18:59.756291 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.758437 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1281) took 1413 ms. Trace:
I20260709 13:18:59.759052 17596 rpcz_store.cc:276] 0709 13:18:58.344849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.420522 (+ 75673us) service_pool.cc:224] Handling call
0709 13:18:59.757808 (+1337286us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400062a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:18:59.758211 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531095808}
I20260709 13:18:59.764413 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:59.765545 17450 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:18:59.765971 20291 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:18:59.767022 20291 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:18:59.768568 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:18:59.771456 17448 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:59.773243 17452 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:59.733664 17568 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:18:59.761866 17596 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:18:59.903530 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.826144 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.787302 17447 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:18:59.914535 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.772372 17451 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:59.792992 17602 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:59.786952 17529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54542
I20260709 13:18:59.917917 17529 raft_consensus.cc:606] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:18:59.918807 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1511) took 1190 ms. Trace:
I20260709 13:18:59.919258 17602 rpcz_store.cc:276] 0709 13:18:58.728360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.788027 (+1059667us) service_pool.cc:224] Handling call
0709 13:18:59.791739 (+  3712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.918495 (+126756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.918742 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.769989 20291 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:18:59.917685 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1509) took 1196 ms. Trace:
I20260709 13:18:59.932157 17596 rpcz_store.cc:276] 0709 13:18:58.721318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.760245 (+1038927us) service_pool.cc:224] Handling call
0709 13:18:59.760882 (+   637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.914486 (+153604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.917609 (+  3123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.745086 20173 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.935401 17599 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:18:59.773972 20204 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.911044 20267 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:59.871099 20111 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:18:59.894220 20120 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:18:59.900024 20231 raft_consensus.cc:3055] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:59.840255 20028 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:18:59.961088 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 274) took 1486 ms. Trace:
I20260709 13:18:59.947979 20291 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.961553 17601 rpcz_store.cc:276] 0709 13:18:58.475187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.496019 (+1020832us) service_pool.cc:224] Handling call
0709 13:18:59.506240 (+ 10221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.506763 (+   523us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:59.597775 (+ 91012us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.960615 (+362840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.960693 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:59.960764 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.960882 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.961035 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13563,"prepare.queue_time_us":130532,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":76,"thread_start_us":391995,"threads_started":2}
W20260709 13:18:59.966539 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.956696 20231 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:00.009132 20021 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:00.009518 17447 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:00.010399 20087 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.010998 20087 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:00.012794 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.013468 17451 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:00.014654 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:00.016431 17599 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:00.018918 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1514) took 1285 ms. Trace:
I20260709 13:19:00.019419 17599 rpcz_store.cc:276] 0709 13:18:58.733240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.945716 (+1212476us) service_pool.cc:224] Handling call
0709 13:18:59.961208 (+ 15492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.018571 (+ 57363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.018842 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.029124 17451 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.029381 20175 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:00.030210 20175 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.031947 20151 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:00.034411 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:00.032636 20175 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:18:59.998974 20267 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.035475 17447 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:00.035626 20267 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:00.036470 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.037246 17447 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
W20260709 13:19:00.034663 20110 consensus_meta.cc:287] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.687s	user 0.008s	sys 0.009s
I20260709 13:19:00.033825 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.042354 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.029146 20161 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:00.045369 20161 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.045679 20170 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.045892 20161 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.046445 20170 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:00.049091 20170 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:00.035660 20087 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:00.050211 20293 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:19:00.050963 20110 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:00.052098 20290 log.cc:927] Time spent T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:19:00.054257 17446 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:00.055380 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.055248 20291 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.056098 17446 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:00.057032 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.057595 17446 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:19:00.009892 20021 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:00.058975 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.007164 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:00.051716 20110 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.081562 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:00.082381 17446 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.001428 20173 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.084000 17445 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:00.079242 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:00.037992 20267 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:00.015331 20120 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.101524 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:00.107563 17599 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:00.080750 20291 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.044834 17596 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:59.998229 20204 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.126972 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1513) took 1394 ms. Trace:
W20260709 13:19:00.117676 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.127648 17596 rpcz_store.cc:276] 0709 13:18:58.732875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.943128 (+1210253us) service_pool.cc:224] Handling call
0709 13:18:59.996821 (+ 53693us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.115406 (+118585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.126910 (+ 11504us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.109500 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1519) took 1055 ms. Trace:
I20260709 13:19:00.131367 17447 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:19:00.129171 17599 rpcz_store.cc:276] 0709 13:18:59.053795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.020441 (+966646us) service_pool.cc:224] Handling call
0709 13:19:00.104193 (+ 83752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.109295 (+  5102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.109460 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.085197 20302 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:00.135180 20302 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.136332 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.137634 20302 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:00.140143 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 99288.1us
I20260709 13:19:00.169777 17529 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:00.168412 17449 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.172458 17446 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:00.105170 20170 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:00.174618 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.175567 17445 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
W20260709 13:19:00.180274 20288 log.cc:927] Time spent T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.484s	user 0.000s	sys 0.002s
I20260709 13:19:00.181193 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:00.182757 20291 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:00.184047 20166 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.184629 20166 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.185066 20166 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.191129 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52572 (request call id 266) took 2007 ms. Trace:
W20260709 13:19:00.191520 20297 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:19:00.191691 17600 rpcz_store.cc:276] 0709 13:18:58.183416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.183529 (+   113us) service_pool.cc:224] Handling call
0709 13:19:00.190771 (+2007242us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400063454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:00.191050 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2612342528}
I20260709 13:19:00.195046 20175 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:00.195974 20175 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:00.196656 17598 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:19:00.197088 17598 pending_rounds.cc:85] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 7
I20260709 13:19:00.197362 17598 pending_rounds.cc:107] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:19:00.197651 17598 raft_consensus.cc:2889] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:00.198135 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:00.199120 20110 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.199366 20170 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:00.202692 20295 log.cc:927] Time spent T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:19:00.203406 17600 raft_consensus.cc:3055] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:00.203814 17600 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:00.201669 20170 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:00.204690 17600 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.205736 17600 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.201658 20203 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:00.205883 20175 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:00.206547 20073 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.208912 20204 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.210320 17420 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:00.211721 20120 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.212275 20120 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:00.212756 17420 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:00.212873 20120 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.213850 20291 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:00.214416 20291 raft_consensus.cc:697] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:00.214185 20183 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.215813 20291 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:00.217461 20183 consensus_queue.cc:1059] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:00.218374 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:00.219062 20302 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:00.220578 20302 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.220935 20302 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:00.221261 20302 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.205942 20028 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:00.222903 20183 raft_consensus.cc:3055] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:00.223541 20183 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:00.226444 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:00.228123 17596 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:00.222960 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 255352us
I20260709 13:19:00.226473 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.232324 17447 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:00.239307 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1289) took 1886 ms. Trace:
I20260709 13:19:00.239640 17600 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:00.243726 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1299) took 1776 ms. Trace:
W20260709 13:19:00.243796 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 510078us
I20260709 13:19:00.244565 17594 rpcz_store.cc:276] 0709 13:18:58.466907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.492397 (+1025490us) service_pool.cc:224] Handling call
0709 13:18:59.492820 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.566857 (+ 74037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.239232 (+672375us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b54000776d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:00.243654 (+  4422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157908864}
W20260709 13:19:00.243721 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 459286us
I20260709 13:19:00.143066 19865 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:00.243768 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 275) took 1761 ms. Trace:
I20260709 13:19:00.249590 17529 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:19:00.250533 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.223277 20166 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.249505 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.257789 17599 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:00.256155 17568 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:00.239827 17595 rpcz_store.cc:276] 0709 13:18:58.348888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.304995 (+956107us) service_pool.cc:224] Handling call
0709 13:18:59.327210 (+ 22215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.328039 (+   829us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:59.538335 (+210296us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.666548 (+128213us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.667148 (+   600us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.667757 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.667900 (+   143us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:59.668334 (+   434us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.668730 (+   396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.668810 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.235586 (+566776us) raft_consensus.cc:1685] finished
0709 13:19:00.235612 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.235765 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":229386,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":125,"raft.queue_time_us":604,"raft.run_cpu_time_us":460,"raft.run_wall_time_us":34770,"thread_start_us":263132,"threads_started":2,"wal-append.queue_time_us":450937}
I20260709 13:19:00.249053 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:00.270454 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:00.247471 17603 rpcz_store.cc:276] 0709 13:18:58.482216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.580840 (+1098624us) service_pool.cc:224] Handling call
0709 13:18:59.634607 (+ 53767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.652899 (+ 18292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.652939 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.653480 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.915002 (+261522us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:59.938268 (+ 23266us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.132582 (+194314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.149925 (+ 17343us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.149998 (+    73us) raft_consensus.cc:1685] finished
0709 13:19:00.150046 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.243697 (+ 93651us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9834,"prepare.queue_time_us":26370,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":4229,"raft.queue_time_us":94015,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":438793,"threads_started":2,"wal-append.queue_time_us":395945}
I20260709 13:19:00.281924 17451 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:00.233776 20231 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.282852 17520 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:19:00.300125 17596 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:00.282584 19865 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:00.260022 20161 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:00.304880 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.307165 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:00.309173 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 54807.4us
W20260709 13:19:00.310487 18167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.005s	sys 0.021s
W20260709 13:19:00.310809 18167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.005s	sys 0.021s
I20260709 13:19:00.311299 20161 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:00.313191 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 57139.3us
I20260709 13:19:00.315261 17568 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:00.315992 20307 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.316485 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.316774 20307 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:00.317610 20301 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:00.331296 17600 raft_consensus.cc:1240] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:00.334645 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1512) took 1602 ms. Trace:
I20260709 13:19:00.344399 17520 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:00.346122 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.344411 17602 rpcz_store.cc:276] 0709 13:18:58.732467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.928383 (+1195916us) service_pool.cc:224] Handling call
0709 13:19:00.000924 (+ 72541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.292940 (+292016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.293238 (+   298us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.334145 (+ 40907us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:00.334231 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.334334 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.334511 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18493,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":267098,"threads_started":1}
I20260709 13:19:00.355969 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:00.359520 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 44385us
I20260709 13:19:00.366286 17451 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:00.360425 20093 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:00.362424 20127 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.365020 20307 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:00.359648 20161 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.365620 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:00.383195 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:00.383682 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.383980 17451 raft_consensus.cc:2393] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:00.317675 20017 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.301926 20227 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.318558 20231 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.282370 20128 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:00.318183 20016 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:00.378548 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.384861 17523 raft_consensus.cc:2410] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:00.385397 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.397506 17529 raft_consensus.cc:2410] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:00.399049 17520 raft_consensus.cc:2393] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:00.383275 20161 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:00.397492 17338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 135075us
I20260709 13:19:00.402058 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.385222 20093 raft_consensus.cc:697] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:00.403765 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1517) took 1665 ms. Trace:
I20260709 13:19:00.406268 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.397909 20017 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.439795 17446 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:19:00.426254 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.411345 20128 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.422775 17451 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:00.415551 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:00.432240 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 44669.9us
I20260709 13:19:00.401712 20227 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:00.420315 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:00.401499 20307 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.424567 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.470414 17527 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:00.405661 20161 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:00.477540 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.474992 17448 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:00.405797 20120 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.411695 20166 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.405143 20132 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:00.494889 20132 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.411209 20173 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:00.421955 20264 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.490854 17523 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:00.491132 20128 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.491719 17419 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:00.418226 20026 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
W20260709 13:19:00.479429 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 59337.5us
I20260709 13:19:00.502297 17529 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:00.401834 20016 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.492646 20308 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.402737 20301 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:00.511317 20264 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.501897 20258 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:00.466717 20093 consensus_queue.cc:237] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:00.545570 20312 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:19:00.547925 20128 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:00.549798 20016 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:00.550720 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 338049us
I20260709 13:19:00.555188 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:00.557157 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:00.558522 20128 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:00.558985 20128 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:00.559379 20128 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.559182 20222 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:00.559900 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1503) took 2372 ms. Trace:
W20260709 13:19:00.562402 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 51284.5us
I20260709 13:19:00.485033 20307 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.528167 20073 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:00.594573 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:00.599138 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.568828 20204 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:00.560272 17597 rpcz_store.cc:276] 0709 13:18:58.187611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.686492 (+498881us) service_pool.cc:224] Handling call
0709 13:18:59.462581 (+776089us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:59.494736 (+ 32155us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:59.610825 (+116089us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.925358 (+314533us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:59.952571 (+ 27213us) log.cc:844] Serialized 52 byte log entry
0709 13:18:59.952731 (+   160us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:59.952978 (+   247us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.130437 (+177459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.130550 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.130607 (+    57us) raft_consensus.cc:1685] finished
0709 13:19:00.132695 (+  2088us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.559570 (+426875us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b540027bad0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:00.559703 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19915,"prepare.queue_time_us":145647,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":94,"raft.queue_time_us":83965,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":12471,"spinlock_wait_cycles":1677384448,"thread_start_us":504961,"threads_started":3,"wal-append.queue_time_us":384465}
I20260709 13:19:00.588449 20258 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:00.532060 20302 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:00.587436 20073 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:00.539795 20308 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.586730 20315 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:19:00.586885 20196 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:19:00.610558 20017 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.641319 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.642680 17447 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.633597 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.623648 20073 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.623996 20204 raft_consensus.cc:697] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:00.643666 17523 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:00.651693 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.655226 17451 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:00.659879 20319 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.660509 20319 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.664475 20319 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.664723 20161 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.666378 20132 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.666492 20227 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.667064 20311 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.667618 20311 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:00.670110 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:00.670442 20258 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.653692 19865 consensus_queue.cc:1059] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:19:00.642724 20166 consensus_queue.cc:1059] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:19:00.651634 19665 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:19:00.651602 19754 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.408922 17601 rpcz_store.cc:276] 0709 13:18:58.738395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.993218 (+1254823us) service_pool.cc:224] Handling call
0709 13:19:00.082324 (+ 89106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.133631 (+ 51307us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:00.202243 (+ 68612us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.403437 (+201194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.403486 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:00.403535 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.403598 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.403708 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":753,"prepare.run_cpu_time_us":159,"prepare.run_wall_time_us":156,"raft.queue_time_us":8743,"thread_start_us":197116,"threads_started":1}
I20260709 13:19:00.677027 19754 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.680011 19754 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:00.686062 17568 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:00.689173 20028 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:00.690573 20028 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.690986 20028 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.692063 19865 raft_consensus.cc:3055] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:00.692613 19865 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:00.689350 20203 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:19:00.659118 20127 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:19:00.698203 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.693807 19865 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.700307 19865 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.700479 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1479) took 1341 ms. Trace:
I20260709 13:19:00.688980 17568 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:00.700996 17522 rpcz_store.cc:276] 0709 13:18:59.358609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.359519 (+   910us) service_pool.cc:224] Handling call
0709 13:18:59.359961 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.611759 (+251798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.700184 (+1088425us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54000fe454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:00.700387 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410618240}
I20260709 13:19:00.702085 20203 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:00.702508 20203 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.702864 20203 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.706933 20170 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:00.709573 17568 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:00.709666 20183 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:00.710477 20170 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:00.710865 20183 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.712154 20170 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:00.715669 20021 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:00.716691 17447 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:00.718398 17419 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:00.718528 17568 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:00.719676 20170 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.720062 20170 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.720224 20307 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:00.720412 20170 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.720952 20319 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:00.721493 20330 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:19:00.724704 18166 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:00.721441 20319 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:00.725560 20319 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.726657 20199 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:00.727126 20199 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.727532 20199 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:00.728529 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 74894.9us
W20260709 13:19:00.730921 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.688324 17449 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:00.699262 17450 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:00.738173 17446 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:00.744974 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1724) took 1004 ms. Trace:
I20260709 13:19:00.745548 17449 rpcz_store.cc:276] 0709 13:18:59.729556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.748423 (+ 18867us) service_pool.cc:224] Handling call
0709 13:19:00.734302 (+985879us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:00.689847 20318 log.cc:927] Time spent T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:19:00.669848 20311 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:00.785637 17597 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:19:00.689265 20153 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:19:00.789108 20070 consensus_queue.cc:1059] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:00.789710 20161 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:00.790154 20310 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:19:00.795128 20179 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:00.796730 20179 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:00.798375 20204 consensus_queue.cc:237] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.802755 17528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54542
I20260709 13:19:00.781281 20021 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:00.825419 20173 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.843149 17528 raft_consensus.cc:606] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:19:00.789620 20153 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:00.779982 19665 raft_consensus.cc:3055] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:00.843053 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:00.843633 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.797874 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:00.853924 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 203529us
I20260709 13:19:00.856535 17602 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:19:00.845791 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 213990us
W20260709 13:19:00.874070 20323 log.cc:927] Time spent T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.113s	user 0.000s	sys 0.002s
I20260709 13:19:00.874406 17420 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:00.876170 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:00.876319 20136 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:00.877104 20136 raft_consensus.cc:2764] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:00.877615 17420 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:00.878911 20017 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.879240 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.879633 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.855512 19665 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:00.881691 19665 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.882416 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:00.883105 19665 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.883677 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.880677 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.886550 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.886878 17527 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
W20260709 13:19:00.889361 17569 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.015s	sys 0.017s
W20260709 13:19:00.889745 17569 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.015s	sys 0.017s
W20260709 13:19:00.890012 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 700061us
I20260709 13:19:00.880764 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:00.899480 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:00.901602 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.855289 20153 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:00.910429 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:00.918365 17524 raft_consensus.cc:2393] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:00.879285 20017 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.891467 20021 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:00.943675 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:00.904000 20311 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:00.860183 20203 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.932741 17568 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:00.949920 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 44542.6us
I20260709 13:19:00.867419 20173 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:00.873355 20028 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.956439 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:00.927428 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:00.968384 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:00.971760 17594 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:00.950495 20017 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.954802 20301 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:00.994647 20302 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:00.995836 20319 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.996676 20203 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:00.998222 20309 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:00.998644 20309 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.999001 20309 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.999375 20028 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:01.000538 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1732) took 1056 ms. Trace:
I20260709 13:19:00.986716 20153 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.986778 20136 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.988358 20308 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:00.989450 17599 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:00.991685 20021 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:00.991844 20170 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:00.982728 17495 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.645s (SENT) [suppressed 26 similar messages]
I20260709 13:19:00.993172 20173 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:00.994372 20128 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:00.987449 20341 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:19:00.988271 20258 raft_consensus.cc:1064] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:19:01.014876 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:01.017181 17603 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:00.981480 20307 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:00.981094 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:01.025025 17600 raft_consensus.cc:2410] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:00.960433 20311 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:01.059891 20073 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:01.059911 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:01.060927 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:01.061399 17527 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:01.030710 20258 raft_consensus.cc:1068] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Unable to promote non-voter 2158c0f750fd4b21afe24135c52167b2: Service unavailable: leader transfer in progress
I20260709 13:19:01.062269 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:01.063479 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:01.027170 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:01.032734 17594 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:01.033767 17602 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:01.030311 20307 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:01.034718 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 81281.3us
W20260709 13:19:01.047030 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.072532 17595 raft_consensus.cc:2393] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:01.073014 17520 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:01.077014 20307 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:01.075017 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:01.077533 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:01.078289 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 258) took 4285 ms. Trace:
I20260709 13:19:01.078770 17454 raft_consensus.cc:2410] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:01.078752 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:01.080622 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:01.081142 17526 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:01.049201 20339 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.002s
I20260709 13:19:01.054842 20153 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:01.055141 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1753) took 1022 ms. Trace:
I20260709 13:19:01.055445 20196 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:01.065683 20199 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:01.000897 17452 rpcz_store.cc:276] 0709 13:18:59.946704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.951483 (+  4779us) service_pool.cc:224] Handling call
0709 13:18:59.967102 (+ 15619us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:00.256707 (+289605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.256755 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:00.269521 (+ 12766us) log.cc:844] Serialized 52 byte log entry
0709 13:19:00.496206 (+226685us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:00.526766 (+ 30560us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.562344 (+ 35578us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.562576 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.694473 (+131897us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b1800372ca0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:19:01.000208 (+305735us) spinlock_profiling.cc:243] Waited 70.9 ms on lock 0x7b54001851d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:01.000274 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.000316 (+    42us) raft_consensus.cc:1685] finished
0709 13:19:01.000345 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.000484 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89152,"prepare.queue_time_us":82671,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":103160,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":32358,"spinlock_wait_cycles":172027392,"thread_start_us":385952,"threads_started":2,"wal-append.queue_time_us":349091}
I20260709 13:19:01.067690 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:01.022192 20319 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:01.089255 17446 rpcz_store.cc:276] 0709 13:19:00.032838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.441982 (+409144us) service_pool.cc:224] Handling call
0709 13:19:00.733906 (+291924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.738578 (+  4672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.054872 (+316294us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400369050. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:01.055067 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":670589184}
I20260709 13:19:01.091230 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:01.093427 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:01.078663 17521 rpcz_store.cc:276] 0709 13:18:56.792365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.803307 (+ 10942us) service_pool.cc:224] Handling call
0709 13:18:56.803666 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.952760 (+3149094us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:59.958460 (+  5700us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.958504 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:59.958564 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.077823 (+1119259us) spinlock_profiling.cc:243] Waited 2.9 s on lock 0x7b5400413054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:01.077871 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.078096 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":311782,"raft.queue_time_us":202621,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":17801,"spinlock_wait_cycles":6679878400}
I20260709 13:19:01.113562 17420 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:01.116593 17527 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
W20260709 13:19:01.112320 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 96957.2us
I20260709 13:19:01.084558 20258 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:01.132692 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.121505 17568 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:01.138587 20349 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:01.139264 20349 raft_consensus.cc:697] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:01.139366 18199 raft_consensus.cc:2368] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:01.138695 17594 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:19:01.141876 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.147469 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47864 (request call id 212) took 1113 ms. Trace:
I20260709 13:19:01.147884 17447 rpcz_store.cc:276] 0709 13:19:00.033782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.365248 (+331466us) service_pool.cc:224] Handling call
0709 13:19:01.147276 (+782028us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54002008d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:01.147406 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595729152}
I20260709 13:19:01.150454 17445 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:19:01.151298 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 168584us
I20260709 13:19:01.149480 20302 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:01.165809 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.176849 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 271904us
W20260709 13:19:01.164528 20343 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:19:01.141228 20258 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:01.180943 20073 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:01.182673 17351 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 97) took 10251 ms. Trace:
I20260709 13:19:01.183302 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:01.187223 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 84376us
I20260709 13:19:01.194948 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:01.195178 20199 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:01.214965 20258 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:01.215822 17420 leader_election.cc:400] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 5. Current term is 6.
I20260709 13:19:01.225688 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1295) took 2875 ms. Trace:
I20260709 13:19:01.226186 17598 rpcz_store.cc:276] 0709 13:18:58.350335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.519275 (+1168940us) service_pool.cc:224] Handling call
0709 13:19:00.196299 (+677024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.198226 (+  1927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.225442 (+1027216us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b5400063450. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:01.225614 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446492928}
I20260709 13:19:01.202646 20349 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:01.189590 17351 rpcz_store.cc:276] 0709 13:18:50.931088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.931324 (+   236us) service_pool.cc:224] Handling call
0709 13:19:01.182414 (+10251090us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:56.193550 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:56.194154 (+   604us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:56.194202 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:18:56.194228 (+    26us) tablet.cc:662] Decoding operations
0709 13:18:56.195252 (+  1024us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:56.195322 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:56.195368 (+    46us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:56.196054 (+   686us) tablet.cc:701] Row locks acquired
0709 13:18:56.196079 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:18:56.196322 (+   243us) write_op.cc:270] Start()
0709 13:18:56.196468 (+   146us) write_op.cc:276] Timestamp: P: 1783603136196219 usec, L: 0
0709 13:18:56.196496 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:18:56.285277 (+ 88781us) log.cc:844] Serialized 2578 byte log entry
0709 13:18:57.118713 (+833436us) op_driver.cc:464] REPLICATION: finished
0709 13:18:57.291822 (+173109us) write_op.cc:301] APPLY: starting
0709 13:18:57.293517 (+  1695us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:57.394804 (+101287us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:57.394945 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:57.408480 (+ 13535us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:57.408731 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:18:57.408781 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:57.409038 (+   257us) log.cc:844] Serialized 53 byte log entry
0709 13:18:57.409265 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:57.409377 (+   112us) write_op.cc:454] Released schema lock
0709 13:18:57.409420 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:57.409914 (+   494us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:57.409945 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":256,"mutex_wait_us":23703,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":152732,"apply.run_cpu_time_us":3202,"apply.run_wall_time_us":128617,"num_ops":6,"prepare.queue_time_us":419841,"prepare.run_cpu_time_us":59691,"prepare.run_wall_time_us":308786,"raft.queue_time_us":192917,"raft.run_cpu_time_us":22240,"raft.run_wall_time_us":147034,"replication_time_us":898067,"thread_start_us":634032,"threads_started":4,"wal-append.queue_time_us":307263,"wal-append.run_cpu_time_us":38953,"wal-append.run_wall_time_us":1817285}]]}
W20260709 13:19:01.263633 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.275379 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:01.277681 17603 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
W20260709 13:19:01.238843 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 223064us
I20260709 13:19:01.242116 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:01.268880 20325 log.cc:927] Time spent T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.652s	user 0.003s	sys 0.002s
W20260709 13:19:01.269955 20352 log.cc:927] Time spent T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:01.263384 20311 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:01.234638 20128 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:01.292138 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 50143.2us
I20260709 13:19:01.242626 20136 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.293226 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 47803us
I20260709 13:19:01.288064 20028 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:01.296818 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:01.297509 20028 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:01.297989 20028 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:01.299185 17420 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:01.300150 20340 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.431s	user 0.004s	sys 0.000s
I20260709 13:19:01.301501 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:01.302263 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:01.302910 17450 raft_consensus.cc:2376] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7. Re-sending same reply.
I20260709 13:19:01.296578 17569 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:01.308526 20313 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:01.308676 20073 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:01.314322 20073 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.314796 20073 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:01.321276 17400 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:19:01.321852 17400 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 2edee9f2356c4e878f2e11af63e46ab9 already in progress
W20260709 13:19:01.322255 17400 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 2edee9f2356c4e878f2e11af63e46ab9 already in progress
I20260709 13:19:01.335556 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:01.336586 17603 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:01.242236 20264 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:01.296505 20136 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:01.356844 17495 leader_election.cc:336] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.626s (SENT)
I20260709 13:19:01.362377 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:01.363385 17523 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:19:01.391947 20350 log.cc:927] Time spent T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:19:01.400058 20170 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:01.393774 20132 raft_consensus.cc:3055] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:01.402681 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:01.401870 20132 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:01.408877 20132 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:01.410166 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:01.410848 17525 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.380874 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:01.430411 17448 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:01.432256 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 135766us
W20260709 13:19:01.435766 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 79408.8us
I20260709 13:19:01.418148 20132 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.459463 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:01.356109 20028 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:01.466766 17526 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:01.437250 20354 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:01.468075 17524 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:01.478811 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 133453us
W20260709 13:19:01.480808 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.481324 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.470002 17419 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:01.484090 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 47360us
I20260709 13:19:01.495791 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:01.429492 20264 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:19:01.498920 17594 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:01.499426 17495 leader_election.cc:400] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) with higher term. Message: Invalid argument: T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:01.504091 17495 leader_election.cc:403] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:01.505630 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 146721us
W20260709 13:19:01.507761 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.492945 19865 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:01.516382 17526 pending_rounds.cc:85] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 7
I20260709 13:19:01.517783 17526 pending_rounds.cc:107] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:19:01.518205 17526 raft_consensus.cc:2889] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:01.508111 20316 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:01.532334 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:01.541936 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.558244 17495 leader_election.cc:336] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.787s (SENT)
I20260709 13:19:01.521100 19865 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:01.658921 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 132315us
W20260709 13:19:01.662005 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 127155us
W20260709 13:19:01.652566 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.666129 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:01.557710 20351 log.cc:927] Time spent T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
W20260709 13:19:01.650640 20307 consensus_meta.cc:287] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.000s
W20260709 13:19:01.646623 20357 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.352s	user 0.001s	sys 0.001s
I20260709 13:19:01.662535 18167 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:01.653551 20360 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:19:01.687927 17525 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:01.560297 20302 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:01.687793 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 150987us
I20260709 13:19:01.530381 20349 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.147s
I20260709 13:19:01.560117 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:01.658074 20148 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.665477 19865 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:01.698668 17568 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:01.558867 20316 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:01.710876 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 48458.5us
I20260709 13:19:01.714130 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:01.721815 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:01.696767 20307 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:01.720561 20161 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:01.715452 20373 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:01.732795 20017 consensus_meta.cc:287] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.724s	user 0.003s	sys 0.010s
I20260709 13:19:01.742872 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:01.742735 17569 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:01.745287 17523 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:01.738202 20028 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:01.750981 17603 raft_consensus.cc:1240] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:01.749979 18166 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:01.754199 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:01.756852 17601 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:01.757315 17602 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:01.733726 20371 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:01.747609 20161 raft_consensus.cc:697] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:01.713003 20148 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:01.771471 20161 consensus_queue.cc:237] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:01.772418 20148 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:01.776036 17448 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:01.744616 20291 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:01.749238 20021 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) with higher term. Message: Invalid argument: T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:01.750253 20354 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:01.805256 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.777964 20309 consensus_meta.cc:287] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.003s
I20260709 13:19:01.811609 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:01.818399 17601 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:01.820386 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:01.748894 20017 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:01.816481 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:01.784552 20348 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:01.784801 20302 raft_consensus.cc:2764] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:01.803586 20264 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.813465 20354 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:01.857805 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 103755us
I20260709 13:19:01.859988 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:01.823941 20291 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.854785 20364 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 13:19:01.867023 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 53926.4us
W20260709 13:19:01.872658 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 71836us
I20260709 13:19:01.873409 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:01.821350 20309 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:01.858475 20348 raft_consensus.cc:697] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:01.861965 20354 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.876374 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:01.812927 20316 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:01.812498 20376 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:19:01.865187 20375 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:01.861346 20264 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:01.867744 20291 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:01.901465 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:01.896219 20375 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:01.954811 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 81321.6us
I20260709 13:19:01.967116 17420 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:01.958348 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:01.972991 17598 raft_consensus.cc:2410] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:19:01.977278 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:01.957533 20375 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:01.958832 20307 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:01.967232 20173 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:01.979803 20073 consensus_meta.cc:287] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.005s
I20260709 13:19:01.979727 20383 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:01.983587 20073 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:01.983693 20383 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:01.989210 20379 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:19:01.989513 20073 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:01.990803 20183 raft_consensus.cc:3055] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:01.991358 20183 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:01.995007 17420 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:01.995512 20378 log.cc:927] Time spent T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:19:01.995327 20183 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:01.996574 20183 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:01.998492 17599 raft_consensus.cc:1275] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:01.999884 20073 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.000976 20073 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:01.978353 20387 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:02.002488 20387 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.002872 20387 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:01.995023 20382 log.cc:927] Time spent T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:19:01.989527 20383 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:02.006938 20264 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:02.004339 17349 catalog_manager.cc:5697] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 7, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 7 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:02.010833 20291 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:02.011905 17349 catalog_manager.cc:5697] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 2 to 5, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 5 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:02.015198 20381 log.cc:927] Time spent T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:19:02.019069 17601 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:01.975353 20302 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:02.016809 20132 consensus_meta.cc:287] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.006s
I20260709 13:19:01.986132 20173 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:01.994182 20017 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:02.046492 17598 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:02.022313 20028 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:02.051016 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.051254 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 149871us
I20260709 13:19:02.025457 20302 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:02.071933 20388 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:02.073720 19865 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:02.098199 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.075093 17450 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:01.975526 20348 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:02.045488 20173 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.100498 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.102241 17594 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:02.094714 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.096357 17445 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:02.103157 17446 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.103755 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.104324 17445 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:02.077029 17349 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:02.108594 17452 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:02.110057 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.113230 17445 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:02.114645 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.115700 17445 raft_consensus.cc:2376] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6. Re-sending same reply.
I20260709 13:19:02.117085 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.117970 17569 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:02.096902 20302 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:02.105371 17349 catalog_manager.cc:5697] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.120414 17451 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:02.110636 17452 raft_consensus.cc:2376] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8. Re-sending same reply.
I20260709 13:19:02.124408 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.125247 17448 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.129015 20309 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:02.132377 19865 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:02.136610 17446 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:02.137847 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.138659 17446 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:02.147958 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.149272 17451 raft_consensus.cc:2393] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:02.152045 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.153117 17452 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:02.110934 20388 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:02.168745 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.169543 17446 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.172008 20311 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:02.172501 20311 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:02.175535 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.176338 17451 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:19:02.185565 17446 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:02.188360 20397 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:02.188726 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.189056 20397 raft_consensus.cc:697] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:02.192343 17445 raft_consensus.cc:2410] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:19:02.184569 17448 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:02.173367 20311 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.169889 20132 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.194931 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.196959 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.199064 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:02.197486 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 95498.2us
I20260709 13:19:02.199807 17451 raft_consensus.cc:2368] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:02.206604 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:02.208623 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:02.196739 17349 catalog_manager.cc:5697] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 1 to 5, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 5 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:02.219066 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.219552 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.220820 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.225896 17450 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:02.226895 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.227057 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.227414 17448 raft_consensus.cc:2376] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6. Re-sending same reply.
I20260709 13:19:02.228078 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:02.228749 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.220111 17349 catalog_manager.cc:5697] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 1 to 5, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 5 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:02.219673 17420 connection.cc:256] RPC call timeout handler was delayed by -1.3095480570000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260709 13:19:02.230652 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.231462 17450 raft_consensus.cc:2376] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7. Re-sending same reply.
I20260709 13:19:02.232157 17420 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:02.234293 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:02.236544 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.237354 17451 raft_consensus.cc:2376] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8. Re-sending same reply.
I20260709 13:19:02.238679 18199 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 9. Ops: [7.8-7.8]
W20260709 13:19:02.245663 20358 log.cc:927] Time spent T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.772s	user 0.010s	sys 0.012s
I20260709 13:19:02.247434 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 220) took 1171 ms. Trace:
I20260709 13:19:02.247795 17449 rpcz_store.cc:276] 0709 13:19:01.076238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.091951 (+ 15713us) service_pool.cc:224] Handling call
0709 13:19:01.092343 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:01.098232 (+  5889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:01.098262 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:01.165236 (+ 66974us) log.cc:844] Serialized 26 byte log entry
0709 13:19:01.275075 (+109839us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:01.275128 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.275199 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:02.244961 (+969762us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:02.247122 (+  2161us) raft_consensus.cc:1685] finished
0709 13:19:02.247143 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:02.247374 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4785,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":25107,"spinlock_wait_cycles":38608128,"thread_start_us":70358,"threads_started":1,"wal-append.queue_time_us":239313}
I20260709 13:19:02.248927 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1539) took 1159 ms. Trace:
I20260709 13:19:02.249827 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.251595 17449 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:02.250859 17349 catalog_manager.cc:5697] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 6, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 6 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:02.214537 20132 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.226742 20311 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.249300 17600 rpcz_store.cc:276] 0709 13:19:01.089528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.271561 (+182033us) service_pool.cc:224] Handling call
0709 13:19:01.272063 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.272359 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:01.339121 (+ 66762us) log.cc:844] Serialized 14 byte log entry
0709 13:19:02.248210 (+909089us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800444700. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab29f3c0a 00007f5abc133219 00007f5ab2a7ba40 00007f5ab2a764e4 00007f5ab2a76455 00007f5ab955e3c7 00007f5ab5b709a7 00007f5ab5b800bf 00007f5ab5b80038
0709 13:19:02.248427 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 13:19:02.248619 (+   192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:02.248666 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:02.248714 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.248776 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:02.248875 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23284,"prepare.queue_time_us":794490,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":11731,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3037,"spinlock_wait_cycles":36583552,"thread_start_us":186096,"threads_started":2,"wal-append.queue_time_us":137136}
I20260709 13:19:02.160243 20375 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:02.259757 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:02.260531 18198 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:02.260838 20375 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:02.190115 20397 consensus_queue.cc:237] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.264684 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:02.266280 17420 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:02.241025 20291 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.241460 20399 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:02.270519 18195 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:02.271409 17349 catalog_manager.cc:5697] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:02.290517 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.229435 20354 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.294842 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:02.298878 18193 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:02.300714 20073 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:02.273242 20316 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:02.309135 20396 log.cc:927] Time spent T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:19:02.306632 20395 log.cc:927] Time spent T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:02.291682 20399 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:02.314922 20399 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.270864 20388 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.282584 20387 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.319404 20132 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:02.320308 20387 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:02.321686 20354 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:02.322269 20173 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.290675 20017 consensus_queue.cc:1059] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:19:02.323550 20017 raft_consensus.cc:3055] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:02.324016 20017 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:02.324352 20173 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:02.331609 17603 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:02.331483 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:02.326870 20399 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.332580 20316 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:02.332993 20316 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.333335 20316 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:02.338861 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.338951 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.339820 17450 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:02.342713 17420 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:02.343715 20313 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.325112 20017 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:02.346951 20017 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:02.350526 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:02.352536 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.353044 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.337026 17349 catalog_manager.cc:5697] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 7, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 7 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:02.333904 20399 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:02.372010 20370 log.cc:927] Time spent T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.678s	user 0.000s	sys 0.021s
I20260709 13:19:02.378751 20132 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:19:02.390981 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.398337 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.399171 17448 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:02.400298 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.400848 17448 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:02.401618 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.403506 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.404107 17452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:19:02.404924 17452 raft_consensus.cc:606] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:02.405359 17452 raft_consensus.cc:614] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:02.405787 17454 raft_consensus.cc:1240] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:02.407322 17454 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:02.408538 17454 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:02.409034 17449 raft_consensus.cc:2410] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:19:02.409301 17445 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:02.404116 17446 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:02.411355 17448 raft_consensus.cc:2376] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8. Re-sending same reply.
I20260709 13:19:02.430753 17529 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:02.448405 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:02.449437 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:02.450554 17526 raft_consensus.cc:2410] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:02.450911 20136 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:02.450353 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:02.451601 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:02.452911 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.453856 20316 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:02.389688 20132 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.463519 20132 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:02.464030 20132 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:02.414105 17349 catalog_manager.cc:5697] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 2 to 4, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 4 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:02.478289 17349 catalog_manager.cc:5697] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:02.384087 20302 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.487947 20302 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:02.489553 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 182876us
I20260709 13:19:02.490918 17454 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:19:02.499924 20368 log.cc:927] Time spent T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 1.023s	user 0.002s	sys 0.017s
I20260709 13:19:02.501359 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:02.503720 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:02.504087 20307 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.504776 20307 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.506357 17524 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:02.506917 20307 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:02.507479 20307 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.507802 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:02.507899 20307 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.509052 20373 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:02.510159 20307 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:02.510495 17450 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:02.513028 17569 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:02.514325 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:02.515712 20311 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:02.516021 20388 raft_consensus.cc:2764] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:02.516773 20399 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:02.518476 20388 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:02.512295 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:02.520288 17522 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:02.522976 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:02.524165 18192 raft_consensus.cc:2393] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 11: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:02.529320 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:02.531023 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:02.531912 18199 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:02.532826 17452 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:02.533072 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:02.534987 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:02.538082 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:02.540896 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:02.543613 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.544697 17524 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:02.551018 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:02.556723 20153 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.557374 20153 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.559859 20170 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:02.560503 20388 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:02.560504 20170 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:02.565840 20388 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.569092 20316 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:02.571770 20170 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:02.572314 20153 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:02.573702 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:02.574760 17594 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:02.579089 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:02.583041 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:02.584968 20161 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:02.559199 17446 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:02.586422 20028 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.585577 20161 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.586907 20028 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.588878 20028 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:02.589062 20161 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:02.590420 17597 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:02.591849 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.592676 17597 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:02.594435 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.595364 17597 raft_consensus.cc:2393] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:02.595453 20388 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:02.602742 17448 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:02.606119 17448 raft_consensus.cc:1240] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:02.606297 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:02.603732 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 249459us
I20260709 13:19:02.613142 17448 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:02.614897 17448 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:02.629364 17522 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:02.631116 17594 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:02.639801 17450 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:02.641338 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.641465 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.642463 17603 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:02.645901 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.651095 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.651752 17445 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
W20260709 13:19:02.651993 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.652547 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.653064 17445 raft_consensus.cc:2376] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6. Re-sending same reply.
I20260709 13:19:02.646193 20136 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.656281 20136 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.657119 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.657709 17451 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.656921 20170 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:02.659006 17447 raft_consensus.cc:1275] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:02.659823 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.660471 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.661553 17447 raft_consensus.cc:2393] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:02.653952 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.607403 20021 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.662926 17449 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:02.664023 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.664934 17447 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:02.665203 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.666431 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.667297 17447 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:02.669518 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.670791 17445 raft_consensus.cc:2410] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:02.660768 17450 raft_consensus.cc:2410] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:19:02.673679 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.677286 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.692817 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.697446 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.701212 20136 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:02.697643 20028 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:19:02.702975 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:02.703732 17522 raft_consensus.cc:2393] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:02.697325 17568 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:02.706598 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.707856 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:02.708964 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.709614 17600 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:02.710306 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.711094 17596 raft_consensus.cc:2393] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:02.711408 17598 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:19:02.711905 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.712625 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.712949 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:02.714350 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.714919 17595 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:02.713023 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.715731 17596 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:02.716041 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:02.716354 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.716694 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:02.717118 17599 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:02.715752 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:02.718120 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:02.719259 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:02.720602 17599 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:02.720645 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.722059 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:02.721930 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.722782 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.722981 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.723402 17449 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:02.713716 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.715150 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:02.658039 20179 consensus_queue.cc:1059] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:19:02.767277 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.767011 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:02.804528 17600 raft_consensus.cc:2410] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:02.722074 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.715752 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:02.773691 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:02.725811 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.806547 17445 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:02.778559 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 56589.4us
I20260709 13:19:02.771067 17520 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:02.774464 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.723644 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.711845 17598 pending_rounds.cc:85] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 7
I20260709 13:19:02.808328 17598 pending_rounds.cc:107] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:19:02.808736 17598 raft_consensus.cc:2889] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:02.716048 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.713716 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:02.809630 17454 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.789433 17596 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:02.807960 17449 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.724886 17452 raft_consensus.cc:2393] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:02.741479 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:02.812851 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 71511.9us
I20260709 13:19:02.813742 17569 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:02.778335 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 55458.5us
I20260709 13:19:02.724093 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.817921 17451 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:02.820508 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.821592 17451 raft_consensus.cc:2410] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:02.816634 17602 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:19:02.827900 17601 raft_consensus.cc:2393] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:02.778223 20376 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:02.771292 20028 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:02.866726 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 53081us
I20260709 13:19:02.867272 20376 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:19:02.767410 20408 log.cc:927] Time spent T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:19:02.868386 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:02.868285 20376 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:02.869408 20161 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:02.870507 17569 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:02.871774 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.831035 17447 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:02.874890 17569 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:02.881040 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:02.881850 17453 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:02.774963 20302 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.871259 20307 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:02.889104 17445 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
W20260709 13:19:02.893599 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 63725.6us
I20260709 13:19:02.865870 20153 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:02.671975 20021 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.903138 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:02.768515 20411 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.138s
W20260709 13:19:02.926393 17420 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.026s	sys 0.038s
W20260709 13:19:02.989640 17420 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.032s	sys 0.041s
I20260709 13:19:02.986971 17447 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:02.936241 17449 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:02.989657 17446 raft_consensus.cc:2410] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:02.883641 20161 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:02.991145 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 612136us
W20260709 13:19:02.967206 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.885874 20397 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.009766 17520 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:19:03.011332 17520 pending_rounds.cc:85] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 4
I20260709 13:19:03.011577 17520 pending_rounds.cc:107] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:19:03.011847 17520 raft_consensus.cc:2889] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:03.015836 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:03.017638 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:02.891418 20179 raft_consensus.cc:3055] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:02.892237 20307 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:03.033577 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.888900 20028 raft_consensus.cc:697] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:03.034762 17452 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:03.036330 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:03.084792 17451 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:02.926393 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:03.049432 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:03.049540 17524 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:03.049772 17602 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:03.055523 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:02.991910 20349 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:03.054409 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:03.095109 18198 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:02.905731 20170 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.897164 20302 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:02.927852 20373 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.129s
I20260709 13:19:03.034287 20179 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:03.068256 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 399786us
I20260709 13:19:02.948154 20388 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.060796 20161 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:03.105180 20170 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:03.118755 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:03.108237 20302 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:03.108065 20028 consensus_queue.cc:237] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:03.110076 20179 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:03.111439 20415 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:19:03.111882 20227 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:03.082639 20308 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:03.128328 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:03.116000 20021 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:03.135165 20179 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.135031 20308 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:03.148162 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.115509 18198 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:03.159814 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:03.160703 17451 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:03.123787 20307 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.115108 20161 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:03.187668 20170 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:03.191540 20308 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:03.193953 20132 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:03.213274 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:03.102335 20349 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:03.261924 17453 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:03.116444 20388 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:03.207710 20161 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.308284 20349 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:03.324430 17454 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:03.329769 17450 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:03.341861 18192 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:03.376484 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.378533 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 228) took 1115 ms. Trace:
I20260709 13:19:03.383529 17448 rpcz_store.cc:276] 0709 13:19:02.263406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.617072 (+353666us) service_pool.cc:224] Handling call
0709 13:19:02.617314 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.617509 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:03.009240 (+391731us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.378163 (+368923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.378216 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:03.378270 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.378347 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.378461 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23961,"prepare.queue_time_us":518126,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":42,"raft.queue_time_us":40249,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":8827,"thread_start_us":716517,"threads_started":2}
W20260709 13:19:03.411613 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.414314 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.415726 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 398228us
I20260709 13:19:03.431303 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:03.421155 20388 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:03.444335 20136 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:03.457546 17522 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:03.457444 17448 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:19:03.460650 17569 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.460767 17448 pending_rounds.cc:85] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 7
I20260709 13:19:03.461815 17448 pending_rounds.cc:107] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:19:03.462205 17448 raft_consensus.cc:2889] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:03.463541 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
W20260709 13:19:03.466820 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 353827us
I20260709 13:19:03.468490 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:03.468540 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:03.478926 17569 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.480885 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:03.484082 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.500073 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:03.504842 17598 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:03.471096 20397 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:03.469413 20388 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:03.478251 20411 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:03.511946 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:03.482301 20349 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:03.516381 17522 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:03.515149 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:03.494262 20308 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.508826 20399 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.469012 20376 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:19:03.491649 20153 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.533012 17527 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:03.518492 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:03.513078 20388 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:03.491425 20148 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:19:03.535274 17598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:19:03.517553 17495 leader_election.cc:400] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:03.579349 17598 raft_consensus.cc:606] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:19:03.579571 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 64146.9us
I20260709 13:19:03.579962 17598 raft_consensus.cc:614] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:03.516176 20411 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:03.492403 20394 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:19:03.538139 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 89535.9us
I20260709 13:19:03.512382 20316 consensus_queue.cc:1059] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:19:03.548403 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:03.577488 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.511111 20170 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:19:03.589743 17601 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:19:03.591929 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 96971.1us
I20260709 13:19:03.593500 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:03.599125 20422 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:19:03.599917 20425 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:19:03.604112 20424 log.cc:927] Time spent T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:19:03.588985 20411 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.625260 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:03.627094 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 97809.7us
W20260709 13:19:03.627475 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 46923us
W20260709 13:19:03.628010 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.632843 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.534861 20397 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:19:03.612674 20349 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:03.628906 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.579236 20388 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.631211 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:03.636160 17420 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.646657 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.642191 17568 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:03.642853 20028 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:03.643993 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.646813 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:03.647806 17568 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:03.628739 20429 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:03.675465 20426 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.676401 17420 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.677887 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:03.676812 20426 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:03.680759 17420 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.622800 20389 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:19:03.648928 20399 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.648145 20136 raft_consensus.cc:697] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:03.699994 17522 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:03.617650 20161 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:03.652681 20427 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.707060 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:03.683488 20021 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:03.710363 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:03.686694 20302 raft_consensus.cc:3055] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:03.691433 20433 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:19:03.715502 17525 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:03.725034 17420 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.726265 20421 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:03.727031 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 83119.6us
I20260709 13:19:03.728356 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:03.731710 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.692401 20426 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:03.732903 17602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:19:03.739406 17602 raft_consensus.cc:606] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.739892 17602 raft_consensus.cc:614] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:03.714313 20349 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:03.714874 20429 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:03.709514 20446 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:03.717828 20302 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:03.714766 20455 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.754637 17569 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:03.755879 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 46050.1us
W20260709 13:19:03.750375 20179 consensus_meta.cc:287] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.584s	user 0.013s	sys 0.000s
I20260709 13:19:03.775380 20161 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:03.766366 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:03.779954 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:03.766144 17420 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.768410 20429 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.768563 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:03.770800 20438 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:19:03.741302 20307 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:03.750352 20170 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.771938 20302 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:03.750344 20349 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.747663 20394 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.754159 20446 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.748327 20445 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:03.759038 20427 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:03.802384 17569 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.792790 20428 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:03.798436 20426 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:03.841923 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 106380us
I20260709 13:19:03.848254 17603 raft_consensus.cc:2393] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:03.855254 17419 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:03.808946 20161 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:03.859449 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 57151.6us
I20260709 13:19:03.860608 17569 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.862272 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.816078 20430 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.823734 20349 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.870615 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.841126 20428 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:03.812971 20153 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:19:03.778774 20136 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:03.836051 20446 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.838832 20441 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:03.907948 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 52744.8us
I20260709 13:19:03.912204 17569 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.807638 20421 consensus_queue.cc:1059] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:19:03.868326 20429 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:03.865546 20462 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:03.876873 20399 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:03.839740 20394 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:03.895402 20316 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:19:03.896570 20161 consensus_queue.cc:1059] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:19:03.920162 20302 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.872516 20431 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.925484 20447 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:03.998628 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 232634us
I20260709 13:19:04.000583 17420 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.918076 20428 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.015564 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:04.023025 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 110925us
I20260709 13:19:04.024281 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.937942 20461 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:03.994701 20443 log.cc:927] Time spent T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.285s	user 0.000s	sys 0.002s
I20260709 13:19:03.920580 20460 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:03.943917 20454 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:03.987772 20445 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:04.006677 20399 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.935425 20021 raft_consensus.cc:697] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:04.034713 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 207002us
I20260709 13:19:04.035702 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:04.039000 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:03.985675 20427 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:04.035775 20453 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:04.051431 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:04.054782 20469 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:04.056201 20437 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:19:04.056107 20394 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:04.059124 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1895) took 1084 ms. Trace:
I20260709 13:19:04.059644 17529 rpcz_store.cc:276] 0709 13:19:02.975037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.979219 (+  4182us) service_pool.cc:224] Handling call
0709 13:19:02.979587 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.993345 (+ 13758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.993375 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.013441 (+ 20066us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.496231 (+482790us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:03.496280 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.496347 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.058804 (+562457us) raft_consensus.cc:1685] finished
0709 13:19:04.058836 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.059044 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151433,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":24302,"thread_start_us":428368,"threads_started":1,"wal-append.queue_time_us":763647}
I20260709 13:19:04.062386 20307 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:04.043017 20470 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 13:19:04.050249 20456 log.cc:927] Time spent T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:19:04.037949 20426 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:04.041621 20170 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:04.050217 20445 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.053158 20399 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.065677 20453 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.072197 20461 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:04.015304 20447 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.068825 20429 raft_consensus.cc:697] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:04.035297 20466 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:19:04.079859 20458 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:04.117795 20421 raft_consensus.cc:3055] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:04.117419 20170 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:04.133283 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 81979.2us
I20260709 13:19:04.126329 20470 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:04.125536 20445 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.129042 20453 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.154516 20179 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:04.142064 20461 raft_consensus.cc:697] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:04.155107 20170 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.174669 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:04.185287 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 149651us
I20260709 13:19:04.180826 20475 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:04.125161 20469 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:19:04.156746 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:04.154623 20470 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:04.187264 17420 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:04.188695 20447 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:04.198582 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1782) took 1202 ms. Trace:
I20260709 13:19:04.201128 20028 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:04.155836 20421 raft_consensus.cc:740] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:04.208482 20475 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:04.233121 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.220069 17603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1342) took 1203 ms (client timeout 1563 ms). Trace:
I20260709 13:19:04.216791 17446 rpcz_store.cc:276] 0709 13:19:02.995758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.996523 (+   765us) service_pool.cc:224] Handling call
0709 13:19:02.998525 (+  2002us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:03.009745 (+ 11220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.009775 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.010273 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.418195 (+407922us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:03.532466 (+114271us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.535476 (+  3010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.535897 (+   421us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.713123 (+177226us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b1800319e40. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:19:04.198255 (+485132us) raft_consensus.cc:1685] finished
0709 13:19:04.198354 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.198515 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32170,"prepare.queue_time_us":232526,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":121223,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":31520,"spinlock_wait_cycles":18077440,"thread_start_us":452073,"threads_started":2,"wal-append.queue_time_us":1092774}
W20260709 13:19:04.234511 17603 rpcz_store.cc:269] 0709 13:19:03.016811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.017146 (+   335us) service_pool.cc:224] Handling call
0709 13:19:04.219846 (+1202700us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54000776d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:04.219996 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1732079616}
I20260709 13:19:04.229679 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:04.239162 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 52131.5us
I20260709 13:19:04.240397 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:04.245102 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:04.217741 20470 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.219337 20132 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:04.158565 20021 consensus_queue.cc:237] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.240808 20028 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.245419 20429 consensus_queue.cc:237] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.247087 20447 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:04.254676 20307 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.257319 20477 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:04.249593 20436 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:19:04.249735 18192 raft_consensus.cc:2393] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:04.202430 20472 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:19:04.254798 17420 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:04.267946 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:04.277401 20132 raft_consensus.cc:697] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:04.302385 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 58587.1us
I20260709 13:19:04.292215 20482 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:04.236120 20479 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:19:04.292941 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:04.294516 17569 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:04.309352 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:04.173794 20427 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:04.311614 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 57547.6us
I20260709 13:19:04.312997 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:04.293913 20477 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.304529 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:19:04.300047 20411 consensus_meta.cc:287] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.650s	user 0.017s	sys 0.000s
I20260709 13:19:04.293020 20447 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.336488 17420 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:04.328971 20473 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
I20260709 13:19:04.320920 20319 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:04.394510 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 58119.6us
I20260709 13:19:04.395576 17420 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:04.366786 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:04.375079 17445 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:04.397202 17447 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:04.398423 17445 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:04.382442 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:04.399658 17450 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.382196 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:04.275888 20428 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.293481 20307 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.423846 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:04.335410 20447 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.423645 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:04.439778 17452 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:04.327054 20477 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.326977 20480 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:04.436162 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:04.441210 17453 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
W20260709 13:19:04.443341 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 111847us
I20260709 13:19:04.334177 20196 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:19:04.456127 17524 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:04.445938 17449 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:19:04.446456 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 51024.2us
I20260709 13:19:04.321116 20445 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.463174 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:04.423448 20460 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:04.393577 20426 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:04.468091 17450 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:04.335291 20411 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.458918 17603 raft_consensus.cc:2955] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 5 to 8, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:04.472826 17420 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:04.479337 17420 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:04.327201 20482 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:04.476066 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 141655us
I20260709 13:19:04.482149 20426 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.272328 20461 consensus_queue.cc:237] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.444516 20466 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:19:04.489035 20459 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:04.486963 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:04.478490 20436 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:04.493798 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 44116.6us
I20260709 13:19:04.495419 17526 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:04.474514 20319 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:04.500916 17420 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:04.483736 20136 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:04.479410 20394 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:19:04.512110 20394 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.512179 20428 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:04.512727 20394 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.514449 20468 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:04.515856 20467 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:04.516709 20463 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.490882 20199 raft_consensus.cc:2955] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 5 to 8, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:04.517259 20463 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.480751 20132 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.519587 20457 consensus_queue.cc:1059] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.164s
I20260709 13:19:04.521159 20457 raft_consensus.cc:3055] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:04.522210 20028 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:04.522584 20472 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:04.523150 20472 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:04.523545 20028 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:19:04.525137 20455 consensus_meta.cc:287] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.000s
I20260709 13:19:04.527333 20455 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:04.521765 20457 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:04.560973 20394 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:04.525496 20472 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:04.503099 20436 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:04.503888 20475 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:04.498380 20319 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.566339 20319 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.567508 20436 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:04.528319 20302 consensus_meta.cc:287] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.004s
I20260709 13:19:04.530444 17448 raft_consensus.cc:2393] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 5: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:04.531260 20481 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:19:04.525373 20431 raft_consensus.cc:3055] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:04.571303 20431 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:04.572687 20431 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.515949 20411 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:04.573807 20431 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.577090 20319 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.580291 20319 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:04.586558 20411 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.587401 20411 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.590518 20411 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:04.505576 20460 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:04.503608 20316 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:04.509158 20462 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.608106 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 49103.3us
W20260709 13:19:04.623905 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 320453us
W20260709 13:19:04.625439 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 162184us
W20260709 13:19:04.604162 20388 consensus_meta.cc:287] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.936s	user 0.011s	sys 0.003s
W20260709 13:19:04.621542 20349 consensus_meta.cc:287] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.703s	user 0.004s	sys 0.008s
W20260709 13:19:04.633024 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 134104us
W20260709 13:19:04.623067 20446 consensus_meta.cc:287] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.681s	user 0.012s	sys 0.000s
I20260709 13:19:04.635253 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:04.653563 17525 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:04.647881 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:04.647917 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 329604us
W20260709 13:19:04.632349 20430 consensus_meta.cc:287] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.761s	user 0.005s	sys 0.008s
I20260709 13:19:04.651472 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:04.654985 17595 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:04.648185 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:04.657027 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:04.658692 17597 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:04.665033 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:04.668156 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:04.670833 17601 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:04.677695 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:04.679029 17594 raft_consensus.cc:2410] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:04.681283 17454 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:04.684801 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:04.685636 17449 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:04.689695 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:04.690816 17568 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:04.694346 17599 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:04.661304 20430 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:04.642743 20472 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:19:04.648147 20436 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:19:04.642838 20411 consensus_queue.cc:1059] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:19:04.648229 20388 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.646517 20428 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:19:04.644707 20349 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:04.721378 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 81388.4us
I20260709 13:19:04.661024 20446 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.702659 20480 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.733278 20411 raft_consensus.cc:3055] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:04.721276 20170 consensus_meta.cc:287] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.000s
W20260709 13:19:04.721094 20453 consensus_meta.cc:287] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 13:19:04.623699 20462 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:04.748332 20478 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:19:04.768319 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1909) took 1039 ms. Trace:
I20260709 13:19:04.713320 20484 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:19:04.746876 20480 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:04.777014 20480 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.779492 20446 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:04.762588 20170 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.782560 20170 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:04.749699 20307 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:04.771119 17521 rpcz_store.cc:276] 0709 13:19:03.729378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.729499 (+   121us) service_pool.cc:224] Handling call
0709 13:19:03.729815 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:03.730182 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.730208 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.740736 (+ 10528us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.152254 (+411518us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:04.152319 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.152445 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.768078 (+615633us) raft_consensus.cc:1685] finished
0709 13:19:04.768107 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.768263 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2997,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":15120,"thread_start_us":373670,"threads_started":1,"wal-append.queue_time_us":490854}
I20260709 13:19:04.749221 20411 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:04.760243 20426 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:04.765635 20453 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.802469 20474 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 13:19:04.803875 20493 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:19:04.804839 20453 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:04.805594 20489 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:04.806269 20489 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:04.809527 20388 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:04.682456 20457 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:04.812855 20457 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.774152 20445 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:04.840824 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 168354us
I20260709 13:19:04.811844 20482 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:04.876567 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:04.877408 20500 log.cc:927] Time spent T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:19:04.884876 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:04.995422 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 97863.2us
I20260709 13:19:04.891891 20430 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:05.009635 20437 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:19:04.885758 20428 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.878937 20436 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.148s
W20260709 13:19:05.058895 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 174097us
I20260709 13:19:04.889164 20453 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:05.061617 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 65124.7us
W20260709 13:19:05.077292 20505 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:19:05.082283 20349 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:05.061623 20472 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:04.890656 20411 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:05.116403 20199 consensus_meta.cc:287] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.006s
I20260709 13:19:05.109560 20132 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:19:05.145340 20496 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:19:05.076622 20430 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.109336 20453 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:05.165566 20199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:42486 (request call id 0) took 2461 ms. Trace:
W20260709 13:19:05.168422 20399 consensus_meta.cc:287] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.034s	user 0.008s	sys 0.001s
I20260709 13:19:05.169659 20464 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:05.140762 20427 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:19:05.127372 20480 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:05.171730 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.176229 20513 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:19:05.190301 17450 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:05.181034 17528 raft_consensus.cc:2955] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 5 to 8, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:05.201736 20462 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:05.202615 20430 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:05.204213 20447 consensus_meta.cc:287] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.747s	user 0.007s	sys 0.003s
I20260709 13:19:05.200706 20480 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:05.219923 20470 consensus_meta.cc:287] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.948s	user 0.008s	sys 0.002s
I20260709 13:19:05.191649 20399 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.221395 20453 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:05.230626 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 157036us
I20260709 13:19:05.210551 20430 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:05.232389 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:05.235093 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:05.236763 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:05.224404 20447 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.235352 20462 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.237805 20526 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:05.238224 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:05.234807 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:05.236681 20472 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:05.240887 20447 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:05.258438 20179 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:05.240190 20132 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:05.240031 20462 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.226857 20470 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.243557 20399 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:05.261101 20472 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:05.235615 20430 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:05.278878 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:05.279841 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:05.265455 20179 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:05.283519 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:05.253661 20021 consensus_queue.cc:1059] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:19:05.285493 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:05.262053 20466 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:05.283993 20421 consensus_queue.cc:260] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.270539 20447 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:05.296216 20421 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.296418 20447 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:05.291183 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:05.298980 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:05.299729 17521 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:05.182257 20199 rpcz_store.cc:276] 0709 13:19:02.703826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.706158 (+  2332us) service_pool.cc:224] Handling call
0709 13:19:03.339827 (+633669us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b54007b2120. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5ae34b1 00007f5ab5b6b863 00007f5ab5b649fa 00007f5abab2c4c9 00007f5ab40a8c54 00007f5ab40a8be2 00007f5ab40a8b11 00007f5ab40a8a8c 00007f5ab40a7d42 00007f5ab3ea148c
0709 13:19:03.445888 (+106061us) log.cc:844] Serialized 501 byte log entry
0709 13:19:03.447180 (+  1292us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54007b1954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6c735 00007f5ab5b649fa 00007f5abab2c4c9 00007f5ab40a8c54 00007f5ab40a8be2 00007f5ab40a8b11 00007f5ab40a8a8c 00007f5ab40a7d42 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:05.165439 (+1718259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60,"raft.queue_time_us":320,"raft.run_cpu_time_us":1273,"raft.run_wall_time_us":1273,"spinlock_wait_cycles":809322752}
I20260709 13:19:05.290202 20480 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:05.291932 20477 consensus_meta.cc:287] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.828s	user 0.013s	sys 0.000s
I20260709 13:19:05.291010 17527 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:05.283918 20472 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:05.293749 20496 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:05.267475 20526 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:19:05.309350 20021 consensus_queue.cc:1059] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:05.315284 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:05.332039 20466 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:05.332525 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:05.337957 20428 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:05.339645 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e57fe371976a485bbdedfdaa4659dec3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:05.342440 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:05.344933 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:05.345686 20447 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:05.350497 20483 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.350952 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:05.352396 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:05.353406 20470 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:05.318718 20477 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.355698 20477 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:05.318718 20480 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.363124 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:05.373741 17521 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:05.370911 17419 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:05.330428 20430 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:05.385804 20349 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.397715 20349 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.399925 20349 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:05.361930 20489 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:05.388367 20536 raft_consensus.cc:2764] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 13:19:05.410490 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 74451.4us
I20260709 13:19:05.395278 20457 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:05.351032 20483 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.429210 20543 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:05.408303 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:05.430872 20466 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.449910 18193 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:05.456310 20411 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:05.461181 20514 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260709 13:19:05.462325 20447 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.462900 20447 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:05.487425 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.434264 20543 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:05.503182 20466 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.503470 20307 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.540681 20543 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:05.540849 20307 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.468571 20472 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.543278 20463 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:05.544024 20179 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.541278 20466 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:05.453410 20479 consensus_queue.cc:1059] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:19:05.332671 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:05.595796 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 183095us
I20260709 13:19:05.568615 17522 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:05.664489 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 74646.7us
I20260709 13:19:05.666117 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:05.660777 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 248050us
I20260709 13:19:05.666702 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:05.667490 17449 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:05.696944 17445 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:19:05.695865 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:05.698251 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:05.698850 17451 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:05.700227 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:05.556999 20179 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:05.705406 17451 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:05.706702 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:05.706751 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:05.711066 17600 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:05.713792 17447 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:05.714100 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:05.715709 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:05.716109 20544 consensus_queue.cc:1059] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:05.717185 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:05.717944 17454 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:19:05.718997 20496 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.719481 20496 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.721529 20496 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:05.717181 20544 raft_consensus.cc:3055] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:05.722460 20544 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:05.723057 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:05.723371 20544 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.724320 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:05.724645 20544 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:05.726807 20447 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:05.727133 20479 raft_consensus.cc:3055] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:05.543314 20307 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:05.727594 20479 raft_consensus.cc:740] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:05.727948 20307 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.728488 20479 consensus_queue.cc:260] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.729302 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:05.729995 20436 raft_consensus.cc:3055] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:05.730398 20436 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:05.731163 20436 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.732105 20436 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:05.733378 20428 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:05.544044 20463 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:05.733974 20428 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:05.734758 20349 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.734586 20463 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.735251 20349 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:05.736241 20428 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:05.737298 20349 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:05.737380 20463 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:05.557686 20480 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:05.719540 17453 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:05.741247 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:05.556917 20483 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:05.655515 20482 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.743392 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:05.746307 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:05.746910 17599 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:05.729851 20479 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.753021 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:05.756254 17599 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:05.757918 17600 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:19:05.758361 17600 pending_rounds.cc:85] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 3
I20260709 13:19:05.758644 17600 pending_rounds.cc:107] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:05.758912 17600 raft_consensus.cc:2889] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:05.778903 17601 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:05.709671 20472 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:05.781481 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:05.804574 17602 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:05.752120 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:05.809566 17600 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:05.810120 17520 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:05.809556 17454 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:05.816733 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1907) took 2317 ms. Trace:
I20260709 13:19:05.817281 17526 rpcz_store.cc:276] 0709 13:19:03.498906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.518235 (+ 19329us) service_pool.cc:224] Handling call
0709 13:19:03.532144 (+ 13909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.497241 (+965097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.816482 (+1319241us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54002c8b54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:05.816657 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2208251648}
I20260709 13:19:05.823324 17528 raft_consensus.cc:3055] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:05.823664 17600 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:05.824815 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:05.825404 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:05.823706 17528 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:05.728443 20307 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.828667 17603 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:05.844995 17601 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:05.831218 20504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.020s	sys 0.038s
W20260709 13:19:05.881202 20504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.020s	sys 0.039s
W20260709 13:19:05.859256 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.884620 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.885322 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.762370 20482 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:05.823853 20028 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:05.845315 20432 raft_consensus.cc:670] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } [suppressed 4 similar messages]
W20260709 13:19:06.048502 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.828745 20349 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.060758 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:06.060694 20349 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.062546 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:06.063164 20349 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:06.063802 20349 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:06.064265 20349 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.065438 20538 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:06.040724 20463 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:06.066982 20463 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.068673 20349 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:05.828019 20480 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:06.069882 20480 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:05.882186 20445 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.072472 20480 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:06.073422 20480 consensus_queue.cc:1059] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:06.036626 17600 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:06.053462 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:06.069175 20463 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:06.072057 20445 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.034340 17419 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:06.080135 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:06.097332 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 63082.8us
W20260709 13:19:06.052076 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.039415 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.098512 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:06.063261 17452 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:06.098054 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:06.102618 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:06.115586 17453 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.118345 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:06.112058 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:06.122293 20428 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.122998 20428 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.123099 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:06.123618 20428 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.124348 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:06.125108 17600 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 4.
I20260709 13:19:06.116717 20397 raft_consensus.cc:3055] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:06.126502 20397 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:06.127620 20397 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.128684 20545 consensus_queue.cc:1059] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:06.129004 20511 consensus_queue.cc:1059] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:06.102550 20543 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:19:06.129875 20466 consensus_queue.cc:1059] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:06.130921 20546 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:06.102365 20021 consensus_queue.cc:1059] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:19:06.132113 20546 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:06.112545 20179 consensus_queue.cc:1059] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:19:06.112546 20454 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:06.095634 20427 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.134711 20427 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:06.135501 17600 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:06.109928 17454 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
W20260709 13:19:06.163650 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.171514 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:06.173730 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:06.176506 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 58251.4us
I20260709 13:19:06.193277 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:06.189607 20466 raft_consensus.cc:3055] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:06.111991 20463 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:06.134161 20496 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:06.162671 20427 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.065963 20538 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.189155 20545 consensus_queue.cc:1243] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:06.084548 20028 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.169858 20543 raft_consensus.cc:3055] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:06.206290 17420 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.683s (SENT) [suppressed 8 similar messages]
I20260709 13:19:06.169196 20349 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:06.210119 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:06.163420 20447 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:06.194891 20466 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:06.226336 20538 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:06.166356 20454 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:06.237720 17452 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
W20260709 13:19:06.239403 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 409472us
I20260709 13:19:06.215689 20496 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:06.239791 20545 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.251124 17453 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
W20260709 13:19:06.245517 20411 consensus_meta.cc:287] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.788s	user 0.017s	sys 0.000s
I20260709 13:19:06.221779 20463 raft_consensus.cc:697] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:06.266716 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:06.232425 20543 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:06.286569 17524 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
W20260709 13:19:06.287285 17448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1796) took 1902 ms (client timeout 2044 ms). Trace:
W20260709 13:19:06.287846 17448 rpcz_store.cc:269] 0709 13:19:04.374453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.374606 (+   153us) service_pool.cc:224] Handling call
0709 13:19:06.276974 (+1902368us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400214b54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:06.277195 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297120512}
I20260709 13:19:06.291190 17448 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [5.4-6.5]
W20260709 13:19:06.298517 20539 log.cc:927] Time spent T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:19:06.311231 17449 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:06.243647 20447 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.307644 20551 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.315202 20551 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.318409 20551 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:06.319135 20551 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.319746 20551 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.322470 20547 consensus_queue.cc:1059] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:06.322523 20411 consensus_queue.cc:1059] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:06.325749 17454 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.335084 20411 consensus_queue.cc:1059] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:06.336180 20547 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.270303 20430 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.341460 17445 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:19:06.336790 20547 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.273046 20545 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:06.354763 17445 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:06.357569 17445 raft_consensus.cc:1240] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:06.289644 20538 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.359287 17445 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:19:06.372893 17445 raft_consensus.cc:1240] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:06.374579 17445 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:06.380975 20543 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.366176 17454 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:06.242156 20349 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:06.339605 20447 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:06.382573 17598 consensus_queue.cc:237] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:19:06.413187 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.369668 20545 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.387331 20445 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:06.375200 20538 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:06.449599 20544 consensus_meta.cc:287] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.721s	user 0.019s	sys 0.020s
I20260709 13:19:06.428686 20397 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.355930 20430 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.382598 20543 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.374914 20307 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:06.406162 20546 raft_consensus.cc:3055] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:06.434234 20482 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:06.433672 20458 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:06.533562 20458 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:06.535379 20179 consensus_queue.cc:1243] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:06.535825 20458 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:06.485877 20551 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:06.496680 20538 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.523862 20546 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:06.531659 20430 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:06.531832 20536 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:06.535987 20179 raft_consensus.cc:3055] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:06.351444 20466 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:06.550627 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 511047us
I20260709 13:19:06.579591 17453 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:06.581264 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:06.582505 17445 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.550999 20558 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:06.435719 20496 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.452205 20463 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:06.596303 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 352997us
W20260709 13:19:06.599829 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 393542us
I20260709 13:19:06.569341 20179 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:06.614604 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:06.616248 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:06.623884 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:06.625083 17420 leader_election.cc:336] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.741s (SENT)
I20260709 13:19:06.626016 17445 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:06.625651 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:06.592756 20227 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.631356 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:06.704327 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.684469 17420 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:06.570202 20536 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.598272 20028 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:06.602578 20466 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:06.712425 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.741117 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:06.749791 17445 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:06.751075 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:06.743083 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.745414 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 114145us
W20260709 13:19:06.752254 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.705742 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 440153us
I20260709 13:19:06.753973 17445 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.758699 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:06.759910 17453 raft_consensus.cc:2410] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:06.632493 20430 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.703979 20458 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:06.685539 20496 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:06.766763 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.739820 20445 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:06.740015 20447 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:06.711448 20454 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:06.776822 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:06.790513 17453 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:06.634621 20544 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.770442 20430 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.603012 20558 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.763913 20562 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:06.808171 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.771013 20563 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:06.684597 20561 consensus_queue.cc:1059] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.160s
I20260709 13:19:06.769585 20028 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:06.795491 20482 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.742487 20227 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:06.845675 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:06.854771 17453 raft_consensus.cc:2393] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:06.836810 17445 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:06.796326 20547 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:06.795293 20430 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:06.796811 20445 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:06.861160 17594 raft_consensus.cc:1240] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:06.847930 20544 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:06.859381 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:06.883334 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.914139 17569 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:06.890681 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 206350us
I20260709 13:19:06.915540 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:06.902009 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 149665us
I20260709 13:19:06.905164 20504 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:06.917433 20504 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:06.920284 20504 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:06.777626 20179 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.796569 20447 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:06.856262 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:06.924695 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:06.744473 20546 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:06.852320 20562 raft_consensus.cc:697] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:06.787876 20458 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:06.868451 20553 log.cc:927] Time spent T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
I20260709 13:19:06.926328 20454 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:07.055733 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 141609us
I20260709 13:19:06.862772 20568 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:06.991225 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 221264us
W20260709 13:19:07.057006 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 141583us
W20260709 13:19:07.057576 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 133787us
I20260709 13:19:07.019089 20569 consensus_queue.cc:1059] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.156s
I20260709 13:19:07.019354 20556 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.869483 20482 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.058941 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1473) took 1350 ms. Trace:
W20260709 13:19:06.859193 20436 consensus_meta.cc:287] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.127s	user 0.025s	sys 0.000s
I20260709 13:19:06.858570 20028 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:07.066253 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:07.087841 17451 rpcz_store.cc:276] 0709 13:19:05.708129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.708262 (+   133us) service_pool.cc:224] Handling call
0709 13:19:05.708541 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.720566 (+ 12025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.720599 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.721121 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.189500 (+468379us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:06.189544 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.189624 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.058718 (+869094us) raft_consensus.cc:1685] finished
0709 13:19:07.058738 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.058882 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2750,"raft.queue_time_us":12860,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":88,"thread_start_us":467984,"threads_started":1,"wal-append.queue_time_us":656825}
I20260709 13:19:06.892436 20430 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.106738 17453 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:07.060634 20458 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:07.056759 20568 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:07.107484 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 49878.4us
I20260709 13:19:06.854581 20349 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:06.850351 20563 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:07.065537 20454 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.913985 20544 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:07.142112 20570 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:19:07.142403 20544 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:07.132282 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1588) took 1031 ms. Trace:
I20260709 13:19:07.140388 20583 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:07.141562 20563 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:07.146430 17597 rpcz_store.cc:276] 0709 13:19:06.101158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.790520 (+689362us) service_pool.cc:224] Handling call
0709 13:19:06.790823 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.791020 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:06.791272 (+   252us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.106140 (+314868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:07.106194 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:07.106250 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.106316 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.132183 (+ 25867us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":99,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"thread_start_us":314372,"threads_started":2}
I20260709 13:19:07.114481 20546 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:07.162117 20572 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 13:19:07.163096 20427 consensus_meta.cc:287] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.930s	user 0.007s	sys 0.005s
I20260709 13:19:07.166285 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:07.115353 20436 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:19:07.155261 20479 consensus_meta.cc:287] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.384s	user 0.011s	sys 0.002s
I20260709 13:19:07.177729 20464 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.180578 20535 raft_consensus.cc:3055] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:07.230281 20535 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:07.231127 20535 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.232154 20535 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:07.219455 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.061394 20562 consensus_queue.cc:237] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.236470 20227 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:07.223744 17568 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:07.229427 20464 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.241539 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:07.276814 20536 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:07.175545 20560 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.418s	user 0.001s	sys 0.000s
W20260709 13:19:07.281957 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 198401us
W20260709 13:19:07.291520 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 67860us
I20260709 13:19:07.291520 17453 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:07.295301 20349 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:07.297152 20580 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:19:07.297986 20576 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 13:19:07.297911 17528 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:07.298936 20573 log.cc:927] Time spent T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:19:07.299036 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1485) took 1488 ms. Trace:
W20260709 13:19:07.325044 17596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.008s	sys 0.012s
I20260709 13:19:07.142138 20454 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:07.360318 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.299494 20565 log.cc:927] Time spent T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
W20260709 13:19:07.358484 17596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.008s	sys 0.012s
I20260709 13:19:07.226367 20427 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:07.238883 20436 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.366314 20427 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:07.367317 20563 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:07.368028 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1577) took 1553 ms. Trace:
W20260709 13:19:07.298938 20571 log.cc:927] Time spent T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 13:19:07.368752 17596 rpcz_store.cc:276] 0709 13:19:05.814560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.815534 (+   974us) service_pool.cc:224] Handling call
0709 13:19:05.818924 (+  3390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.819189 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:06.341042 (+521853us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.364089 (+1023047us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:07.364201 (+   112us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:07.364272 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.364463 (+   191us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.367938 (+  3475us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":755751,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":366526,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":1516379,"threads_started":3,"wal-append.queue_time_us":700506}
I20260709 13:19:07.104018 20556 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.377671 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1483) took 1630 ms. Trace:
I20260709 13:19:07.415139 17448 rpcz_store.cc:276] 0709 13:19:05.747154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.295096 (+547942us) service_pool.cc:224] Handling call
0709 13:19:06.295529 (+   433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.298390 (+  2861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.298799 (+   409us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.304428 (+  5629us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.759246 (+454818us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:06.759428 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.759522 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.377352 (+617830us) raft_consensus.cc:1685] finished
0709 13:19:07.377382 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.377586 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":396,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"thread_start_us":453543,"threads_started":1,"wal-append.queue_time_us":547873}
I20260709 13:19:07.379228 20536 raft_consensus.cc:1064] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:19:07.382632 20484 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:07.383533 20132 raft_consensus.cc:3055] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:07.342983 20458 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.385949 17454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1490) took 1566 ms (client timeout 1853 ms). Trace:
I20260709 13:19:07.343369 20447 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:07.408535 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1582) took 1587 ms. Trace:
I20260709 13:19:07.438109 17600 rpcz_store.cc:276] 0709 13:19:05.826351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.136400 (+310049us) service_pool.cc:224] Handling call
0709 13:19:06.175342 (+ 38942us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.534260 (+358918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.534290 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.534858 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.848397 (+313539us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:06.857410 (+  9013us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.022415 (+165005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.022533 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.408203 (+385670us) raft_consensus.cc:1685] finished
0709 13:19:07.408236 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.408441 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4716,"prepare.queue_time_us":39330,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":11299,"raft.queue_time_us":685571,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":14733,"thread_start_us":831390,"threads_started":3,"wal-append.queue_time_us":573660}
I20260709 13:19:07.423193 20388 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:07.423233 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:07.442855 20388 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:07.444267 20575 log.cc:927] Time spent T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:19:07.444458 20388 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.446563 20021 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:07.447111 20021 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:07.436961 17454 rpcz_store.cc:269] 0709 13:19:05.819836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.140368 (+320532us) service_pool.cc:224] Handling call
0709 13:19:07.385701 (+1245333us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54000da2d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:07.385863 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353049984}
I20260709 13:19:07.449918 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1586) took 1349 ms. Trace:
I20260709 13:19:07.457549 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1580) took 1636 ms. Trace:
I20260709 13:19:07.458056 17603 rpcz_store.cc:276] 0709 13:19:05.820894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.111536 (+290642us) service_pool.cc:224] Handling call
0709 13:19:06.112230 (+   694us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.114212 (+  1982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.114240 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.148270 (+ 34030us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.682496 (+534226us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:06.682540 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.682614 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.457312 (+774698us) raft_consensus.cc:1685] finished
0709 13:19:07.457332 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.457488 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1380,"raft.queue_time_us":6116,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":25686,"thread_start_us":492916,"threads_started":1,"wal-append.queue_time_us":689948}
I20260709 13:19:07.459558 20447 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:07.450444 17595 rpcz_store.cc:276] 0709 13:19:06.100622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.385436 (+284814us) service_pool.cc:224] Handling call
0709 13:19:06.385782 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.386293 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.386332 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.425001 (+ 38669us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.855728 (+430727us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:06.887563 (+ 31835us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.157658 (+270095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.157802 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.449637 (+291835us) raft_consensus.cc:1685] finished
0709 13:19:07.449661 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.449844 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46736,"prepare.queue_time_us":132238,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":459118,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":12092,"thread_start_us":663276,"threads_started":2,"wal-append.queue_time_us":800720}
I20260709 13:19:07.462426 20598 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:07.472286 17526 raft_consensus.cc:1240] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:07.507144 20594 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:07.507766 20594 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:07.504841 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1572) took 1699 ms. Trace:
I20260709 13:19:07.425043 20558 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:07.519039 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.519676 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 177127us
I20260709 13:19:07.326959 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:07.520856 17453 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:07.356540 17449 rpcz_store.cc:276] 0709 13:19:05.810376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.312286 (+501910us) service_pool.cc:224] Handling call
0709 13:19:06.312713 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.313220 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.313260 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.313959 (+   699us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.598228 (+284269us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:06.598271 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.598346 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.298796 (+700450us) raft_consensus.cc:1685] finished
0709 13:19:07.298815 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.298958 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1373,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":281736,"threads_started":1,"wal-append.queue_time_us":500001}
I20260709 13:19:07.448786 20132 raft_consensus.cc:740] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:07.521977 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:07.527110 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:07.522187 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:07.531998 17449 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:07.508630 17602 rpcz_store.cc:276] 0709 13:19:05.805833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.806283 (+   450us) service_pool.cc:224] Handling call
0709 13:19:05.829167 (+ 22884us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.033860 (+204693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.035904 (+  2044us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.036467 (+   563us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.337693 (+301226us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:06.762456 (+424763us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.067144 (+304688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.067248 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.504631 (+437383us) raft_consensus.cc:1685] finished
0709 13:19:07.504649 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.504790 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21751,"prepare.queue_time_us":277694,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1237,"raft.queue_time_us":629150,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":4001,"thread_start_us":897293,"threads_started":3,"wal-append.queue_time_us":475775}
I20260709 13:19:07.538365 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:07.532938 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:07.541126 17454 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 5.
I20260709 13:19:07.503358 20479 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:07.558064 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:07.560459 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:07.560823 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:07.561467 17594 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
W20260709 13:19:07.562367 17569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.001s	sys 0.020s
W20260709 13:19:07.562850 17569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.001s	sys 0.020s
W20260709 13:19:07.563306 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 506593us
I20260709 13:19:07.562942 17596 raft_consensus.cc:2393] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:07.564016 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:07.566395 17597 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:07.571589 20132 consensus_queue.cc:260] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.573493 20132 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.504925 20447 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:07.510692 20598 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.448161 20021 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.583547 20021 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:07.551977 20586 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:19:07.463142 20458 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.590607 20458 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:07.565794 20479 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:07.613498 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:07.578400 20538 consensus_meta.cc:287] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.006s	user 0.010s	sys 0.002s
I20260709 13:19:07.639983 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:07.637228 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.640882 17600 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:07.648116 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1912) took 3356 ms. Trace:
I20260709 13:19:07.648670 17527 rpcz_store.cc:276] 0709 13:19:04.291328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.291699 (+   371us) service_pool.cc:224] Handling call
0709 13:19:04.291992 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.318463 (+1026471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.647839 (+2329376us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54001def54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:07.648040 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2297026816}
I20260709 13:19:07.659490 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:07.660439 17492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.011s	sys 0.028s
W20260709 13:19:07.661000 17492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.011s	sys 0.028s
I20260709 13:19:07.660387 17448 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:07.666605 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:07.668406 17448 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
W20260709 13:19:07.668341 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.670840 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.636740 20482 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:07.637633 20583 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:07.676563 17452 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.012s	sys 0.032s
W20260709 13:19:07.687445 17452 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.012s	sys 0.032s
I20260709 13:19:07.697692 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1486) took 1879 ms. Trace:
W20260709 13:19:07.670153 20560 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:19:07.702986 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 159666us
I20260709 13:19:07.698203 17452 rpcz_store.cc:276] 0709 13:19:05.818380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.327507 (+509127us) service_pool.cc:224] Handling call
0709 13:19:06.328914 (+  1407us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.329440 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.329478 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.346520 (+ 17042us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.790311 (+443791us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:07.697123 (+906812us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.697351 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.697427 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.697467 (+    40us) raft_consensus.cc:1685] finished
0709 13:19:07.697477 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.697630 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6484,"thread_start_us":1215282,"threads_started":2,"wal-append.queue_time_us":535771}
I20260709 13:19:07.707109 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:07.707985 17448 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:07.709115 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:07.673799 20549 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:07.716111 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 152172us
I20260709 13:19:07.716928 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:07.718483 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:07.721031 17448 raft_consensus.cc:2410] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:07.649641 20538 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.735180 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1820) took 1134 ms. Trace:
I20260709 13:19:07.699003 20436 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:07.735790 17448 rpcz_store.cc:276] 0709 13:19:06.600607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.708822 (+1108215us) service_pool.cc:224] Handling call
0709 13:19:07.735099 (+ 26277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:07.738765 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:07.742615 20582 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:07.741134 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1821) took 1125 ms. Trace:
I20260709 13:19:07.760835 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:07.723119 20594 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:07.782435 17448 rpcz_store.cc:276] 0709 13:19:06.615942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.740019 (+1124077us) service_pool.cc:224] Handling call
0709 13:19:07.740427 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.740676 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.740729 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:07.740793 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:07.740850 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.740925 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.741060 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:07.728307 20558 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:07.734329 20447 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:07.775586 20397 consensus_meta.cc:287] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.252s	user 0.010s	sys 0.014s
I20260709 13:19:07.794865 17594 raft_consensus.cc:2410] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:19:07.786832 20543 consensus_meta.cc:287] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.260s	user 0.008s	sys 0.012s
W20260709 13:19:07.797633 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.748888 20568 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:07.800711 20608 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:07.800987 20600 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:07.801265 20428 consensus_meta.cc:287] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.677s	user 0.013s	sys 0.016s
W20260709 13:19:07.818977 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.806957 17448 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:07.791047 20464 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:07.820251 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1822) took 1136 ms. Trace:
W20260709 13:19:07.806653 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 72375.9us
I20260709 13:19:07.793535 20028 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:07.791378 20436 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:07.824156 17448 rpcz_store.cc:276] 0709 13:19:06.683702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.796740 (+1113038us) service_pool.cc:224] Handling call
0709 13:19:07.798181 (+  1441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.819854 (+ 21673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.820170 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:07.818743 20543 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.831459 20543 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:07.820693 20544 consensus_meta.cc:287] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.032s
W20260709 13:19:07.826345 20545 consensus_meta.cc:287] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.337s	user 0.032s	sys 0.001s
I20260709 13:19:07.817984 20582 raft_consensus.cc:697] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:07.851455 17569 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:07.837029 20463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.011s	sys 0.014s
W20260709 13:19:07.850594 20496 consensus_meta.cc:287] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.059s	user 0.014s	sys 0.007s
I20260709 13:19:07.862457 17569 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:07.863898 17569 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:07.866153 17569 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:07.852207 20583 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:07.850095 20544 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.874594 20593 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:19:07.875243 20583 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.876636 20544 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:07.876793 20615 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:07.877475 20615 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:07.853142 20545 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.858076 20028 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:07.887384 20582 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:07.822163 20608 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:07.838778 20436 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:07.858819 20463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.011s	sys 0.014s
I20260709 13:19:07.895480 20545 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:07.896922 20436 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:07.876663 20604 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:07.897851 20604 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:07.906782 20543 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:07.908777 20602 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:07.909443 20602 raft_consensus.cc:697] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:07.910566 20602 consensus_queue.cc:237] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.909494 20594 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.822858 20428 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.911402 20618 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:07.912302 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 46269us
I20260709 13:19:07.953532 17569 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:07.951426 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.951589 20132 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.836673 20482 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:19:07.959641 17449 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:07.982757 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1827) took 1206 ms. Trace:
I20260709 13:19:07.983223 17449 rpcz_store.cc:276] 0709 13:19:06.776117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.959025 (+1182908us) service_pool.cc:224] Handling call
0709 13:19:07.959334 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.982363 (+ 23029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.982681 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:07.942179 20568 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:08.003487 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1576) took 2190 ms. Trace:
I20260709 13:19:08.003952 17599 rpcz_store.cc:276] 0709 13:19:05.812571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.813476 (+   905us) service_pool.cc:224] Handling call
0709 13:19:05.813906 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.279249 (+465343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.279296 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.290484 (+ 11188us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.600341 (+309857us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:06.600375 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.957469 (+1357094us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400315454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:07.957538 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.957599 (+    61us) raft_consensus.cc:1685] finished
0709 13:19:07.957622 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.003347 (+ 45725us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54,"raft.queue_time_us":61997,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":15634,"spinlock_wait_cycles":513440128,"thread_start_us":550961,"threads_started":2,"wal-append.queue_time_us":552144}
I20260709 13:19:08.005841 17451 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:07.956493 20132 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.905571 20604 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:07.859210 20556 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:07.892532 20608 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:07.941457 20544 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.058507 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.123412 17527 raft_consensus.cc:2410] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:08.124686 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.059911 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.127595 17521 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:08.060619 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.104717 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:07.879874 20615 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:08.031906 20538 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.119792 20428 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.120682 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:08.133193 20623 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:19:08.121424 20430 consensus_meta.cc:287] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.985s	user 0.033s	sys 0.019s
I20260709 13:19:08.134203 20430 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:07.972790 20589 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:08.135568 20589 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:07.957175 20594 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:08.129751 17520 raft_consensus.cc:2410] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:07.976325 20593 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:08.004645 20618 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:08.218042 20589 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:08.454828 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.516994 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:08.312137 17598 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.000s	sys 0.011s
W20260709 13:19:08.523644 17598 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.000s	sys 0.013s
W20260709 13:19:08.312739 18167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.001s	sys 0.009s
I20260709 13:19:08.522202 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:08.524581 18167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.001s	sys 0.010s
W20260709 13:19:08.530323 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.530283 17450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1805) took 3871 ms (client timeout 1580 ms). Trace:
W20260709 13:19:08.525460 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 736677us
I20260709 13:19:08.524845 17521 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
W20260709 13:19:08.476565 20609 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.003s
W20260709 13:19:08.219098 20535 consensus_meta.cc:287] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.987s	user 0.000s	sys 0.043s
W20260709 13:19:08.531172 17450 rpcz_store.cc:269] 0709 13:19:04.650908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.651205 (+   297us) service_pool.cc:224] Handling call
0709 13:19:08.521737 (+3870532us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54000d7ad4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:08.522483 (+   746us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223394560}
W20260709 13:19:08.459666 20021 consensus_meta.cc:287] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.876s	user 0.003s	sys 0.009s
I20260709 13:19:08.535478 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:08.533929 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.532745 20388 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:08.542869 17520 raft_consensus.cc:2410] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:08.543773 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:19:08.519454 20466 consensus_meta.cc:287] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.754s	user 0.020s	sys 0.005s
I20260709 13:19:08.551805 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:08.164346 20028 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:08.540019 20608 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:08.555585 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:08.563273 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.558221 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:08.568557 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1548) took 3291 ms. Trace:
I20260709 13:19:08.569026 17522 rpcz_store.cc:276] 0709 13:19:05.277417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.277572 (+   155us) service_pool.cc:224] Handling call
0709 13:19:05.279906 (+  2334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.666473 (+386567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.568304 (+2901831us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54000ff354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:08.568503 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613005312}
I20260709 13:19:08.538257 20594 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.330642 20544 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:08.550563 20388 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.583678 17569 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:08.552629 20593 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:08.552101 20583 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:08.590704 20556 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:19:08.595157 20583 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:08.597512 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:08.597899 20583 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:08.598477 17600 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:08.598923 17522 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:08.599362 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:08.599932 17600 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.539333 20598 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.600726 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.601351 17522 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:08.603410 17522 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:08.604692 17520 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:08.606465 17520 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:08.605932 20594 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:08.606626 20535 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.608518 20535 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:08.610369 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.611037 17520 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:08.566246 20132 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.612218 17522 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:08.615998 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1824) took 1872 ms. Trace:
I20260709 13:19:08.616277 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 357) took 1111 ms. Trace:
I20260709 13:19:08.566841 20608 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:08.619037 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.618382 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.619786 20608 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.620060 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.552778 20616 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:08.606700 20598 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.620958 17525 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:08.621153 20616 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:08.623276 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.623632 20616 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.620254 17520 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:08.558674 20558 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:08.621423 20598 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:08.623886 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.624257 20558 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.624662 20558 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.624733 17529 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:08.625979 20598 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.626077 20445 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:08.623809 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.571177 20595 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:08.616883 17526 rpcz_store.cc:276] 0709 13:19:07.504480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.505138 (+   658us) service_pool.cc:224] Handling call
0709 13:19:07.505448 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.597528 (+ 92080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.597560 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:07.597605 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:07.597642 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.615980 (+1018338us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b5400413054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:08.616043 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.616203 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211281792}
I20260709 13:19:08.611299 20535 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:08.631785 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.632175 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.632493 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.633402 20179 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:08.633548 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 75285.3us
I20260709 13:19:08.634732 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:08.635825 20535 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:08.636375 20535 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.636817 20535 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:08.638958 20546 consensus_meta.cc:287] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.463s	user 0.006s	sys 0.012s
I20260709 13:19:08.639619 20482 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:08.640161 20482 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:08.640623 20482 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:08.591004 17597 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:08.592926 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:08.645224 17596 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:08.616474 17448 rpcz_store.cc:276] 0709 13:19:06.743681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.828846 (+1085165us) service_pool.cc:224] Handling call
0709 13:19:07.829298 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.829747 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.829788 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.832291 (+  2503us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.943843 (+111552us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:07.943908 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.944015 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.615787 (+671772us) raft_consensus.cc:1685] finished
0709 13:19:08.615808 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.615936 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4889,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":7897,"thread_start_us":110999,"threads_started":1,"wal-append.queue_time_us":752653}
I20260709 13:19:08.658093 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:08.658917 17596 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:19:08.593875 20388 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.662954 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.663894 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:08.666481 17521 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
W20260709 13:19:08.664340 17493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.028s	sys 0.046s
I20260709 13:19:08.665241 17522 raft_consensus.cc:2410] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:19:08.667380 17493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.028s	sys 0.046s
I20260709 13:19:08.667766 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:08.668725 17596 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.616962 20430 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.593672 20593 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.595189 20462 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.670128 20614 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.679780 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:08.671576 20445 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 13:19:08.681856 17568 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.041s	sys 0.085s
I20260709 13:19:08.684901 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:08.685464 17600 raft_consensus.cc:2410] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:19:08.685968 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.690735 17495 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:08.691682 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.692142 17568 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.041s	sys 0.085s
W20260709 13:19:08.692945 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 745144us
I20260709 13:19:08.693493 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:08.693930 20549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.053s	sys 0.119s
W20260709 13:19:08.694403 20549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.053s	sys 0.119s
I20260709 13:19:08.694682 20549 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:08.695073 17568 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:08.695366 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.695871 17521 raft_consensus.cc:1813] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Handling vote request from an unknown peer 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:08.696039 20595 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.695662 20549 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:08.696619 20595 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:08.696681 17521 raft_consensus.cc:2410] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:08.697661 20307 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:08.699744 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.700366 17526 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:08.701068 20595 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:08.702527 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:08.700394 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:08.703481 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.703945 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:08.705163 20614 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:08.706040 20479 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:08.706521 17521 raft_consensus.cc:2410] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:08.707453 20614 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.705591 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:08.708281 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.686602 20583 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.709347 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.709920 17525 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:08.710367 17528 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.710788 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.711511 17523 raft_consensus.cc:2410] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:08.712458 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.704278 17526 raft_consensus.cc:2393] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:08.713238 20594 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:08.713738 20594 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:08.714181 20594 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.699187 17568 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:08.715611 20552 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:08.716871 17568 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:08.717932 17528 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:19:08.719046 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.719681 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.720353 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.722492 17528 pending_rounds.cc:85] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 4
I20260709 13:19:08.714614 20591 raft_consensus.cc:3055] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:08.703020 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.723804 17528 pending_rounds.cc:107] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:08.721858 17526 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:19:08.724159 17528 raft_consensus.cc:2889] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:08.724386 17568 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:08.722563 17529 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:19:08.726330 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:08.727814 17597 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.709517 20583 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:08.751274 20552 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:08.753031 20583 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.756101 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.756652 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 1928) took 3044 ms. Trace:
I20260709 13:19:08.757705 17419 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:08.758212 17568 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:08.758998 17568 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:08.759390 17419 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:08.763087 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.773851 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:08.778976 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:08.756992 17528 rpcz_store.cc:276] 0709 13:19:05.712260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.751409 (+ 39149us) service_pool.cc:224] Handling call
0709 13:19:05.754891 (+  3482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.430860 (+675969us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b4c0019f140. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab3e32a20 00007f5ab3e43a29 00007f5ab3e09644 00007f5ab3e30f2d 00007f5ab3e30b93 00007f5ab5b6118b 00007f5ab5b61cb5 00007f5ab5b5cf30 00007f5ab5b5e7de 00007f5ab5b68b49 00007f5ab5b69416
0709 13:19:07.297530 (+866670us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54001b7ea0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5ae406f 00007f5ab5b5cf60 00007f5ab5b5e7de 00007f5ab5b68b49 00007f5ab5b69416 00007f5ab5b65d8f 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62
0709 13:19:08.709945 (+1412415us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5800588ed0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5ac20aa 00007f5ab5b44447 00007f5ab5b5cfe7 00007f5ab5b5e7de 00007f5ab5b68b49 00007f5ab5b69416 00007f5ab5b65d8f 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4
0709 13:19:08.756403 (+ 46458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.756601 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3418741120}
I20260709 13:19:08.657392 20028 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:19:08.780069 17526 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
W20260709 13:19:08.831611 17420 leader_election.cc:336] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.683s (SENT)
W20260709 13:19:08.836741 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 134318us
I20260709 13:19:08.840540 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:08.687152 20593 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.855782 20556 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:19:08.859480 20558 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:08.860852 20636 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:08.861332 20636 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:08.861694 20636 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:08.862490 20558 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:08.866092 20567 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:08.866657 20567 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:08.867085 20567 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.869201 20544 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:08.870358 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:08.725893 20621 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:08.786899 20595 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:08.738461 20591 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:08.793303 20307 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:08.883558 17596 raft_consensus.cc:2410] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:19:08.908572 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:08.880347 17419 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:08.908779 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:08.909335 17450 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:08.909453 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:08.909864 17596 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.794229 20316 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:08.881956 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 50408.4us
I20260709 13:19:08.765131 20569 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.898766 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:08.911418 17448 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:08.912931 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:08.913914 17601 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:08.947803 17447 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:08.974885 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:08.903729 17495 connection.cc:256] RPC call timeout handler was delayed by -1.2067752329999166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 13:19:08.993404 20618 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:08.993480 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 142885us
I20260709 13:19:08.995116 17419 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:08.997614 20635 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:08.998723 20635 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:08.999375 20635 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:08.907140 20603 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.000510 20603 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:08.993692 20430 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:08.946492 20569 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.002580 20430 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:09.003309 20430 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:08.838001 20552 consensus_queue.cc:1059] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:19:09.006569 17419 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:09.032223 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.033666 17596 raft_consensus.cc:2410] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:08.895718 20621 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.894702 20445 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:09.057260 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.061695 17596 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:08.975908 17447 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:09.072511 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:08.908012 20307 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:08.914724 20316 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.075527 17451 raft_consensus.cc:2410] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:09.074764 17447 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:09.077831 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.073540 20307 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.066507 20621 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.079103 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.090801 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.091770 17447 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:09.093272 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:09.100041 17598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.016s	sys 0.042s
I20260709 13:19:09.079649 20445 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.104981 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:09.101748 17598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.017s	sys 0.042s
I20260709 13:19:09.106940 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.108660 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:09.112679 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.114133 17596 raft_consensus.cc:2410] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:09.076615 20316 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.080535 20594 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.132179 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.105258 20445 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:09.127400 18167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.000s	sys 0.043s
W20260709 13:19:09.129776 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.140040 18167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.043s
W20260709 13:19:09.142902 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 607807us
I20260709 13:19:09.147202 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.123191 20569 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:09.150766 20552 raft_consensus.cc:3055] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:09.192658 17597 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:09.151566 20603 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:09.151638 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 329) took 1468 ms. Trace:
W20260709 13:19:09.152583 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.154350 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 162912us
I20260709 13:19:09.200871 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:09.155167 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:09.171367 20594 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:09.171599 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:09.173190 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.146229 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.174132 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.174880 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.177330 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.178150 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:09.191864 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 403313us
I20260709 13:19:09.207216 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.214905 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.211761 20421 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.219172 20421 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.221880 20421 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:09.161846 20482 consensus_meta.cc:287] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.001s
I20260709 13:19:09.139420 20445 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.209764 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.089846 20591 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.227690 20591 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.132922 20593 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.231779 20593 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:09.226478 17597 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
W20260709 13:19:09.234810 20388 consensus_meta.cc:287] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 13:19:09.235337 20388 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.235668 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.236577 17597 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:19:09.237531 20388 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:09.193357 20179 consensus_meta.cc:287] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.000s
W20260709 13:19:09.239650 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.242976 17527 raft_consensus.cc:2410] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:09.243935 20582 consensus_queue.cc:1059] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:09.245651 20602 raft_consensus.cc:3055] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:09.245951 17568 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:09.248118 17568 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:09.248960 17568 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:09.248996 20599 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:09.249310 17524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1925) took 3553 ms (client timeout 1865 ms). Trace:
I20260709 13:19:09.250181 20028 consensus_queue.cc:1059] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:09.250906 20028 consensus_queue.cc:1243] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:09.251348 20028 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.251683 20028 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:09.252048 20028 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.254161 20558 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:09.254576 20558 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:09.254933 20558 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.255973 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:09.258195 20498 raft_consensus.cc:3055] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:09.258611 20498 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:09.259799 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.263628 20430 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:09.259371 20498 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.246232 20132 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.249878 17568 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:09.267019 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:09.270010 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:09.270606 17526 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.271138 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:09.271850 17529 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:09.271694 17528 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.237695 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.198254 17598 rpcz_store.cc:276] 0709 13:19:07.683174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.683423 (+   249us) service_pool.cc:224] Handling call
0709 13:19:07.714638 (+ 31215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.714857 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:08.527454 (+812597us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.151293 (+623839us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.151345 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:09.151393 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.151456 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.151580 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44898,"prepare.queue_time_us":32460,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":45753,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":1387409,"threads_started":2,"wal-append.queue_time_us":642690}
I20260709 13:19:09.279633 17528 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:09.281581 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:09.249809 17524 rpcz_store.cc:269] 0709 13:19:05.696283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.696415 (+   132us) service_pool.cc:224] Handling call
0709 13:19:09.249120 (+3552705us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400089654. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:09.249211 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1311152512}
I20260709 13:19:09.249660 20599 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:09.286641 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:09.286339 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:09.288122 17520 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.285995 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:09.288856 17447 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:09.290530 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 84774.1us
I20260709 13:19:09.192566 20552 raft_consensus.cc:740] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:09.266594 20132 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.197708 20563 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:09.215754 20349 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.240761 20482 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.268532 20602 raft_consensus.cc:740] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:09.310540 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 304065us
W20260709 13:19:09.294369 20549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.016s	sys 0.037s
I20260709 13:19:09.319824 17521 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:09.323068 17526 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:09.300107 20388 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:09.293391 20599 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.212532 20567 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.332515 17520 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:09.365312 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:09.366103 17524 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:09.367669 17601 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:09.311371 20564 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.314013 20563 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:09.325273 20549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.016s	sys 0.038s
I20260709 13:19:09.314875 20349 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:09.375412 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.377910 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.378448 17449 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:09.381285 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.384311 17449 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:09.386932 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.387948 17449 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:09.358234 20388 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:09.389050 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:09.370194 20589 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.375491 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.396847 17447 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:09.397423 20388 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.382889 20349 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.406546 20482 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:09.407619 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.408229 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.408450 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.408150 20536 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:09.409333 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.409845 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.410151 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.469511 17603 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:09.411222 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:09.412292 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:09.414625 20637 log.cc:927] Time spent T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:19:09.420552 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:09.425182 20430 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:09.426245 20535 consensus_meta.cc:287] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.789s	user 0.013s	sys 0.000s
I20260709 13:19:09.427554 20132 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:09.428073 20427 raft_consensus.cc:3055] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:09.427732 20316 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.429416 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52572 (request call id 330) took 1669 ms. Trace:
W20260709 13:19:09.430557 20644 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:09.494535 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.430701 17597 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:09.360132 20028 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:09.434293 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.496037 20621 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.497457 20028 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:09.437431 17524 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:19:09.441744 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.498883 20454 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:09.499266 17449 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:09.500138 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.500560 20454 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:09.459790 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.501191 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.501659 17451 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:09.441857 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.503479 17447 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
W20260709 13:19:09.503947 17527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1938) took 1383 ms (client timeout 1735 ms). Trace:
I20260709 13:19:09.410264 20651 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.504422 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:09.505133 17447 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.504746 20651 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.449605 20399 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.506312 20399 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.507462 20651 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:09.388360 20646 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:19:09.440913 20589 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.450006 20458 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.377591 20552 consensus_queue.cc:260] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.481917 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.466602 20579 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:09.417461 20445 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.443961 20559 consensus_queue.cc:1059] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:19:09.492697 17594 rpcz_store.cc:276] 0709 13:19:07.760175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.760351 (+   176us) service_pool.cc:224] Handling call
0709 13:19:09.429223 (+1668872us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54000776d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:09.429363 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26738560}
I20260709 13:19:09.477128 20558 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:09.497591 17525 raft_consensus.cc:2368] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10.
I20260709 13:19:09.533699 17454 raft_consensus.cc:2368] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8.
I20260709 13:19:09.501044 20454 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.502765 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:09.535233 17451 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.488955 20430 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:09.502830 17522 raft_consensus.cc:1240] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:09.398676 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 422152us
W20260709 13:19:09.472172 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 333144us
I20260709 13:19:09.466742 20582 consensus_queue.cc:1059] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:19:09.531752 17419 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:09.548684 17495 connection.cc:256] RPC call timeout handler was delayed by -1.0273363669998616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
I20260709 13:19:09.476964 18193 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
W20260709 13:19:09.504441 17527 rpcz_store.cc:269] 0709 13:19:08.120599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.124341 (+  3742us) service_pool.cc:224] Handling call
0709 13:19:09.503664 (+1379323us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002f7e54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:09.503845 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2569044224}
I20260709 13:19:09.532385 20651 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.536832 20552 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.537060 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.487967 20427 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:09.540199 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:09.550854 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:09.551753 17594 raft_consensus.cc:1217] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Deduplicated request from leader. Original: 4.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:19:09.578493 17594 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:09.552260 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.552909 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.522656 20589 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.403154 20602 consensus_queue.cc:260] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:09.563987 17447 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:09.579545 17595 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:09.585685 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.486320 20535 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.580427 17526 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:09.565291 17451 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:09.586205 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.537714 20399 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:09.546344 20307 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:09.595742 20558 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:09.596486 20307 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:09.597684 20535 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:09.598613 17523 raft_consensus.cc:2393] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:09.598834 17603 raft_consensus.cc:2393] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:09.602272 20654 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:09.602823 20621 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:09.603242 20654 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:09.603824 20654 raft_consensus.cc:697] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:09.579227 20636 consensus_meta.cc:287] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.717s	user 0.004s	sys 0.007s
I20260709 13:19:09.604672 20654 consensus_queue.cc:237] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:09.605214 20636 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:09.606323 17445 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:09.606590 20648 log.cc:927] Time spent T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:19:09.607676 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1355) took 1019 ms. Trace:
I20260709 13:19:09.608101 20602 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:09.608072 17600 rpcz_store.cc:276] 0709 13:19:08.588639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.720785 (+132146us) service_pool.cc:224] Handling call
0709 13:19:08.721098 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.724904 (+  3806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.724947 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.756248 (+ 31301us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.309339 (+553091us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:09.309381 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.309458 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.607437 (+297979us) raft_consensus.cc:1685] finished
0709 13:19:09.607461 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.607609 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4029,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":449516,"threads_started":1,"wal-append.queue_time_us":607257}
W20260709 13:19:09.610602 20652 log.cc:927] Time spent T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:09.607666 20636 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:09.610728 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.613201 17600 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:09.591959 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:09.612083 17452 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:09.587867 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:09.619364 17452 raft_consensus.cc:1240] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:09.590665 17595 raft_consensus.cc:2393] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:09.617677 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1590) took 2072 ms. Trace:
I20260709 13:19:09.620009 17602 rpcz_store.cc:276] 0709 13:19:07.545032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.545210 (+   178us) service_pool.cc:224] Handling call
0709 13:19:07.545669 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.668801 (+123132us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:07.697405 (+ 28604us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.266910 (+1569505us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b1800443da0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab570623a 00007f5ab5b70a2a
0709 13:19:09.457316 (+190406us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.461716 (+  4400us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.461880 (+   164us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:09.461928 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.462005 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.617385 (+155380us) raft_consensus.cc:1685] finished
0709 13:19:09.617469 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.617621 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181837,"prepare.queue_time_us":29561,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":228829,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":44236,"spinlock_wait_cycles":6635264,"thread_start_us":190175,"threads_started":1,"wal-append.queue_time_us":1847314}
I20260709 13:19:09.615525 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:09.623253 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:09.623971 17595 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:09.624713 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:09.624955 20563 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:09.627805 17453 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1825) took 2869 ms (client timeout 2765 ms). Trace:
I20260709 13:19:09.615306 20427 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:09.628178 17453 rpcz_store.cc:269] 0709 13:19:06.757983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.521593 (+763610us) service_pool.cc:224] Handling call
0709 13:19:09.615334 (+2093741us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b5800002798. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:19:09.627733 (+ 12399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12031360}
I20260709 13:19:09.631798 17450 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:19:09.632615 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.625648 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.554148 20430 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.530865 20458 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.635715 17450 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:09.582211 20567 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:09.636919 17595 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:09.637559 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.642210 17600 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:09.638247 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1351) took 1050 ms. Trace:
W20260709 13:19:09.646183 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 180579us
I20260709 13:19:09.636046 17453 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:19:09.593118 20616 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.645814 17599 rpcz_store.cc:276] 0709 13:19:08.587515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.587661 (+   146us) service_pool.cc:224] Handling call
0709 13:19:08.587974 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.591947 (+  3973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.591984 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.592485 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.900464 (+307979us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:08.912354 (+ 11890us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.912981 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.913075 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.638002 (+724927us) raft_consensus.cc:1685] finished
0709 13:19:09.638024 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.638187 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142553,"prepare.queue_time_us":11313,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":4476,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":88439,"thread_start_us":305520,"threads_started":1,"wal-append.queue_time_us":538659}
I20260709 13:19:09.651721 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.652328 17602 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:09.653492 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.654158 17595 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:09.656374 18166 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:09.576402 20651 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.658417 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:09.640139 20643 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.342s	user 0.003s	sys 0.000s
W20260709 13:19:09.660485 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.663168 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:09.646890 20427 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.640184 20399 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:09.642356 20595 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:09.668399 17596 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:09.691800 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:09.694486 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.681031 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:09.650775 20454 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:09.716725 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:09.720886 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.727283 17602 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:09.727461 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:09.744367 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.748780 17568 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:09.756852 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.791967 17568 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:09.666332 20630 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:09.793180 17568 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:09.815795 20635 consensus_meta.cc:287] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.816s	user 0.014s	sys 0.000s
I20260709 13:19:09.657591 20616 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.814610 20591 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:09.727023 20399 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:09.844664 20657 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:09.731487 20595 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:09.855515 20659 log.cc:927] Time spent T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:19:09.843190 20662 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:19:09.857281 20563 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:09.858788 20591 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:09.850304 20635 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:09.861941 20657 raft_consensus.cc:697] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:09.940394 20591 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.943913 20635 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:09.948326 20589 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:09.951436 20595 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:09.952741 20651 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:09.954058 20589 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:09.979386 20657 consensus_queue.cc:237] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:10.065846 17419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.011s	sys 0.010s
W20260709 13:19:10.066910 17419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.012s	sys 0.010s
W20260709 13:19:10.067433 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 512495us
I20260709 13:19:10.068356 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1508) took 1058 ms. Trace:
W20260709 13:19:10.070576 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 510773us
I20260709 13:19:10.069249 17445 rpcz_store.cc:276] 0709 13:19:09.009384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.627929 (+618545us) service_pool.cc:224] Handling call
0709 13:19:09.628275 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.628546 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:09.634014 (+  5468us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.066815 (+432801us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.066993 (+   178us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:10.067210 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.067458 (+   248us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.067938 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9465,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":431638,"threads_started":1,"wal-append.queue_time_us":229696}
W20260709 13:19:10.066321 17418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.004s	sys 0.011s
W20260709 13:19:10.074692 17418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.004s	sys 0.012s
I20260709 13:19:10.075686 17445 raft_consensus.cc:1240] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:10.076977 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:09.707181 17449 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:10.093550 17451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.017s	sys 0.009s
W20260709 13:19:10.094633 17451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.017s	sys 0.010s
W20260709 13:19:10.165437 17452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.002s	sys 0.011s
W20260709 13:19:10.182317 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 389049us
I20260709 13:19:10.183635 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1510) took 1173 ms. Trace:
I20260709 13:19:10.194435 20672 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:10.196038 20671 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:10.197575 20589 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:10.198784 20589 raft_consensus.cc:697] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:10.242206 17595 raft_consensus.cc:2393] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:10.250944 20654 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:10.252100 20654 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.255177 20430 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:10.280606 17450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.004s	sys 0.016s
W20260709 13:19:10.281418 17450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.004s	sys 0.016s
I20260709 13:19:10.285005 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1528) took 1190 ms. Trace:
W20260709 13:19:10.286931 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.306861 20132 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:10.308109 20132 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:10.308488 17450 rpcz_store.cc:276] 0709 13:19:09.094531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.641697 (+547166us) service_pool.cc:224] Handling call
0709 13:19:09.642930 (+  1233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.643140 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:09.704898 (+ 61758us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.283380 (+578482us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.284052 (+   672us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.284162 (+   110us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:10.284317 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.284491 (+   174us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.284898 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":600395,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":77,"raft.queue_time_us":360,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":272,"thread_start_us":576771,"threads_started":1,"wal-append.queue_time_us":486984}
I20260709 13:19:09.856125 20316 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:10.298601 17594 raft_consensus.cc:2410] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:10.299207 17600 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:10.197436 20671 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:10.304705 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.304667 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 551250us
W20260709 13:19:10.290295 18164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.001s	sys 0.029s
I20260709 13:19:10.185791 20616 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:10.186201 17568 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:10.304193 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.200518 20589 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:10.337565 20599 consensus_meta.cc:287] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.963s	user 0.013s	sys 0.000s
I20260709 13:19:10.338161 20670 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.338675 20599 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.339104 20670 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.340531 17598 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:10.342049 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:10.343230 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1475) took 4633 ms. Trace:
W20260709 13:19:10.354713 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.355417 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.355633 17527 raft_consensus.cc:1240] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:10.232142 20399 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:10.185092 17452 rpcz_store.cc:276] 0709 13:19:09.009973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.629107 (+619134us) service_pool.cc:224] Handling call
0709 13:19:09.629310 (+   203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.629526 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.629578 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.633611 (+  4033us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.166349 (+532738us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:10.166448 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.166589 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.178342 (+ 11753us) raft_consensus.cc:1685] finished
0709 13:19:10.178383 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.183539 (+  5156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":228087,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2895,"thread_start_us":503262,"threads_started":1,"wal-append.queue_time_us":516139}
W20260709 13:19:10.379848 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 193995us
I20260709 13:19:10.380954 20612 raft_consensus.cc:3055] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:10.381513 20612 raft_consensus.cc:740] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:10.381774 20657 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:10.343930 17446 rpcz_store.cc:276] 0709 13:19:05.710086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.710260 (+   174us) service_pool.cc:224] Handling call
0709 13:19:08.521861 (+2811601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.686541 (+164680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.686587 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.724217 (+ 37630us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.197616 (+473399us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:09.197655 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.197725 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.422402 (+224677us) raft_consensus.cc:1685] finished
0709 13:19:09.422424 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.342534 (+920110us) spinlock_profiling.cc:243] Waited 2.81 s on lock 0x7b54000d7ad0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:10.343011 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104797,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":60,"spinlock_wait_cycles":6465014144,"thread_start_us":607955,"threads_started":2,"wal-append.queue_time_us":572572}
I20260709 13:19:10.383329 20612 consensus_queue.cc:260] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:10.482014 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 1578) took 1729 ms. Trace:
I20260709 13:19:10.482652 17523 rpcz_store.cc:276] 0709 13:19:08.752487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.762748 (+ 10261us) service_pool.cc:224] Handling call
0709 13:19:10.481388 (+1718640us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b5400170a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:10.481741 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919274880}
I20260709 13:19:10.493777 20448 raft_consensus.cc:3055] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:10.494432 20448 raft_consensus.cc:740] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:10.494714 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 260) took 1070 ms. Trace:
I20260709 13:19:10.495208 17446 rpcz_store.cc:276] 0709 13:19:09.424609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.460012 (+1035403us) service_pool.cc:224] Handling call
0709 13:19:10.493851 (+ 33839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.494256 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.494290 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.494352 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:10.494403 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.494479 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.494615 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.496083 20448 consensus_queue.cc:260] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:10.503407 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.504380 20681 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.312s	user 0.004s	sys 0.000s
W20260709 13:19:10.505730 20602 consensus_meta.cc:287] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.897s	user 0.015s	sys 0.000s
I20260709 13:19:10.497639 20448 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.497710 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 261) took 1072 ms. Trace:
I20260709 13:19:10.513670 17446 rpcz_store.cc:276] 0709 13:19:09.424866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.496503 (+1071637us) service_pool.cc:224] Handling call
0709 13:19:10.496883 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.497271 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.497307 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.497396 (+    89us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:10.497433 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.497503 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.497635 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.484318 20399 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.505851 20670 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:10.540563 20427 consensus_meta.cc:287] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.835s	user 0.017s	sys 0.001s
W20260709 13:19:10.544814 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.545125 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:10.551172 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:10.546991 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 259) took 1122 ms. Trace:
I20260709 13:19:10.553442 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:10.555264 20482 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:10.556737 20476 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:10.553191 17452 rpcz_store.cc:276] 0709 13:19:09.424303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.445442 (+1021139us) service_pool.cc:224] Handling call
0709 13:19:10.517234 (+ 71792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.546405 (+ 29171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.546448 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.546537 (+    89us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:10.546595 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.546685 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.546877 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.558354 20132 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:10.532841 20655 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:10.606709 20482 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.606950 20476 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:10.607929 17454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1514) took 1596 ms (client timeout 1799 ms). Trace:
I20260709 13:19:10.607705 20655 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:10.608347 17454 rpcz_store.cc:269] 0709 13:19:09.011256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.255684 (+244428us) service_pool.cc:224] Handling call
0709 13:19:10.607431 (+1351747us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400351e54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:10.607728 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636915968}
W20260709 13:19:10.597942 17596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1371) took 1844 ms (client timeout 2029 ms). Trace:
I20260709 13:19:10.609330 20482 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:10.562626 20399 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:10.565421 20671 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:10.566989 20599 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:10.569381 20654 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:10.572224 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 1957) took 1302 ms. Trace:
I20260709 13:19:10.564775 20445 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:10.574182 20349 consensus_meta.cc:287] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.107s	user 0.012s	sys 0.009s
W20260709 13:19:10.609586 17596 rpcz_store.cc:269] 0709 13:19:08.753088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.131693 (+378605us) service_pool.cc:224] Handling call
0709 13:19:10.597498 (+1465805us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54003aded4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:10.597721 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230328576}
I20260709 13:19:10.577229 20458 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:10.583041 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1605) took 1008 ms. Trace:
I20260709 13:19:10.585242 20579 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:10.588183 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1848) took 1385 ms. Trace:
I20260709 13:19:10.596752 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1366) took 1845 ms. Trace:
I20260709 13:19:10.609330 20476 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:10.626214 20349 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:10.619104 17525 rpcz_store.cc:276] 0709 13:19:09.269372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.270184 (+   812us) service_pool.cc:224] Handling call
0709 13:19:10.571655 (+1301471us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400089654. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:10.571995 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494666624}
I20260709 13:19:10.630647 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:10.630995 20655 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:10.614990 20399 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:10.633206 17596 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:10.621209 17595 rpcz_store.cc:276] 0709 13:19:09.575602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.664025 (+ 88423us) service_pool.cc:224] Handling call
0709 13:19:10.582659 (+918634us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54003eba54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:10.582942 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1014832384}
I20260709 13:19:10.621851 17598 rpcz_store.cc:276] 0709 13:19:08.751564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.301539 (+549975us) service_pool.cc:224] Handling call
0709 13:19:09.316774 (+ 15235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.341087 (+1024313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.596315 (+255228us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400329454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:10.596630 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2353301888}
I20260709 13:19:10.636797 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 258) took 1412 ms. Trace:
I20260709 13:19:10.639883 17450 rpcz_store.cc:276] 0709 13:19:09.224688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.428968 (+1204280us) service_pool.cc:224] Handling call
0709 13:19:10.523117 (+ 94149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.627898 (+104781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.627942 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.636400 (+  8458us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:10.636482 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.636572 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.636725 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.621731 17445 rpcz_store.cc:276] 0709 13:19:09.202986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.077159 (+874173us) service_pool.cc:224] Handling call
0709 13:19:10.077814 (+   655us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:10.311802 (+233988us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:10.342745 (+ 30943us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.463718 (+120973us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:10.524085 (+ 60367us) log.cc:844] Serialized 52 byte log entry
0709 13:19:10.524297 (+   212us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:10.524579 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.524803 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.524919 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.587815 (+ 62896us) raft_consensus.cc:1685] finished
0709 13:19:10.587842 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.588088 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22460,"prepare.queue_time_us":13659,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":2139,"raft.run_cpu_time_us":517,"raft.run_wall_time_us":20927,"spinlock_wait_cycles":5522944,"thread_start_us":108533,"threads_started":1,"wal-append.queue_time_us":229898}
I20260709 13:19:10.649029 17598 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:10.653439 20349 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:10.655330 20558 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:10.656322 20558 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.660535 20558 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:10.635989 20579 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:10.642270 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1600) took 1087 ms. Trace:
I20260709 13:19:10.679181 17596 rpcz_store.cc:276] 0709 13:19:09.552453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.632257 (+1079804us) service_pool.cc:224] Handling call
0709 13:19:10.632738 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.638918 (+  6180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.639357 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.645213 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1618) took 1042 ms. Trace:
I20260709 13:19:10.680960 17603 rpcz_store.cc:276] 0709 13:19:09.597935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.552609 (+954674us) service_pool.cc:224] Handling call
0709 13:19:10.640133 (+ 87524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.683856 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1607) took 1055 ms. Trace:
I20260709 13:19:10.688361 17598 rpcz_store.cc:276] 0709 13:19:09.594863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.647972 (+1053109us) service_pool.cc:224] Handling call
0709 13:19:10.648527 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.649678 (+  1151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.649934 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.689603 17449 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:10.689878 17446 raft_consensus.cc:1240] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:10.692689 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 262) took 1203 ms. Trace:
I20260709 13:19:10.693120 17446 rpcz_store.cc:276] 0709 13:19:09.489023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.523788 (+1034765us) service_pool.cc:224] Handling call
0709 13:19:10.628675 (+104887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.692365 (+ 63690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.692615 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:10.706177 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.713210 20635 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.714015 20635 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.714486 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1606) took 1131 ms. Trace:
I20260709 13:19:10.714886 17595 rpcz_store.cc:276] 0709 13:19:09.583610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.642259 (+1058649us) service_pool.cc:224] Handling call
0709 13:19:10.713835 (+ 71576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.714092 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.714118 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.714184 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:10.714229 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.714288 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.714406 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:10.728645 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 207929us
I20260709 13:19:10.721613 20458 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:10.736999 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:10.738222 17596 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:10.741729 20669 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.742841 20669 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:10.747164 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:10.751191 20551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.242s	user 0.007s	sys 0.031s
W20260709 13:19:10.751657 20551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.277s	user 0.008s	sys 0.031s
I20260709 13:19:10.752619 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1849) took 1454 ms. Trace:
I20260709 13:19:10.753276 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1601) took 1200 ms. Trace:
W20260709 13:19:10.756048 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 211303us
I20260709 13:19:10.753147 17449 rpcz_store.cc:276] 0709 13:19:09.298690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.509469 (+210779us) service_pool.cc:224] Handling call
0709 13:19:10.752401 (+1242932us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54000dc5d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:10.752552 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297718144}
I20260709 13:19:10.750550 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1609) took 1151 ms. Trace:
I20260709 13:19:10.759666 17596 rpcz_store.cc:276] 0709 13:19:09.595486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.692134 (+1096648us) service_pool.cc:224] Handling call
0709 13:19:10.729991 (+ 37857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.746421 (+ 16430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.746586 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.753849 17594 rpcz_store.cc:276] 0709 13:19:09.552712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.587494 (+ 34782us) service_pool.cc:224] Handling call
0709 13:19:10.753006 (+1165512us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54003ea654. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:10.753204 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265203456}
I20260709 13:19:10.762259 17446 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:10.762405 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 363) took 1342 ms. Trace:
I20260709 13:19:10.763470 20551 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.764108 20551 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.764556 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:10.765035 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:10.765393 20458 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.766286 20655 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:10.767951 20458 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:10.768823 20551 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:10.763046 17522 rpcz_store.cc:276] 0709 13:19:09.419848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.421096 (+  1248us) service_pool.cc:224] Handling call
0709 13:19:09.502627 (+ 81531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.538946 (+ 36319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.761957 (+1223011us) spinlock_profiling.cc:243] Waited 81.2 ms on lock 0x7b5400090450. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:10.762188 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186662656}
I20260709 13:19:10.766700 17446 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:10.773161 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.774303 17450 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:10.769805 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1362) took 2179 ms. Trace:
I20260709 13:19:10.776469 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:10.812942 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1378) took 1891 ms. Trace:
I20260709 13:19:10.834725 17601 rpcz_store.cc:276] 0709 13:19:08.885324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.259528 (+374204us) service_pool.cc:224] Handling call
0709 13:19:10.776172 (+1516644us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54000753d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:10.776444 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245986176}
I20260709 13:19:10.835346 17599 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:10.836095 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:10.748826 20669 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:10.823060 17597 rpcz_store.cc:276] 0709 13:19:08.590323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.277109 (+686786us) service_pool.cc:224] Handling call
0709 13:19:09.430380 (+153271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.495460 (+ 65080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.769454 (+1273994us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54000776d0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:10.769632 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351838080}
W20260709 13:19:10.843452 20388 consensus_meta.cc:287] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.378s	user 0.012s	sys 0.009s
I20260709 13:19:10.847523 20388 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:10.849740 17602 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:10.850148 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:10.850804 17453 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:10.852418 20388 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:10.843720 20686 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:19:10.843943 20690 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.846252 20635 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:10.846390 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:10.857569 17446 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
W20260709 13:19:10.858469 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 98698.7us
I20260709 13:19:10.859305 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:10.862239 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:10.862805 20462 raft_consensus.cc:3055] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:10.863001 17454 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:10.863380 20462 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:10.863555 20593 raft_consensus.cc:3055] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:10.866870 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:10.867877 20690 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.868772 20462 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.869721 17601 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:10.866549 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:10.870445 20690 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:10.871436 20462 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:10.865830 20593 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:10.870483 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:10.872524 17599 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:10.872965 17596 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:10.871768 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:10.873248 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1621) took 1216 ms. Trace:
I20260709 13:19:10.874868 17599 rpcz_store.cc:276] 0709 13:19:09.657229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.871726 (+1214497us) service_pool.cc:224] Handling call
0709 13:19:10.872094 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.872997 (+   903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.873194 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.879805 17449 raft_consensus.cc:2368] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9.
W20260709 13:19:10.883994 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.873106 20593 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.885694 20448 consensus_queue.cc:1059] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:10.888648 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:10.884996 17453 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:10.880348 20690 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.896653 17596 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:10.890004 20593 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.898972 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 333) took 1237 ms. Trace:
I20260709 13:19:10.897894 20589 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:10.900511 20589 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:10.876473 20579 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.904307 20579 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:10.899423 17596 rpcz_store.cc:276] 0709 13:19:09.660142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.873981 (+1213839us) service_pool.cc:224] Handling call
0709 13:19:10.878173 (+  4192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.897010 (+ 18837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.897140 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.904973 20612 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.905975 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:10.898710 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 334) took 1237 ms. Trace:
I20260709 13:19:10.907481 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:10.906607 17599 rpcz_store.cc:276] 0709 13:19:09.660382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.876850 (+1216468us) service_pool.cc:224] Handling call
0709 13:19:10.879384 (+  2534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.894803 (+ 15419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.894840 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.897734 (+  2894us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:10.897785 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.897976 (+   191us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.898099 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.910848 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:10.911607 17450 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:10.913367 17495 connection.cc:256] RPC call timeout handler was delayed by -1.6921372299998438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260709 13:19:10.916060 20227 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:10.917163 20689 log.cc:927] Time spent T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:10.922183 20690 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.926172 17450 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:10.930197 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:10.932780 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1843) took 1973 ms. Trace:
I20260709 13:19:10.938438 17447 rpcz_store.cc:276] 0709 13:19:08.959391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.587705 (+628314us) service_pool.cc:224] Handling call
0709 13:19:09.588312 (+   607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.656257 (+ 67945us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:10.357671 (+701414us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.732572 (+374901us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.734310 (+  1738us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:10.740225 (+  5915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.932377 (+192152us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b5400185bd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:10.932428 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.932586 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48469,"prepare.queue_time_us":569108,"prepare.run_cpu_time_us":169,"prepare.run_wall_time_us":1768,"raft.queue_time_us":1564,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":7093,"spinlock_wait_cycles":155816704,"thread_start_us":483248,"threads_started":2,"wal-append.queue_time_us":293809}
W20260709 13:19:10.936578 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.916945 20227 consensus_queue.cc:1059] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:10.940707 17599 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:10.942880 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.943653 17597 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:10.944415 17454 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:10.946969 17448 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:10.951932 20559 raft_consensus.cc:3055] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:10.952399 20559 raft_consensus.cc:740] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:10.955873 17599 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:10.957511 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:10.953598 20559 consensus_queue.cc:260] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:10.959085 17596 raft_consensus.cc:2393] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:10.960611 17597 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:10.960017 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:10.960672 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:10.963821 17447 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:10.980737 17601 raft_consensus.cc:2410] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:10.975423 20559 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.981240 20690 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:10.980852 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:10.986280 17599 raft_consensus.cc:2410] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:10.986258 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:10.987090 20684 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.987774 20684 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:10.990581 17594 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:10.990753 20227 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:10.991245 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 338) took 1296 ms. Trace:
I20260709 13:19:10.991839 17601 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:10.991632 17594 rpcz_store.cc:276] 0709 13:19:09.695192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.989994 (+1294802us) service_pool.cc:224] Handling call
0709 13:19:10.990380 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.991002 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.991190 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.992573 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 337) took 1329 ms. Trace:
I20260709 13:19:10.992906 17601 rpcz_store.cc:276] 0709 13:19:09.662724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.981390 (+1318666us) service_pool.cc:224] Handling call
0709 13:19:10.982548 (+  1158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.992328 (+  9780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.992490 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.993458 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 339) took 1263 ms. Trace:
I20260709 13:19:10.991637 20684 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:10.976598 20589 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:10.994731 20448 raft_consensus.cc:3055] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:10.995034 17601 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:10.995152 20448 raft_consensus.cc:740] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:10.995705 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 340) took 1247 ms. Trace:
I20260709 13:19:10.996044 17601 rpcz_store.cc:276] 0709 13:19:09.748031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.994450 (+1246419us) service_pool.cc:224] Handling call
0709 13:19:10.994827 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.995460 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.995655 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.996143 20448 consensus_queue.cc:260] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:10.997362 17601 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:10.998580 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1604) took 1445 ms. Trace:
I20260709 13:19:10.998966 17600 rpcz_store.cc:276] 0709 13:19:09.553528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.651495 (+ 97967us) service_pool.cc:224] Handling call
0709 13:19:10.998385 (+1346890us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400062054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:10.998524 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013179136}
I20260709 13:19:11.000000 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 335) took 1339 ms. Trace:
I20260709 13:19:11.000327 17600 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:11.000694 17597 rpcz_store.cc:276] 0709 13:19:09.660635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.984179 (+1323544us) service_pool.cc:224] Handling call
0709 13:19:10.999178 (+ 14999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.999517 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.999552 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.999664 (+   112us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:10.999704 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.999787 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.999928 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.002489 17352 catalog_manager.cc:5697] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.008323 20498 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.011475 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1624) took 1312 ms. Trace:
I20260709 13:19:11.011884 17602 rpcz_store.cc:276] 0709 13:19:09.699523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.830150 (+130627us) service_pool.cc:224] Handling call
0709 13:19:11.011280 (+1181130us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54003e9254. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:11.011422 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164710656}
I20260709 13:19:10.993806 17594 rpcz_store.cc:276] 0709 13:19:09.729701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.992546 (+1262845us) service_pool.cc:224] Handling call
0709 13:19:10.992911 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.993158 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.993183 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.993223 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:10.993257 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.993306 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.993392 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.014963 17450 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 5.
I20260709 13:19:10.997802 20448 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.015997 17596 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:11.016222 17597 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:19:11.018712 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.020531 20683 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.374s	user 0.006s	sys 0.018s
I20260709 13:19:11.022418 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1844) took 2062 ms. Trace:
I20260709 13:19:11.022847 17451 rpcz_store.cc:276] 0709 13:19:08.960013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.589304 (+629291us) service_pool.cc:224] Handling call
0709 13:19:09.589613 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:10.095759 (+506146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.095826 (+    67us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:10.097309 (+  1483us) log.cc:844] Serialized 52 byte log entry
0709 13:19:10.394468 (+297159us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:10.394519 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.449415 (+ 54896us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.019678 (+570263us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:11.022001 (+  2323us) raft_consensus.cc:1685] finished
0709 13:19:11.022052 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.022341 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":222762,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":11447,"spinlock_wait_cycles":62680320,"thread_start_us":801972,"threads_started":2,"wal-append.queue_time_us":548650}
W20260709 13:19:11.030329 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 83029.5us
I20260709 13:19:11.036741 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:11.037364 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.038430 20688 consensus_queue.cc:1059] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:11.040324 20688 raft_consensus.cc:3055] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:11.040865 20688 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:19:11.037875 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.043655 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.044181 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.047362 17595 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:11.048528 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 336) took 1387 ms. Trace:
I20260709 13:19:11.048290 20688 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:11.048966 17596 rpcz_store.cc:276] 0709 13:19:09.660889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.980506 (+1319617us) service_pool.cc:224] Handling call
0709 13:19:11.014550 (+ 34044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.017455 (+  2905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.048307 (+ 30852us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b54003e9250. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:11.048463 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77384576}
I20260709 13:19:11.025007 20674 consensus_queue.cc:1059] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:19:11.050398 20688 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.051295 20674 raft_consensus.cc:3055] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:11.051728 20674 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:11.051864 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:11.052040 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:11.052654 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.054190 20602 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.054838 17568 leader_election.cc:400] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10.
I20260709 13:19:11.055202 17568 leader_election.cc:403] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:11.054778 20602 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.055867 20498 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10.
I20260709 13:19:11.058344 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.059235 20227 consensus_queue.cc:1059] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:11.059837 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.061349 20227 raft_consensus.cc:3055] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:11.061497 20675 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:11.062686 20630 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:11.061784 20227 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:11.063053 20630 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:11.064059 20227 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:11.066299 20227 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.067553 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:11.068205 17445 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.064018 20630 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:11.070403 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:11.071130 17451 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:11.071359 20630 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.072374 17454 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:11.082587 20591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.034s	sys 0.007s
I20260709 13:19:11.082804 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.083467 17523 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:11.061390 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.084688 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1614) took 1487 ms. Trace:
I20260709 13:19:11.022953 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:11.083033 20591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.034s	sys 0.007s
I20260709 13:19:11.099303 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:11.085304 17595 rpcz_store.cc:276] 0709 13:19:09.596774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.721286 (+1124512us) service_pool.cc:224] Handling call
0709 13:19:10.739253 (+ 17967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.047907 (+308654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.084283 (+ 36376us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54000762d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:11.084551 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707492608}
I20260709 13:19:11.100054 17525 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.100678 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:11.101867 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.102582 17526 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:11.102629 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:11.103327 17521 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.105036 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.105968 17527 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:11.106412 17529 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:11.108438 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.108940 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.109248 17522 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:11.102633 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.110461 17528 raft_consensus.cc:2410] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:11.116407 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.089803 17352 catalog_manager.cc:5697] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:19:11.117116 17527 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:11.118352 17352 catalog_manager.cc:5697] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.122475 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:11.121562 17352 catalog_manager.cc:5697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.131910 17521 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
W20260709 13:19:11.125980 17349 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40488 (request call id 190) took 31003 ms (client timeout 15000 ms). Trace:
I20260709 13:19:11.110415 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.142315 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:11.143304 17523 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:11.148511 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 234498us
I20260709 13:19:11.138060 17352 catalog_manager.cc:5697] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.151640 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.154592 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:11.138082 20584 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:11.161142 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.161006 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:11.147987 18193 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:19:11.169106 17525 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:11.169329 17352 catalog_manager.cc:5697] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:11.173985 17495 connection.cc:256] RPC call timeout handler was delayed by -1.4725372299999435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
I20260709 13:19:11.172500 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:11.179001 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.179697 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:11.180078 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.180661 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.185046 17454 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:11.185873 17495 connection.cc:256] RPC call timeout handler was delayed by -1.3663372299999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 13:19:11.186290 17495 connection.cc:256] RPC call timeout handler was delayed by -1.3663372299999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 13:19:11.198124 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.198515 17451 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:11.198825 17420 leader_election.cc:336] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.654s (SENT)
I20260709 13:19:11.199322 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:11.199648 20602 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:11.200788 17454 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:11.202230 20462 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:11.210592 18199 raft_consensus.cc:1813] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Handling vote request from an unknown peer 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:11.212266 17523 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:11.215745 18199 raft_consensus.cc:2410] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:11.221303 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.223412 17529 raft_consensus.cc:1240] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:11.219650 20612 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.187587 20584 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:11.213810 20636 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.136047 17349 rpcz_store.cc:269] 0709 13:18:40.122844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.145704 (+ 22860us) service_pool.cc:224] Handling call
0709 13:19:11.125645 (+30979941us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:03.298519 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:03.420645 (+122126us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:03.429035 (+  8390us) write_op.cc:435] Acquired schema lock
0709 13:19:03.430223 (+  1188us) tablet.cc:662] Decoding operations
0709 13:19:03.614634 (+184411us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:03.614754 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:03.614790 (+    36us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:19:03.732939 (+118149us) tablet.cc:701] Row locks acquired
0709 13:19:03.732988 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:19:03.735343 (+  2355us) write_op.cc:270] Start()
0709 13:19:03.763138 (+ 27795us) write_op.cc:276] Timestamp: P: 1783603143735272 usec, L: 0
0709 13:19:03.763177 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:19:03.857960 (+ 94783us) log.cc:844] Serialized 4422 byte log entry
0709 13:19:04.768547 (+910587us) op_driver.cc:464] REPLICATION: finished
0709 13:19:05.215009 (+446462us) write_op.cc:301] APPLY: starting
0709 13:19:05.215109 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:05.215369 (+   260us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:05.215645 (+   276us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:05.217098 (+  1453us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:05.217441 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:19:05.217489 (+    48us) write_op.cc:312] APPLY: finished
0709 13:19:05.217835 (+   346us) log.cc:844] Serialized 83 byte log entry
0709 13:19:05.218748 (+   913us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:05.218889 (+   141us) write_op.cc:454] Released schema lock
0709 13:19:05.218954 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:05.236085 (+ 17131us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:05.237417 (+  1332us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29609,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":432018,"apply.run_cpu_time_us":3726,"apply.run_wall_time_us":12096,"num_ops":11,"prepare.queue_time_us":636682,"prepare.run_cpu_time_us":44162,"prepare.run_wall_time_us":853960,"raft.queue_time_us":186598,"raft.run_cpu_time_us":63737,"raft.run_wall_time_us":472331,"replication_time_us":963694,"thread_start_us":1005986,"threads_started":4,"wal-append.queue_time_us":331163,"wal-append.run_cpu_time_us":32905,"wal-append.run_wall_time_us":1996220}]]}
I20260709 13:19:11.214201 20674 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:11.226490 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.227407 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:11.223767 17523 raft_consensus.cc:2410] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:11.238462 17522 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.221709 17451 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:11.234810 17525 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:11.235352 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.226884 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:11.227849 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.234318 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:11.228194 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.245918 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.232326 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.247323 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.248217 17527 raft_consensus.cc:2393] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:11.230187 20562 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.248911 20562 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.227025 18196 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:11.230741 20636 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.226418 20612 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.256121 20612 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:11.257373 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.234570 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:11.258417 17419 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.66:40943 timed out after 2.681s (SENT) [suppressed 37 similar messages]
I20260709 13:19:11.259382 17527 raft_consensus.cc:2393] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:11.234622 20674 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.259632 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:11.260897 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.230046 20584 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:11.253633 20636 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:11.262697 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.265113 17445 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:11.265475 17526 raft_consensus.cc:2410] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:11.237504 17352 catalog_manager.cc:5697] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 1 to 5, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 5 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.275269 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.275938 17527 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:11.276714 17523 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:11.277698 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:11.278379 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 89962.4us
I20260709 13:19:11.285190 17526 raft_consensus.cc:2393] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:11.284657 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.286612 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.286734 17527 raft_consensus.cc:2393] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:11.287012 17523 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:19:11.287530 17523 pending_rounds.cc:85] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 5
I20260709 13:19:11.289433 18194 raft_consensus.cc:2410] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:19:11.291920 17420 leader_election.cc:336] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.745s (SENT)
W20260709 13:19:11.292733 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.292567 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.284642 17352 catalog_manager.cc:5697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:11.297212 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.298979 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:11.299764 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:11.271613 20688 consensus_queue.cc:1059] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:19:11.301786 17352 catalog_manager.cc:5697] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 5 to 8, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 8 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.303064 17529 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:11.302547 17522 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:11.289340 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.303428 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:11.307822 18192 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:11.304177 18199 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:11.303958 20488 raft_consensus.cc:3055] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:11.287770 17523 pending_rounds.cc:107] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.6
I20260709 13:19:11.306793 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.313611 17523 raft_consensus.cc:2917] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Aborting config change with OpId 6.6: Aborted: Op aborted by new leader
I20260709 13:19:11.314143 17523 raft_consensus.cc:2889] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:11.316145 17521 raft_consensus.cc:3055] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:11.306592 20697 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:19:11.316514 17521 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:11.309214 20488 raft_consensus.cc:740] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:11.319201 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.322433 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.322501 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:11.323494 17595 raft_consensus.cc:2393] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:11.324220 17526 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:11.327131 17527 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:19:11.327549 17527 pending_rounds.cc:85] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 4
I20260709 13:19:11.327806 17527 pending_rounds.cc:107] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:19:11.328050 17527 raft_consensus.cc:2889] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:11.331105 17352 catalog_manager.cc:5697] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.330623 20488 consensus_queue.cc:260] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:11.334661 18198 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:19:11.334728 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.335008 20488 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.335491 17595 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:11.336905 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:11.337858 17420 leader_election.cc:336] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.796s (SENT)
I20260709 13:19:11.338346 18192 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEARNER]: Advancing to term 7
I20260709 13:19:11.338392 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:11.338717 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.339354 20636 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:11.341329 18194 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:11.346194 18192 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:11.346455 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.347136 17597 raft_consensus.cc:2393] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:11.348268 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.348832 17597 raft_consensus.cc:2376] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8. Re-sending same reply.
I20260709 13:19:11.348961 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:11.349668 17595 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:11.350404 17521 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.351438 17521 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.352574 20612 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:11.352967 20612 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.353276 20612 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:11.356788 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.358323 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.359215 17525 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:11.360737 17521 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:19:11.360769 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:11.361568 17521 pending_rounds.cc:85] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 5
I20260709 13:19:11.361647 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.361979 17521 pending_rounds.cc:107] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:19:11.362437 17521 raft_consensus.cc:2889] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:11.362303 17352 catalog_manager.cc:5697] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 3 to 5, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 5 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.364745 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.366737 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1622) took 1702 ms. Trace:
I20260709 13:19:11.368093 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.368875 17528 raft_consensus.cc:2393] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:11.373539 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.379631 17352 catalog_manager.cc:5697] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 5 to 7, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 7 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:19:11.380553 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.375942 20562 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:11.381124 17420 leader_election.cc:336] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.832s (SENT)
I20260709 13:19:11.381328 17495 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.384805 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:11.383757 17419 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:11.384248 17568 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.387156 17420 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:11.367079 17598 rpcz_store.cc:276] 0709 13:19:09.664313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.983950 (+1319637us) service_pool.cc:224] Handling call
0709 13:19:10.987215 (+  3265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.987540 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:11.016704 (+ 29164us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.156972 (+140268us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.366307 (+209335us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b18003588a0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab29f3c0a 00007f5abc133219 00007f5ab2a7ba40 00007f5ab2a764e4 00007f5ab2a76455 00007f5ab5b5e060 00007f5ab5b70716 00007f5ab5b81287 00007f5ab5b81208
0709 13:19:11.366460 (+   153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.366521 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:11.366563 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.366616 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.366695 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3379,"prepare.queue_time_us":30936,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":67,"raft.queue_time_us":6874,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":7943,"spinlock_wait_cycles":8265088,"thread_start_us":137164,"threads_started":2,"wal-append.queue_time_us":182418}
I20260709 13:19:11.389990 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:11.393985 17595 raft_consensus.cc:2410] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:11.395546 17603 raft_consensus.cc:2410] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:11.394964 20636 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:11.402074 18200 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:11.397886 20462 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:19:11.401934 20599 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:11.404771 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.405319 17597 raft_consensus.cc:1813] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Handling vote request from an unknown peer 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:11.405733 17597 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:11.406562 17419 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.395972 20562 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:11.411041 20636 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:11.415066 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.401718 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.411612 20584 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:11.422536 17419 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.424343 20593 consensus_queue.cc:1059] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:11.424613 20602 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:11.424571 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.414808 20562 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.426927 17419 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.430188 17597 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:11.433054 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:11.433672 17603 raft_consensus.cc:2410] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:19:11.434640 17568 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.435039 17419 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.423796 20584 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:11.428874 20636 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:11.429579 20562 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.440342 20596 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:11.439011 20593 consensus_queue.cc:1059] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:19:11.451190 20596 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.451694 20596 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.452088 20593 raft_consensus.cc:3055] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:11.452512 20593 raft_consensus.cc:740] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:11.453011 20612 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.442678 20584 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.455140 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:11.440660 20498 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.456713 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.456566 20498 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.457460 17595 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:11.436033 20462 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:11.458010 20599 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.458488 20599 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.459375 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.460044 17595 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:11.460130 20498 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:11.425016 18197 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:11.443594 20556 consensus_queue.cc:1059] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:11.460821 20591 raft_consensus.cc:3055] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:11.461280 20591 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:11.461846 20556 raft_consensus.cc:3055] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:11.462517 20556 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:11.463850 20612 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:11.463801 20556 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:11.465278 20556 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.468344 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:11.469062 17597 raft_consensus.cc:2376] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8. Re-sending same reply.
I20260709 13:19:11.446422 20636 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:11.470171 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.470613 20636 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.471084 17598 raft_consensus.cc:2393] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:11.472884 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:11.473894 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 92838.2us
I20260709 13:19:11.474359 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.474632 20591 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.475907 20591 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.477460 20498 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:11.477995 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.478338 20498 raft_consensus.cc:697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:11.478952 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.479694 20684 raft_consensus.cc:2764] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:11.479701 20498 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.480729 20684 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:11.481132 20684 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:11.481513 20684 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.444593 20704 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:11.437798 20602 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.482930 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.488169 17596 raft_consensus.cc:2410] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:11.488798 20462 raft_consensus.cc:697] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:11.490584 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.494850 17420 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:11.453402 20593 consensus_queue.cc:260] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.496336 20462 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.498862 20589 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:19:11.504805 20602 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:11.505326 20589 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:11.500519 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:11.506338 17596 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.514551 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.515232 17603 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:11.515456 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.516250 17595 raft_consensus.cc:2410] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:11.516119 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.516863 17598 raft_consensus.cc:2410] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:11.517414 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.517661 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.518851 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.519683 17598 raft_consensus.cc:2410] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:11.519743 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.520480 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.521360 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:11.521644 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.522186 17602 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.522881 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.523613 17599 raft_consensus.cc:2393] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:11.522290 20593 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.536893 20707 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.538525 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.538599 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.539793 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.540846 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:11.541950 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 56393.1us
I20260709 13:19:11.539785 17601 raft_consensus.cc:2393] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:11.493376 20704 raft_consensus.cc:697] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:11.543135 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 80966.5us
I20260709 13:19:11.555397 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.556304 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.557868 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.558526 17598 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:11.561625 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.554389 20612 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:11.570948 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 79155.5us
I20260709 13:19:11.582516 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.572572 20612 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.593721 17419 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.585146 20612 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:11.600208 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.602011 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 47872.5us
W20260709 13:19:11.605710 17420 leader_election.cc:336] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.856s (SENT)
I20260709 13:19:11.606246 17420 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:11.605813 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.613893 17419 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:11.615780 20706 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:19:11.588330 20596 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.594170 20584 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.655356 17602 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:11.658249 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:11.658483 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 44811.7us
I20260709 13:19:11.663223 17598 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:19:11.662217 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 87014.5us
I20260709 13:19:11.674912 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.675638 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:11.677618 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.679710 17419 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.606500 20708 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:19:11.696008 17596 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
W20260709 13:19:11.701889 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.683184 20705 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:11.678956 20712 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:11.713413 20706 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:11.732900 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:11.733780 17454 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:11.734128 20710 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:11.663684 20704 consensus_queue.cc:237] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.717689 20705 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:11.737882 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 134321us
I20260709 13:19:11.738798 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:11.740316 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:11.740819 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.741321 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.741662 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.741920 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.738148 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:19:11.743106 17420 leader_election.cc:336] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.893s (SENT)
W20260709 13:19:11.744305 17420 leader_election.cc:336] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.965s (SENT)
I20260709 13:19:11.745030 17420 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:11.745608 17600 raft_consensus.cc:2410] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:11.752743 20612 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.756170 18197 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:11.756604 20636 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.766485 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:11.772846 17445 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:11.773031 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:11.773205 20705 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:11.773970 17454 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
W20260709 13:19:11.774464 20709 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:19:11.826884 17454 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:11.824153 17595 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:11.762796 20584 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:11.828812 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 171333us
I20260709 13:19:11.829628 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:11.835528 17454 raft_consensus.cc:2393] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:11.835695 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.813493 20710 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:11.853016 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:11.855634 17454 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:11.868880 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:11.869073 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 124813us
I20260709 13:19:11.869758 17451 raft_consensus.cc:2410] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:19:11.872083 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.872900 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:11.875252 20488 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.876010 20488 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:11.880203 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:11.850203 20710 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:11.884600 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.885704 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 50004.7us
I20260709 13:19:11.881124 17528 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:11.888140 18166 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:11.884075 17454 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.854524 20712 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:11.856882 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:11.857322 20596 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:11.899124 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:11.903318 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:11.904057 17450 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:11.906279 20719 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.883519 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:11.886149 20710 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.889392 20636 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:11.889480 20729 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:11.906828 20719 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:11.913334 20729 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.913750 20729 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.892465 20674 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:11.892407 20720 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:11.944357 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 105320us
I20260709 13:19:11.899341 20612 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:11.945850 17450 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:19:11.955422 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.955175 17454 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:11.956950 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:11.966509 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 69766us
W20260709 13:19:11.972141 17420 leader_election.cc:336] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.118s (SENT)
I20260709 13:19:11.974313 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:11.976454 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:11.944387 20719 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:11.977309 17454 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:11.965802 17447 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:11.979240 17446 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:11.956545 20488 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:11.968918 20599 consensus_meta.cc:287] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.510s	user 0.013s	sys 0.000s
I20260709 13:19:11.947551 18193 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:11.988662 18197 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
W20260709 13:19:11.982672 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 317407us
I20260709 13:19:11.995687 20674 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.007575 20674 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:12.014853 20726 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:12.000391 20612 raft_consensus.cc:2804] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:12.018643 20612 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:12.019203 20612 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.020785 20674 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:11.995546 20730 raft_consensus.cc:2764] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:12.030963 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:12.033828 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:12.035619 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:12.048002 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:12.049014 17524 raft_consensus.cc:2393] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:19:12.051092 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 160032us
I20260709 13:19:11.998863 20599 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:12.059576 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.047406 20684 consensus_meta.cc:287] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.000s
I20260709 13:19:12.064666 17525 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
W20260709 13:19:12.066248 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 94164.7us
W20260709 13:19:12.067266 17420 leader_election.cc:336] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.220s (SENT)
I20260709 13:19:12.067736 17420 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:12.070791 17419 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:12.045078 20734 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:12.085872 20734 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:12.086906 20734 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:12.087572 20734 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:12.025559 20712 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:12.059993 20593 consensus_meta.cc:287] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.005s
W20260709 13:19:12.098141 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.107764 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 47047us
I20260709 13:19:12.107988 17603 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:12.080027 20684 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:12.112185 20717 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:12.131995 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:12.124538 20720 consensus_queue.cc:1059] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:19:12.137053 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:12.137944 17521 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.133260 20674 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:12.138278 20562 consensus_meta.cc:287] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.647s	user 0.004s	sys 0.009s
I20260709 13:19:12.151575 20711 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:12.151405 20745 consensus_queue.cc:1059] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:19:12.152462 20711 consensus_queue.cc:1243] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:12.152856 20745 raft_consensus.cc:3055] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:12.153264 20745 raft_consensus.cc:740] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:12.154537 20734 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:12.138984 20717 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:12.155925 20717 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:12.141054 20612 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:12.166824 20727 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.199s	user 0.004s	sys 0.000s
I20260709 13:19:12.172263 20714 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:12.176465 20707 consensus_meta.cc:287] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.639s	user 0.006s	sys 0.006s
I20260709 13:19:12.177008 20707 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:12.178174 20599 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:12.178622 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 46777.1us
I20260709 13:19:12.178920 20719 raft_consensus.cc:3055] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:12.179535 20719 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:12.179705 17420 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:12.180408 20719 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:12.181156 20714 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:12.183175 20684 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:12.184294 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 188109us
I20260709 13:19:12.159507 20710 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:12.185737 20596 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:12.188062 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.226075 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.228670 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:12.230769 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.162882 20562 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:12.231622 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.252887 17521 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:12.270493 18166 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:12.237221 20745 consensus_queue.cc:260] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:12.273531 20488 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:12.274253 20488 raft_consensus.cc:697] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:12.275381 20488 consensus_queue.cc:237] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:12.280539 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 134227us
W20260709 13:19:12.280876 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 97140.5us
I20260709 13:19:12.284263 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:12.285363 17524 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.286317 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:12.295467 17524 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:12.297000 17419 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:12.299135 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:12.297194 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:12.300016 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 120407us
I20260709 13:19:12.305588 17521 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:12.305735 17495 leader_election.cc:400] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8.
I20260709 13:19:12.306178 17495 leader_election.cc:403] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:12.279747 20745 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.308089 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:12.241662 20729 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:12.313936 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:12.315826 17521 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.314361 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:12.304636 20710 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:12.299424 20719 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.314375 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:12.318531 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:12.319410 17523 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:12.310981 20562 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:12.324098 20754 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.329598 20716 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:12.334052 20738 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8.
W20260709 13:19:12.376559 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 62249.3us
I20260709 13:19:12.383401 17521 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:12.338495 17526 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:19:12.510106 20759 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.214s	user 0.003s	sys 0.000s
W20260709 13:19:12.768811 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 464098us
W20260709 13:19:12.450428 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.783010 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.783429 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:12.689328 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.785563 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.777182 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 456140us
I20260709 13:19:12.399503 17523 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.423640 17520 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:12.769415 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 372859us
I20260709 13:19:12.794457 17523 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:12.451363 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.798828 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.799211 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.453130 20612 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:12.443936 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:12.499641 17527 raft_consensus.cc:1240] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:12.807101 17521 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:12.814978 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 391477us
I20260709 13:19:12.816215 17495 leader_election.cc:400] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9.
I20260709 13:19:12.816705 17495 leader_election.cc:403] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:19:12.509284 20756 log.cc:927] Time spent T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.124s	user 0.001s	sys 0.001s
W20260709 13:19:12.508083 20758 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.213s	user 0.000s	sys 0.002s
W20260709 13:19:12.509032 20755 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.211s	user 0.002s	sys 0.000s
I20260709 13:19:12.452816 20754 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:12.508143 20757 log.cc:927] Time spent T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:19:12.443028 20729 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:12.506592 20227 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.399752 20712 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:12.395838 20716 raft_consensus.cc:697] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:12.509310 20591 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:12.729187 20488 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:12.832330 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:12.452602 20684 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.403s
I20260709 13:19:12.486940 20596 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.342s
I20260709 13:19:12.823511 20730 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:12.841568 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:12.831487 20712 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.823035 20704 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:19:12.847496 20674 consensus_queue.cc:1059] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:12.847801 20769 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:12.831164 20612 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9.
W20260709 13:19:12.848489 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 55351.9us
I20260709 13:19:12.851533 20732 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:12.851670 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:12.842522 20729 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:12.838917 20730 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:12.854313 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 70962.5us
I20260709 13:19:12.852916 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:12.848824 20719 consensus_meta.cc:287] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 13:19:12.854439 20732 raft_consensus.cc:697] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:12.837617 20591 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:12.833832 20227 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:12.848959 20712 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.861912 17352 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 98) took 9511 ms. Trace:
I20260709 13:19:12.837929 20488 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:12.865942 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 65592.3us
I20260709 13:19:12.863057 20720 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:12.860754 20745 consensus_meta.cc:287] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.000s
I20260709 13:19:12.856894 20729 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.878114 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:12.875718 17568 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:12.878114 17495 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:12.856772 20730 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.862991 17352 rpcz_store.cc:276] 0709 13:19:03.350352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.350635 (+   283us) service_pool.cc:224] Handling call
0709 13:19:12.861787 (+9511152us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:11.735000 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:11.967982 (+232982us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:11.979532 (+ 11550us) write_op.cc:435] Acquired schema lock
0709 13:19:11.982074 (+  2542us) tablet.cc:662] Decoding operations
0709 13:19:12.016659 (+ 34585us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:12.016746 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:12.016782 (+    36us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:19:12.017987 (+  1205us) tablet.cc:701] Row locks acquired
0709 13:19:12.022679 (+  4692us) write_op.cc:260] PREPARE: finished
0709 13:19:12.022900 (+   221us) write_op.cc:270] Start()
0709 13:19:12.023118 (+   218us) write_op.cc:276] Timestamp: P: 1783603152022826 usec, L: 0
0709 13:19:12.023145 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:19:12.024044 (+   899us) log.cc:844] Serialized 4876 byte log entry
0709 13:19:12.166708 (+142664us) op_driver.cc:464] REPLICATION: finished
0709 13:19:12.772627 (+605919us) write_op.cc:301] APPLY: starting
0709 13:19:12.772725 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:12.772986 (+   261us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:12.773123 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:12.774832 (+  1709us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:12.775238 (+   406us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:19:12.775282 (+    44us) write_op.cc:312] APPLY: finished
0709 13:19:12.775669 (+   387us) log.cc:844] Serialized 89 byte log entry
0709 13:19:12.775862 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:12.776021 (+   159us) write_op.cc:454] Released schema lock
0709 13:19:12.776090 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:12.776493 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:12.776534 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47179,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":605596,"apply.run_cpu_time_us":3596,"apply.run_wall_time_us":3835,"num_ops":12,"prepare.queue_time_us":102577,"prepare.run_cpu_time_us":43051,"prepare.run_wall_time_us":389103,"raft.queue_time_us":47971,"raft.run_cpu_time_us":14875,"raft.run_wall_time_us":436617,"replication_time_us":143371,"thread_start_us":571207,"threads_started":4,"wal-append.queue_time_us":91004}]]}
I20260709 13:19:12.884023 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:12.880877 20729 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:12.887140 20764 log.cc:927] Time spent T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.116s	user 0.004s	sys 0.000s
I20260709 13:19:12.888347 20745 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:12.889114 20745 raft_consensus.cc:697] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:12.890314 20719 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:12.866818 20612 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:12.894797 17420 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:12.896227 17420 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:12.897161 20767 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.122s	user 0.000s	sys 0.002s
I20260709 13:19:12.899540 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:12.850705 20716 consensus_queue.cc:237] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:12.906615 20562 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:12.907117 20562 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.907269 20488 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:12.907588 20562 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.904932 20719 raft_consensus.cc:2764] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:12.908514 20612 raft_consensus.cc:697] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:12.909443 20612 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:12.910732 20766 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.002s
I20260709 13:19:12.911612 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:12.911764 20749 raft_consensus.cc:3055] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:12.903285 20704 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:12.918839 20761 log.cc:927] Time spent T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.147s	user 0.001s	sys 0.001s
I20260709 13:19:12.914296 20749 raft_consensus.cc:740] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:12.921734 20749 consensus_queue.cc:260] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:12.923002 20749 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.891104 20745 consensus_queue.cc:237] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:12.929958 20763 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:19:12.897496 20732 consensus_queue.cc:237] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:12.931015 20762 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.161s	user 0.002s	sys 0.000s
I20260709 13:19:12.936316 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:12.931890 20227 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:12.893225 20684 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:19:12.875873 20768 consensus_queue.cc:1059] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:19:12.893394 20770 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:12.947449 17522 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
W20260709 13:19:12.948109 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 51968.2us
W20260709 13:19:12.949458 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 131570us
I20260709 13:19:12.947227 17351 catalog_manager.cc:5697] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:12.961045 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:12.958781 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 121712us
I20260709 13:19:12.966900 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:12.966980 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 87299.6us
I20260709 13:19:12.962167 18166 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:12.969305 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:12.969969 17451 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
W20260709 13:19:12.976025 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.992300 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 108817us
I20260709 13:19:12.984444 17351 catalog_manager.cc:5697] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.003185 17525 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:19:13.012275 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 62596.8us
I20260709 13:19:13.013150 17420 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.005692 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:12.974509 20754 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.967212 20704 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:19:12.994840 18167 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.031565 17351 catalog_manager.cc:5697] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.994772 20772 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.046300 20772 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.046687 20772 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.022202 20710 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.051749 20729 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.054395 20729 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.055503 20720 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:13.055080 17351 catalog_manager.cc:5697] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:13.058426 17339 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e57fe371976a485bbdedfdaa4659dec3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2158c0f750fd4b21afe24135c52167b2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:13.060146 20591 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:13.029881 20584 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.062855 20584 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.065371 20584 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.029714 20775 consensus_queue.cc:1059] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:19:13.065867 20562 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.067981 20562 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.022550 20684 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.034090 20773 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:19:13.023528 20749 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:13.059542 17351 catalog_manager.cc:5697] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 8, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 8 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.102628 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:13.041527 20730 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.106235 17520 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:13.105700 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
W20260709 13:19:13.107841 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 94771.3us
I20260709 13:19:13.083460 20776 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:13.108870 17420 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.105769 20769 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:13.110131 17351 catalog_manager.cc:5697] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:13.125361 17522 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:13.110139 20774 raft_consensus.cc:3055] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:13.134903 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.114940 20769 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:13.127099 20771 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:13.140935 20771 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.143666 20771 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.122681 20684 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:13.144217 20684 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:13.144639 20684 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.144668 17351 catalog_manager.cc:5697] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 5 to 8, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 8 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:13.146340 17351 catalog_manager.cc:5697] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 6 to 8, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 8 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } }
I20260709 13:19:13.147151 20730 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.149809 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:13.151906 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.152658 20716 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.153398 20716 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.138449 20591 raft_consensus.cc:3055] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:13.154101 20716 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.154299 20591 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:13.140251 20754 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.156277 20591 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.165621 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:13.166891 20591 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.166999 20769 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.168587 20769 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.148258 17351 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 5 to 6, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 6 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:13.176424 20712 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.177814 17522 raft_consensus.cc:2368] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8.
I20260709 13:19:13.136212 20774 raft_consensus.cc:740] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:13.179069 20774 consensus_queue.cc:260] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.180325 20774 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.181419 17419 leader_election.cc:400] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8.
I20260709 13:19:13.182119 17419 leader_election.cc:403] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:13.183933 20754 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.125223 20720 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:13.158926 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:13.170862 17351 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 7 to 10, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 10 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.166064 20704 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:19:13.191001 20783 log.cc:927] Time spent T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:19:13.191388 20749 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:13.197250 20749 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.198414 20704 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:13.199174 20719 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:13.199676 20227 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.200178 20227 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.200702 20749 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.202260 20227 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.203053 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:13.203385 20710 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.199709 20719 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:13.204142 20772 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.205194 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:13.205947 17529 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:13.206589 20772 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:13.208449 18166 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:13.210822 20712 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.210939 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:13.211674 17451 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.132992 20770 raft_consensus.cc:697] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:13.227464 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:13.228092 20771 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.227553 17351 catalog_manager.cc:5697] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:13.230815 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 247391us
I20260709 13:19:13.229656 17529 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:19:13.232092 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 73267.6us
I20260709 13:19:13.233070 17420 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:13.235991 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.235672 17420 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.237943 17420 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.239120 20710 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:13.242787 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.225152 20772 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:13.247442 20772 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.247949 20772 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.250830 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:13.252007 20712 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.253265 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:13.253832 17351 catalog_manager.cc:5697] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:13.255504 17529 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:13.256338 17420 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.256978 18166 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:13.257499 17451 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:13.259251 17351 catalog_manager.cc:5697] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:13.273281 20792 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.279645 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:13.282807 20770 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.285624 20705 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:13.243330 20771 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.243000 20704 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:13.287755 20684 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.258394 20754 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8.
I20260709 13:19:13.259068 20227 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.276480 20749 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:13.277137 20710 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.288861 20730 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:13.294715 20562 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:13.306458 20488 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.314250 20771 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.329195 20684 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:13.319826 20562 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:13.330072 20562 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.296589 20792 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.332098 20792 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.315510 20227 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.320027 20749 raft_consensus.cc:697] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:13.334753 20227 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.338466 20772 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.342362 20488 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.344878 20488 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.335454 20749 consensus_queue.cc:237] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.347867 20772 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.365217 20730 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.372776 20712 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:13.372993 20730 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.375391 20730 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:13.386533 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 100986us
W20260709 13:19:13.388206 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 112953us
I20260709 13:19:13.398010 17569 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:13.399977 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.402518 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:13.403244 17596 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:13.404285 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:13.406077 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:13.406495 17603 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.406665 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:13.407413 17595 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:13.408202 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:13.408514 17351 catalog_manager.cc:5697] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:13.410141 20488 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:13.410573 20488 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.410918 20488 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.412475 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:13.413064 17600 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:13.406690 17597 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.409893 17351 catalog_manager.cc:5697] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:13.415759 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:13.399055 20716 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:13.422492 17603 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:13.418973 20773 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:13.419245 20772 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:13.438017 20773 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.438633 20772 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.428020 20227 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:13.439819 20227 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:13.440214 20227 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.404035 20787 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.445699 20787 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.424300 20770 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.477653 17597 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:13.480897 18167 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:19:13.482303 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 84421.1us
I20260709 13:19:13.483611 17569 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.487977 20773 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.488808 20448 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:13.489530 20448 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.490180 20448 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.490592 20772 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:13.491743 20776 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.492051 20562 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.494411 20562 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.510584 20776 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:13.521170 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.513377 20448 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.523731 20784 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:13.524183 17569 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.524770 20488 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.530412 20784 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:13.531049 20784 raft_consensus.cc:697] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:13.532011 20784 consensus_queue.cc:237] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.532887 20488 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.534647 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.536489 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.526865 20719 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.537889 17569 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:13.525962 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 45150.3us
I20260709 13:19:13.539587 18167 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:13.528630 20448 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.540961 20780 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.541548 20780 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:13.542083 20780 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.546155 20770 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:13.546669 20770 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:13.546878 20776 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:13.547078 20770 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.547365 20776 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:13.547785 20776 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.559201 17569 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.560880 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:13.561337 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:13.561832 17603 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.562429 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.571026 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:13.571928 17600 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.574399 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:13.575073 17597 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:13.577049 20797 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:13.577576 20797 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.577965 20797 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.564942 20488 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:13.563582 20768 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.579000 20488 raft_consensus.cc:697] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:13.580169 20488 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.560880 20775 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:19:13.596154 17603 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
W20260709 13:19:13.598382 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 318938us
I20260709 13:19:13.600383 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:13.602828 17569 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.604140 20768 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:13.606890 20768 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:13.609223 17600 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:13.610522 20562 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.560736 20448 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:19:13.625535 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:13.628069 20787 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:13.619930 20780 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.621258 20776 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.611446 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.629526 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:13.628616 20730 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.630788 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:13.634671 20730 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:13.635385 18167 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:13.635918 20448 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.636431 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:13.638769 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.640493 20488 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:13.641078 20488 raft_consensus.cc:697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:13.641965 20488 consensus_queue.cc:237] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:13.647037 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 390728us
I20260709 13:19:13.647863 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.648499 20775 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:13.648633 20754 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:13.649138 20797 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.636358 20448 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:13.663307 20448 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.658191 20754 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:13.658677 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:13.666225 17529 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:13.659332 20776 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:13.660344 20780 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:13.628687 20227 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.680104 20227 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.680958 18193 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:13.628687 20770 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.682117 17419 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:13.683358 20770 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:13.648032 20562 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:13.684441 20792 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:13.662582 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:13.684897 20792 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.685360 20792 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.685741 20797 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:13.664319 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.688429 17569 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.688637 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:13.669898 20775 raft_consensus.cc:697] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:13.671831 20754 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.689805 20784 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:13.654721 20802 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:13.694568 20754 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.696002 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:13.771015 20802 raft_consensus.cc:697] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:13.690407 20780 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:13.672708 17524 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:13.697782 20775 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.710729 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.076288 17522 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:14.077735 17522 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.690328 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:13.701351 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:13.689251 17603 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.725101 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:14.135334 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 410337us
I20260709 13:19:14.137539 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:13.745679 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.733958 20720 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:14.152536 20720 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.687952 20712 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.713780 20770 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:13.846187 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.859829 20792 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.163476 20792 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:13.920675 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 142309us
I20260709 13:19:14.164616 17419 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:13.700420 17420 leader_election.cc:336] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.792s (SENT)
W20260709 13:19:14.174631 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 509800us
I20260709 13:19:13.922261 20811 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:13.923435 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.176041 20811 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:13.772141 20802 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:13.924010 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.178558 17529 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:13.924088 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:13.925369 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:13.926355 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:13.926648 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:13.927664 17523 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:14.180585 17526 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.945444 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:13.968746 20771 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.985080 20710 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.182679 17351 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40488 (request call id 191) took 11414 ms (client timeout 15000 ms). Trace:
I20260709 13:19:14.182812 20773 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:14.183032 20710 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.183867 20749 raft_consensus.cc:3055] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:14.184226 20749 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:14.185127 20749 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:14.185590 20710 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.989967 20716 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.186546 20749 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:14.186271 20716 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.188334 20716 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.991766 20772 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.189031 20772 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:14.191004 20772 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:13.997347 20784 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.191604 20784 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:14.009707 20488 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.014532 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.017272 20719 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.025439 17520 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:14.027679 17597 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:14.060489 17528 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:14.065237 20448 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:14.093297 17522 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:14.210393 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:14.121850 20780 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.211103 17450 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
W20260709 13:19:14.129601 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 428323us
I20260709 13:19:14.212198 20780 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.212698 17569 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:13.725797 20797 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:14.138293 20562 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:14.138942 20730 consensus_queue.cc:1059] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:14.140818 20754 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.141597 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.225065 20754 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.227104 20754 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:14.142786 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:14.148061 17603 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:14.217867 20772 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:19:14.230846 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:14.229722 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:14.231992 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:14.194291 20488 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:14.232515 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:14.232986 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.233503 17521 raft_consensus.cc:2393] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:14.233712 17528 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:14.234006 20488 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:14.149188 20612 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:14.156546 17352 catalog_manager.cc:5697] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 5 to 8, term changed from 7 to 8, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to <none>, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 8 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:14.235265 20780 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:14.236217 20730 raft_consensus.cc:3055] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:14.236125 17352 catalog_manager.cc:5697] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 5 to 6, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 6 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:14.158601 20720 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:14.204061 17526 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:14.203927 18166 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:14.202658 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:14.245847 17600 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:14.208631 17451 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:14.247179 17526 raft_consensus.cc:3055] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:14.247720 17526 raft_consensus.cc:740] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:14.211275 20710 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:14.217016 17569 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:14.250425 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46567.4us
I20260709 13:19:14.181725 20770 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.181463 20792 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:19:14.247884 17528 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:14.220815 20448 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:14.221796 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:14.224231 20775 raft_consensus.cc:2764] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:19:14.210698 20771 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:14.269676 20771 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:14.241796 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:14.273186 20770 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:14.249080 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 106510us
I20260709 13:19:14.274098 20773 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:14.249895 20769 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:14.211879 20716 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.236605 20730 raft_consensus.cc:740] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:14.277660 20559 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:14.278270 20716 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.280745 20716 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:14.277024 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:14.281889 20612 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:14.282189 17339 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e57fe371976a485bbdedfdaa4659dec3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:14.254860 17526 consensus_queue.cc:260] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.286655 17526 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.286772 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:14.286947 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:14.287443 17600 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:14.288614 20559 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:14.288981 20559 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.289302 20559 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:14.290367 20770 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:14.293615 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:14.209587 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.305132 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:14.305747 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 130439us
W20260709 13:19:14.306244 17420 connection.cc:256] RPC call timeout handler was delayed by -1.5488512849999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:19:14.306668 17420 connection.cc:256] RPC call timeout handler was delayed by -1.3517512849998639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 13:19:14.183137 17351 rpcz_store.cc:269] 0709 13:19:02.768161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.769504 (+  1343us) service_pool.cc:224] Handling call
0709 13:19:14.182620 (+11413116us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:13.611602 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:13.612696 (+  1094us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:13.612733 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:19:13.612751 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:13.614076 (+  1325us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:13.614158 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:13.614187 (+    29us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:19:13.615351 (+  1164us) tablet.cc:701] Row locks acquired
0709 13:19:13.615377 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:19:13.615568 (+   191us) write_op.cc:270] Start()
0709 13:19:13.615684 (+   116us) write_op.cc:276] Timestamp: P: 1783603153615481 usec, L: 0
0709 13:19:13.615701 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:19:13.616400 (+   699us) log.cc:844] Serialized 5961 byte log entry
0709 13:19:13.667958 (+ 51558us) op_driver.cc:464] REPLICATION: finished
0709 13:19:13.739369 (+ 71411us) write_op.cc:301] APPLY: starting
0709 13:19:13.739459 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:13.739798 (+   339us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:13.739915 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:13.742231 (+  2316us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:13.742558 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:19:13.742609 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:13.743103 (+   494us) log.cc:844] Serialized 107 byte log entry
0709 13:19:13.743280 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:13.752370 (+  9090us) write_op.cc:454] Released schema lock
0709 13:19:13.752430 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:13.752899 (+   469us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:13.752930 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":71118,"apply.run_cpu_time_us":3885,"apply.run_wall_time_us":13484,"num_ops":15,"prepare.queue_time_us":55221,"prepare.run_cpu_time_us":4714,"prepare.run_wall_time_us":32889,"replication_time_us":52060,"thread_start_us":82796,"threads_started":2}]]}
I20260709 13:19:14.255838 17597 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.252534 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.216135 20797 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.273584 20488 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:14.237883 17352 catalog_manager.cc:5697] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.320055 17600 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:14.277494 20712 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:14.307047 17420 connection.cc:256] RPC call timeout handler was delayed by -1.1497098729998925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
I20260709 13:19:14.308774 17528 raft_consensus.cc:2393] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:19:14.250983 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 86433.7us
I20260709 13:19:14.273463 20784 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.305306 17526 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:14.331992 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.332739 17526 raft_consensus.cc:2410] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:14.320676 17352 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 10 to 11, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 11 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.322044 18167 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:14.254530 20772 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:14.250444 20562 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:14.250346 20710 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.329097 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:14.333696 17352 catalog_manager.cc:5697] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:14.343075 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.338757 17524 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:14.318271 20775 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:14.295058 20811 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:14.319979 20797 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.318737 20792 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:14.346490 20712 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:14.346529 20802 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:14.343861 17522 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:19:14.350927 17597 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:14.366195 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.367105 17528 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:14.342832 20710 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.336925 20488 raft_consensus.cc:697] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:14.325560 20780 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:19:14.327702 20773 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:19:14.373728 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.278415 20730 consensus_queue.cc:260] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.383517 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:14.384282 17420 leader_election.cc:336] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 2.860s (SENT)
I20260709 13:19:14.384557 17528 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:14.384843 17420 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:14.385342 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 168376us
I20260709 13:19:14.390620 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.341734 20769 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:19:14.356628 20802 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.357026 20712 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:14.397943 17569 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:14.404605 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.406596 17527 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.405674 17524 raft_consensus.cc:1813] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Handling vote request from an unknown peer 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:14.409792 17524 raft_consensus.cc:2410] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:14.399384 20802 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:14.364573 20792 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.348804 20720 consensus_queue.cc:1059] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:19:14.412195 17569 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:14.413558 20775 raft_consensus.cc:2764] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:19:14.413992 20768 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:14.414705 20811 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.383287 20716 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:14.419713 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.420845 17524 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:14.372092 20754 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.390281 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:14.427961 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 106032us
I20260709 13:19:14.399741 20712 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.436069 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:14.372457 17451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:19:14.452693 17451 raft_consensus.cc:606] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:14.454130 17451 raft_consensus.cc:614] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:14.447168 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 69724us
W20260709 13:19:14.461490 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 49361.1us
I20260709 13:19:14.462453 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:14.465801 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:14.437834 20720 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:14.466187 17419 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:14.436432 20730 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:14.474697 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.475067 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:14.446589 20612 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.476979 17522 raft_consensus.cc:2393] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:14.426819 20816 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:19:14.448572 20749 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:14.450877 20771 raft_consensus.cc:3055] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:14.429226 20811 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.450074 20824 raft_consensus.cc:2764] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:19:14.471336 20780 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:14.436631 20716 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:14.436162 20754 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.448177 20773 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:19:14.535221 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 150945us
I20260709 13:19:14.480044 20775 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:14.516330 20769 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:14.490494 20771 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:14.489987 20719 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:14.486989 20612 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.473335 20488 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:14.544116 20720 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.558635 20784 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:14.574906 20828 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:19:14.560349 20719 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.563221 20769 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:14.703064 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:14.648602 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.704310 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 229327us
I20260709 13:19:14.565438 20775 raft_consensus.cc:697] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:14.725919 17529 raft_consensus.cc:3055] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:14.771497 17529 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:14.772099 17569 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:14.713037 20792 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:14.781277 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.664237 20771 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:14.787603 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.802103 20837 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:19:14.803365 17529 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.769296 20719 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.760274 20768 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.810271 17600 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:14.809903 17529 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:14.810838 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 235612us
I20260709 13:19:14.726289 20720 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.826452 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:14.824043 20825 log.cc:927] Time spent T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260709 13:19:14.807209 17550 debug-util.cc:398] Leaking SignalData structure 0x7b080030f680 after lost signal to thread 16329
W20260709 13:19:14.817615 20818 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:19:14.835517 17521 raft_consensus.cc:2368] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9.
I20260709 13:19:14.841924 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:14.842737 17451 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.834803 17528 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:14.843111 17419 leader_election.cc:400] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9.
I20260709 13:19:14.843473 17419 leader_election.cc:403] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:14.839262 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4360 after lost signal to thread 16332
W20260709 13:19:14.846391 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0340 after lost signal to thread 17386
W20260709 13:19:14.846827 17550 debug-util.cc:398] Leaking SignalData structure 0x7b080027b120 after lost signal to thread 17400
W20260709 13:19:14.848203 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff360 after lost signal to thread 17478
W20260709 13:19:14.849500 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08002fea20 after lost signal to thread 17553
W20260709 13:19:14.849812 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08002feac0 after lost signal to thread 17554
I20260709 13:19:14.851686 17451 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:14.838063 17529 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:14.853775 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:14.857260 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:14.859879 17450 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.860018 17448 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:14.861078 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:14.861732 17448 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.858815 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:14.862736 17454 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:14.863554 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:14.864029 17454 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.854132 17447 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:14.867107 17450 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:14.867203 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:14.856513 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:14.868093 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:14.868402 17452 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.868582 17450 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:14.856182 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:14.871309 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:14.871863 17451 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:14.872740 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:14.874951 17450 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
W20260709 13:19:14.879732 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.881843 17448 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:14.882488 17452 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:14.883307 17448 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:14.883668 17452 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:14.801769 20712 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:14.853518 17550 debug-util.cc:398] Leaking SignalData structure 0x7b0800334bc0 after lost signal to thread 17627
I20260709 13:19:14.883952 17454 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
W20260709 13:19:14.886833 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08003f1920 after lost signal to thread 17628
W20260709 13:19:14.888921 17550 debug-util.cc:398] Leaking SignalData structure 0x7b080033ff40 after lost signal to thread 18225
W20260709 13:19:14.889297 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08003da4a0 after lost signal to thread 18226
W20260709 13:19:14.890313 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.895159 20771 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:14.828665 20845 raft_consensus.cc:2764] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:14.786963 20836 consensus_queue.cc:1059] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 13:19:14.912083 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 66972.9us
W20260709 13:19:14.918934 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 75979.9us
I20260709 13:19:14.960892 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:14.961633 17529 raft_consensus.cc:2393] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 6: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:14.961163 17419 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:14.970235 17527 consensus_meta.cc:287] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.557s	user 0.006s	sys 0.005s
I20260709 13:19:14.973892 17527 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:19:14.956809 20831 log.cc:927] Time spent T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.447s	user 0.004s	sys 0.000s
I20260709 13:19:14.912005 20770 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.830869 20768 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.963478 20841 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.967779 20784 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.998483 17525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.005s	sys 0.017s
W20260709 13:19:15.001963 17525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.005s	sys 0.017s
W20260709 13:19:14.989763 20832 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.431s	user 0.000s	sys 0.001s
I20260709 13:19:14.975551 20844 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.979367 20811 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:14.993975 20829 log.cc:927] Time spent T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.435s	user 0.001s	sys 0.000s
W20260709 13:19:15.039324 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.989470 20780 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.045113 20780 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.045563 20849 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:15.047308 20780 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.031775 20716 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:15.038371 20845 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.050312 20838 log.cc:927] Time spent T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.342s	user 0.000s	sys 0.002s
I20260709 13:19:15.040364 20847 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.963935 20775 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:14.972338 20769 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:15.049317 20780 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.001024 20784 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:14.997397 20841 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.049958 20856 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:15.042824 20844 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:15.127031 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 165984us
I20260709 13:19:15.065018 20612 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:14.997153 20770 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:15.149092 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:15.157181 17529 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
W20260709 13:19:15.158706 17495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.013s	sys 0.008s
W20260709 13:19:15.159780 17495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.013s	sys 0.008s
W20260709 13:19:15.160014 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 711130us
I20260709 13:19:15.163437 17419 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:15.167899 17525 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:15.162292 20840 log.cc:927] Time spent T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:19:15.184576 17524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.012s	sys 0.012s
I20260709 13:19:15.182361 17420 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:15.192322 17523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.008s	sys 0.037s
W20260709 13:19:15.194938 17524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.013s	sys 0.012s
I20260709 13:19:15.128106 20780 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.182578 20833 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:15.196156 17523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.008s	sys 0.037s
I20260709 13:19:15.101152 20845 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:15.197995 18166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.004s	sys 0.012s
I20260709 13:19:15.124931 20847 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:15.210414 18166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.004s	sys 0.012s
I20260709 13:19:15.190582 20720 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:15.189843 20712 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:15.214679 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 674813us
I20260709 13:19:15.221889 20768 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:15.228621 20802 consensus_meta.cc:287] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.815s	user 0.009s	sys 0.002s
W20260709 13:19:15.230917 20865 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:19:15.237226 20797 consensus_meta.cc:287] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.868s	user 0.008s	sys 0.000s
I20260709 13:19:15.214169 20792 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.242400 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.290365 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.291268 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.294831 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:15.298316 17520 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:15.245039 20784 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:15.250562 20864 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:15.252183 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:15.256343 20862 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:15.255343 20780 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.273893 20878 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.275807 17495 connection.cc:256] RPC call timeout handler was delayed by -3.038821463999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260709 13:19:15.183748 20612 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:19:15.286423 17525 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:19:15.241155 20730 consensus_meta.cc:287] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.761s	user 0.005s	sys 0.004s
W20260709 13:19:15.299831 20559 consensus_meta.cc:287] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 1.010s	user 0.011s	sys 0.002s
I20260709 13:19:15.300539 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:15.280573 20710 consensus_meta.cc:287] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.898s	user 0.008s	sys 0.003s
W20260709 13:19:15.306345 17420 leader_election.cc:336] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.507s (SENT)
I20260709 13:19:15.328495 17420 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:15.256537 20841 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.272876 20754 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:15.309381 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.273154 20847 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:15.305028 17454 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:15.321918 17495 connection.cc:256] RPC call timeout handler was delayed by -2.9524214639998263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 13:19:15.339850 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.332998 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:15.346990 17495 connection.cc:256] RPC call timeout handler was delayed by -2.9110214639999867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 13:19:15.347389 17495 connection.cc:256] RPC call timeout handler was delayed by -2.8354214639998645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
I20260709 13:19:15.347491 17600 raft_consensus.cc:2410] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:15.277051 20833 raft_consensus.cc:697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:15.325783 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:15.330471 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:15.350675 17446 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:15.321965 20749 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.033s	sys 0.042s
I20260709 13:19:15.279477 20845 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.283075 20768 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.287662 20797 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.332751 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.321739 20861 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:15.335989 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 44712.7us
I20260709 13:19:15.349982 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.357287 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:15.339903 20780 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:15.359027 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.359697 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:15.359777 17598 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:15.359952 17454 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:15.361430 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:15.332449 17599 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:15.362391 17601 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: [7.8-10.9]
I20260709 13:19:15.283555 20802 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:15.321671 20835 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:15.326190 20878 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:15.326995 17566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.023s	sys 0.010s
I20260709 13:19:15.307009 20792 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.331471 20710 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.436621 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.437446 17601 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:15.429528 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:15.438493 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:15.371474 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.412861 17597 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:15.392994 17594 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:15.389484 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:15.440339 17566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.027s	sys 0.012s
I20260709 13:19:15.441715 17596 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:15.441744 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.442538 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.442996 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.443338 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.443913 17597 raft_consensus.cc:2393] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:15.444327 17603 raft_consensus.cc:2393] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:15.444622 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:15.445263 17596 raft_consensus.cc:2410] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:15.445719 17601 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:15.329665 20559 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:15.361937 20841 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.445873 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.567044 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 417) took 1406 ms. Trace:
I20260709 13:19:15.567534 17527 rpcz_store.cc:276] 0709 13:19:14.160681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.187436 (+ 26755us) service_pool.cc:224] Handling call
0709 13:19:14.406407 (+218971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.975067 (+568660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.566835 (+591768us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400201cd0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:15.566972 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502769536}
I20260709 13:19:15.566962 20841 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.567754 17596 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:15.454743 17599 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:15.570605 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.467785 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.472296 17446 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:15.561229 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:15.515304 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:15.572333 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:15.518204 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.572674 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:15.573802 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:15.464457 17595 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:15.574127 17597 raft_consensus.cc:2410] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:15.522186 17447 raft_consensus.cc:2368] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9.
I20260709 13:19:15.572206 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:15.571477 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:15.353868 20749 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.034s	sys 0.042s
W20260709 13:19:15.504249 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 197911us
I20260709 13:19:15.522264 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:15.574672 17596 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:15.392385 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 420) took 1109 ms. Trace:
I20260709 13:19:15.350345 20730 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.504917 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:15.458400 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.742753 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:15.453941 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:15.762112 17603 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:15.762197 17453 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:15.663455 18165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.002s	sys 0.007s
I20260709 13:19:15.762245 17600 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
W20260709 13:19:15.763206 18165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.009s	sys 0.011s
I20260709 13:19:15.762207 17449 raft_consensus.cc:2393] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:15.763957 17448 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:15.396796 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
W20260709 13:19:15.674630 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.768424 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.768958 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.760619 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.771219 17520 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:15.761543 17528 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:15.764267 17525 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:15.587205 17445 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:15.763796 17527 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:15.457413 20802 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:15.389542 20833 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.780593 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:15.781436 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.774479 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:15.774637 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:15.783066 17595 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:15.783201 17446 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:15.774994 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:15.784425 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 265705us
I20260709 13:19:15.784528 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.775424 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.785148 17597 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
W20260709 13:19:15.706632 20866 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.390s	user 0.001s	sys 0.001s
I20260709 13:19:15.770972 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:15.790665 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.791535 17597 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:15.390106 20877 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:15.393304 20881 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.515401 20770 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.454914 20835 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.777613 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:15.457345 20846 raft_consensus.cc:3055] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:15.663678 20826 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.984s	user 0.005s	sys 0.001s
I20260709 13:19:15.439038 20720 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.339s
W20260709 13:19:15.778263 20886 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.056s	user 0.001s	sys 0.001s
I20260709 13:19:15.502218 20780 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.778715 20883 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.775044 20730 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.763054 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:15.794710 20848 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:15.785061 17600 raft_consensus.cc:2376] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9. Re-sending same reply.
I20260709 13:19:15.809813 20769 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:15.787642 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.389678 20867 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:15.367156 20861 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.842263 20861 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:15.842794 20876 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:19:15.504101 20612 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.845590 20612 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.847869 20612 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:15.459664 20797 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.389901 20863 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.848879 20863 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:15.820257 20710 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:15.366549 20754 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.417s
I20260709 13:19:15.453857 20844 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:15.765833 17529 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:15.839358 20792 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:15.782801 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.853410 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.795220 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.854342 17449 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:15.854485 17594 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:15.855280 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.801702 20877 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:15.856673 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.857247 17449 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:15.799067 17569 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:15.859063 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 60060.9us
I20260709 13:19:15.860090 17569 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:15.860302 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:15.861192 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:15.800508 17527 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:15.862270 20896 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:15.779999 20849 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.808315 17446 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:15.773706 20749 raft_consensus.cc:697] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:19:15.810308 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 456408us
I20260709 13:19:15.366125 20768 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.822373 17603 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:15.394599 20879 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.412s
I20260709 13:19:15.793141 20712 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:15.862782 20896 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:15.876010 20896 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:15.876215 20749 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:15.877589 20719 consensus_meta.cc:287] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 1.043s	user 0.006s	sys 0.006s
I20260709 13:19:15.877997 20719 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.878087 20849 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:15.879920 20768 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.880292 20719 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:15.808240 20881 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.880757 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.881881 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.882483 20881 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.778340 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.883303 17598 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:15.884116 20712 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.779639 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:15.660778 20888 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.228s
I20260709 13:19:15.886255 20712 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:15.886886 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.887251 20856 consensus_meta.cc:287] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.723s	user 0.007s	sys 0.002s
I20260709 13:19:15.786720 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:15.832903 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:19:15.824409 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 59104.4us
I20260709 13:19:15.841387 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:15.889855 17600 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:15.889979 17595 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:15.891218 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:15.851416 20863 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.794319 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:15.891834 17448 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.892350 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:15.892645 17597 raft_consensus.cc:2410] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:15.893031 17596 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:15.795679 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:15.894156 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.864480 17445 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:15.894974 17520 raft_consensus.cc:2393] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:15.865669 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.870934 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.873302 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:15.809913 20846 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:15.884351 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:15.826905 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:15.763240 17524 rpcz_store.cc:276] 0709 13:19:14.283407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.426763 (+143356us) service_pool.cc:224] Handling call
0709 13:19:14.427149 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.516778 (+ 89629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.516820 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.542180 (+ 25360us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.196710 (+654530us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:15.196769 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.196868 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.392148 (+195280us) raft_consensus.cc:1685] finished
0709 13:19:15.392170 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.392318 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9908,"raft.queue_time_us":237697,"raft.run_cpu_time_us":4164,"raft.run_wall_time_us":40633,"thread_start_us":674062,"threads_started":2,"wal-append.queue_time_us":808352}
I20260709 13:19:15.873378 20797 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:15.842274 20853 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:19:15.900092 20885 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.332s	user 0.001s	sys 0.001s
I20260709 13:19:15.900357 20853 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:15.887795 20730 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:15.865196 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:15.898497 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:15.882534 17603 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:15.902418 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2028) took 1423 ms. Trace:
I20260709 13:19:15.837355 20769 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:15.874434 20771 consensus_meta.cc:287] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.975s	user 0.011s	sys 0.002s
I20260709 13:19:15.902395 17597 raft_consensus.cc:2376] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8. Re-sending same reply.
I20260709 13:19:15.903789 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:15.904675 17453 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:15.902801 17523 rpcz_store.cc:276] 0709 13:19:14.478624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.539359 (+ 60735us) service_pool.cc:224] Handling call
0709 13:19:14.539768 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:15.204908 (+665140us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:15.204955 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:15.227748 (+ 22793us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.319486 (+ 91738us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:15.319530 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.319643 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.902010 (+582367us) raft_consensus.cc:1685] finished
0709 13:19:15.902194 (+   184us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.902344 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25989,"raft.queue_time_us":409157,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":11259,"thread_start_us":741024,"threads_started":2,"wal-append.queue_time_us":133701}
I20260709 13:19:15.918706 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.919508 17453 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:15.920408 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:15.921006 17453 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:15.921339 20853 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.897332 17598 raft_consensus.cc:2376] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9. Re-sending same reply.
W20260709 13:19:15.916529 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 51399.2us
I20260709 13:19:15.906677 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:15.862576 20878 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.866420 20780 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.837549 20883 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:15.876271 20770 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.922104 20827 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:15.898214 20856 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9.
I20260709 13:19:15.922492 20769 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:15.917562 20712 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.092900 20835 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:15.973295 20797 raft_consensus.cc:697] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:16.159026 20877 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:16.160851 20883 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:16.162895 20861 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.165021 20861 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:16.155009 20559 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:16.177742 20867 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:16.191413 20769 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.192806 20797 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.150279 20827 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:16.200709 20827 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:16.208269 20896 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.263229 20769 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:16.106648 20846 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.410262 20846 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.419608 20896 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:15.922338 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:16.559222 17595 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.566687 17595 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:16.567792 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1651) took 1010 ms. Trace:
I20260709 13:19:16.568204 17595 rpcz_store.cc:276] 0709 13:19:15.557615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.917928 (+360313us) service_pool.cc:224] Handling call
0709 13:19:16.567719 (+649791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.570067 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:16.570833 17595 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:16.571326 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1646) took 1040 ms. Trace:
I20260709 13:19:16.571687 17595 rpcz_store.cc:276] 0709 13:19:15.531009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.569755 (+1038746us) service_pool.cc:224] Handling call
0709 13:19:16.571256 (+  1501us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.572608 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:16.573168 17595 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.577589 20824 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.578338 20824 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:16.581035 20824 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:16.582850 17454 raft_consensus.cc:2368] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:16.584478 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:16.584951 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:16.585810 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:16.585958 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:16.587010 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:16.587052 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:16.587800 17527 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:16.587981 17524 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:16.591073 17595 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:16.591660 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1657) took 1032 ms. Trace:
I20260709 13:19:16.592049 17595 rpcz_store.cc:276] 0709 13:19:15.559176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.572354 (+1013178us) service_pool.cc:224] Handling call
0709 13:19:16.591597 (+ 19243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.593134 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:16.593833 17595 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:16.594583 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1656) took 1035 ms. Trace:
I20260709 13:19:16.594941 17595 rpcz_store.cc:276] 0709 13:19:15.558883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.592851 (+1033968us) service_pool.cc:224] Handling call
0709 13:19:16.594532 (+  1681us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.596208 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:16.596870 17595 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.602397 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:16.606104 17595 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:16.606823 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1665) took 1045 ms. Trace:
I20260709 13:19:16.607230 20824 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:16.607249 17595 rpcz_store.cc:276] 0709 13:19:15.561638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.595955 (+1034317us) service_pool.cc:224] Handling call
0709 13:19:16.606760 (+ 10805us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.608278 20824 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:16.608906 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:16.610219 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1663) took 1049 ms. Trace:
I20260709 13:19:16.610694 20824 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:16.611009 17595 rpcz_store.cc:276] 0709 13:19:15.561007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.608638 (+1047631us) service_pool.cc:224] Handling call
0709 13:19:16.610126 (+  1488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.612010 17568 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:16.612272 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:16.613081 17595 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.617616 17568 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:16.063942 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 199958us
I20260709 13:19:16.620584 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:16.621353 17595 raft_consensus.cc:2410] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:16.621260 20835 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:16.622045 20835 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.622797 17568 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:16.624663 20835 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:16.625077 20797 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:16.625658 20797 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.626387 20835 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:16.627691 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1650) took 1070 ms. Trace:
I20260709 13:19:16.628203 17595 rpcz_store.cc:276] 0709 13:19:15.557379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.611973 (+1054594us) service_pool.cc:224] Handling call
0709 13:19:16.627608 (+ 15635us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.629410 20882 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:16.629282 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:16.629247 17568 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:16.631493 20769 consensus_queue.cc:1059] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:16.633257 17595 raft_consensus.cc:2410] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:16.633759 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1458) took 1098 ms. Trace:
I20260709 13:19:16.634196 17595 rpcz_store.cc:276] 0709 13:19:15.535627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.629006 (+1093379us) service_pool.cc:224] Handling call
0709 13:19:16.633697 (+  4691us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.634696 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:16.635237 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:16.636646 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1446) took 1122 ms. Trace:
I20260709 13:19:16.637133 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:16.635864 20914 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:16.638060 20835 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.638896 20914 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:16.639454 20914 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.639462 17569 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:16.637081 17595 rpcz_store.cc:276] 0709 13:19:15.514728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.634949 (+1120221us) service_pool.cc:224] Handling call
0709 13:19:16.636522 (+  1573us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.632184 20797 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.643828 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:16.645480 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.632709 20882 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.651341 20882 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:16.653659 20917 raft_consensus.cc:3055] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:16.654135 20917 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:16.654997 20917 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.656457 20917 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.656343 20835 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.657325 20835 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:16.653066 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:16.660090 20835 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:16.660679 20835 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.661289 20835 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:16.660499 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:16.664902 20835 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:16.665827 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1452) took 1131 ms. Trace:
I20260709 13:19:16.665581 17595 raft_consensus.cc:2368] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9.
I20260709 13:19:16.666252 17597 rpcz_store.cc:276] 0709 13:19:15.534091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.893472 (+359381us) service_pool.cc:224] Handling call
0709 13:19:16.665767 (+772295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.666661 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1455) took 1131 ms. Trace:
I20260709 13:19:16.667179 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:16.667198 17595 rpcz_store.cc:276] 0709 13:19:15.534846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.643554 (+1108708us) service_pool.cc:224] Handling call
0709 13:19:16.666596 (+ 23042us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.668534 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:16.669139 17597 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:16.669569 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:16.670379 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:16.676844 20797 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.678046 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1449) took 1144 ms. Trace:
I20260709 13:19:16.663954 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:16.678710 17597 rpcz_store.cc:276] 0709 13:19:15.533264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.669834 (+1136570us) service_pool.cc:224] Handling call
0709 13:19:16.677950 (+  8116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.680460 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:16.681952 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:16.682232 18167 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:16.683998 17597 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:16.682621 17595 raft_consensus.cc:1813] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Handling vote request from an unknown peer 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:16.684463 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1451) took 1150 ms. Trace:
I20260709 13:19:16.684952 17595 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:16.685675 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1450) took 1152 ms. Trace:
I20260709 13:19:16.684864 17597 rpcz_store.cc:276] 0709 13:19:15.533800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.681674 (+1147874us) service_pool.cc:224] Handling call
0709 13:19:16.684404 (+  2730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.686091 17595 rpcz_store.cc:276] 0709 13:19:15.533519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.668611 (+1135092us) service_pool.cc:224] Handling call
0709 13:19:16.685618 (+ 17007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.687047 17597 raft_consensus.cc:1240] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:16.687389 17595 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:19:16.687788 17595 pending_rounds.cc:85] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 4
I20260709 13:19:16.687726 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1640) took 1245 ms. Trace:
I20260709 13:19:16.688288 17595 pending_rounds.cc:107] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:16.688635 17595 raft_consensus.cc:2889] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.688428 17597 rpcz_store.cc:276] 0709 13:19:15.442688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.686565 (+1243877us) service_pool.cc:224] Handling call
0709 13:19:16.686853 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.687501 (+   648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.687675 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.689623 18197 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:16.676198 20914 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:16.689685 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1459) took 1153 ms. Trace:
I20260709 13:19:16.700143 17595 rpcz_store.cc:276] 0709 13:19:15.535900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.686835 (+1150935us) service_pool.cc:224] Handling call
0709 13:19:16.687088 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.689317 (+  2229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.689634 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.701450 17595 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:16.702140 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1654) took 1143 ms. Trace:
I20260709 13:19:16.703249 17595 rpcz_store.cc:276] 0709 13:19:15.558384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.700982 (+1142598us) service_pool.cc:224] Handling call
0709 13:19:16.701276 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.701889 (+   613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.702083 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.704020 20882 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.704588 20916 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:16.704779 17595 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:16.706144 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1658) took 1146 ms. Trace:
I20260709 13:19:16.706517 17595 rpcz_store.cc:276] 0709 13:19:15.559497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.704039 (+1144542us) service_pool.cc:224] Handling call
0709 13:19:16.704328 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.705855 (+  1527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.706094 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.707891 17595 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:16.708460 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1659) took 1148 ms. Trace:
I20260709 13:19:16.710335 17595 rpcz_store.cc:276] 0709 13:19:15.559790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.707244 (+1147454us) service_pool.cc:224] Handling call
0709 13:19:16.707580 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.708248 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.708409 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.711756 17595 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:16.716271 20882 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:16.714977 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:16.717228 20916 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:16.717659 17527 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.717753 20916 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:16.722319 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.722405 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:16.722884 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.723214 17524 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:16.723428 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.723845 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.724841 20835 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:16.716766 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1660) took 1156 ms. Trace:
I20260709 13:19:16.725310 20835 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.725693 17595 rpcz_store.cc:276] 0709 13:19:15.560105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.711154 (+1151049us) service_pool.cc:224] Handling call
0709 13:19:16.711447 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.716501 (+  5054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.716697 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.727166 17595 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:16.709897 20797 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:16.727990 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1662) took 1167 ms. Trace:
I20260709 13:19:16.728128 20797 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:16.708791 20769 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:16.728643 20797 raft_consensus.cc:697] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:16.728906 17527 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:16.729161 20769 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:16.690748 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:16.730106 20882 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:16.692968 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1647) took 2326 ms. Trace:
I20260709 13:19:16.730607 20882 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:16.730710 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:16.696729 17601 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:16.732175 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:16.732398 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1652) took 1174 ms. Trace:
I20260709 13:19:16.732920 17601 rpcz_store.cc:276] 0709 13:19:15.557850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.696226 (+1138376us) service_pool.cc:224] Handling call
0709 13:19:16.696545 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.732096 (+ 35551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.732334 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.727233 20915 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.733841 17568 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:16.734484 20915 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.735762 20769 raft_consensus.cc:697] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:16.730754 17522 rpcz_store.cc:276] 0709 13:19:14.366769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.481832 (+115063us) service_pool.cc:224] Handling call
0709 13:19:14.509691 (+ 27859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.779657 (+269966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.779687 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.780320 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.929172 (+148852us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:14.929222 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.692334 (+1763112us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400230ad4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:16.692377 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.692420 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:16.692431 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.692783 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45714,"raft.queue_time_us":270997,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2488,"spinlock_wait_cycles":393825664,"thread_start_us":184193,"threads_started":2,"wal-append.queue_time_us":172042,"wal-append.run_cpu_time_us":2862,"wal-append.run_wall_time_us":1168062}
I20260709 13:19:16.740115 20769 consensus_queue.cc:237] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.731462 20882 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.729584 20797 consensus_queue.cc:237] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.692253 20914 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:16.746366 20914 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:16.746956 20914 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.747407 20914 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.748152 20835 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:16.749177 20835 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:16.749711 20835 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:16.690593 17597 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:16.750202 17597 pending_rounds.cc:85] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 5
I20260709 13:19:16.750701 17597 pending_rounds.cc:107] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:16.750985 17597 raft_consensus.cc:2889] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.751852 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1648) took 1195 ms. Trace:
I20260709 13:19:16.752202 17597 rpcz_store.cc:276] 0709 13:19:15.556700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.689781 (+1133081us) service_pool.cc:224] Handling call
0709 13:19:16.690237 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.751607 (+ 61370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.751799 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.754099 17525 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:16.756263 20712 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:16.757095 20712 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:16.757483 20915 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:16.748648 17601 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:16.762319 20835 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.764513 20784 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:16.728332 17595 rpcz_store.cc:276] 0709 13:19:15.560712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.726610 (+1165898us) service_pool.cc:224] Handling call
0709 13:19:16.726928 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.727737 (+   809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.727940 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.765054 20784 raft_consensus.cc:697] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:16.765105 20914 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.698834 20903 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:16.771195 20916 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.771755 20903 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.772181 20903 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.773649 20916 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:16.728945 17454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1565) took 1485 ms (client timeout 1926 ms). Trace:
W20260709 13:19:16.801853 17454 rpcz_store.cc:269] 0709 13:19:15.243985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.504623 (+260638us) service_pool.cc:224] Handling call
0709 13:19:16.728748 (+1224125us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54001856d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:16.728878 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890071424}
I20260709 13:19:16.803416 17454 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 9. Ops: []
I20260709 13:19:16.803987 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1550) took 1567 ms. Trace:
I20260709 13:19:16.804302 17454 rpcz_store.cc:276] 0709 13:19:15.236414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.802909 (+1566495us) service_pool.cc:224] Handling call
0709 13:19:16.803229 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.803776 (+   547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.803939 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.804983 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 295) took 1944 ms. Trace:
I20260709 13:19:16.805588 17449 rpcz_store.cc:276] 0709 13:19:14.860121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.923919 (+1063798us) service_pool.cc:224] Handling call
0709 13:19:16.804287 (+880368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.804534 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.804589 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.804648 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:16.804698 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.804775 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.804904 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.806946 17449 raft_consensus.cc:1240] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:16.807524 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1555) took 1569 ms. Trace:
I20260709 13:19:16.807808 17449 rpcz_store.cc:276] 0709 13:19:15.237973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.806535 (+1568562us) service_pool.cc:224] Handling call
0709 13:19:16.806794 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.807285 (+   491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.807473 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.046496 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:16.808885 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1903) took 1040 ms. Trace:
I20260709 13:19:16.809012 17449 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:16.809222 17446 rpcz_store.cc:276] 0709 13:19:15.768456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.925066 (+156610us) service_pool.cc:224] Handling call
0709 13:19:16.808812 (+883746us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.809577 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1557) took 1570 ms. Trace:
I20260709 13:19:16.805569 17454 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:16.810827 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1554) took 1573 ms. Trace:
I20260709 13:19:16.811182 17454 rpcz_store.cc:276] 0709 13:19:15.237674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.805106 (+1567432us) service_pool.cc:224] Handling call
0709 13:19:16.805385 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.810595 (+  5210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.810772 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.809890 17449 rpcz_store.cc:276] 0709 13:19:15.238696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.808605 (+1569909us) service_pool.cc:224] Handling call
0709 13:19:16.808862 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.809367 (+   505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.809534 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.814867 17449 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:16.815449 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1560) took 1575 ms. Trace:
I20260709 13:19:16.815778 17449 rpcz_store.cc:276] 0709 13:19:15.239592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.814253 (+1574661us) service_pool.cc:224] Handling call
0709 13:19:16.814550 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.815221 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.815382 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.765828 17524 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:16.786322 20914 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:16.790109 20892 consensus_queue.cc:1059] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:16.818205 20892 raft_consensus.cc:3055] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:16.818653 20892 raft_consensus.cc:740] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:19:16.818861 17521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.016s	sys 0.064s
W20260709 13:19:16.819252 17521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.016s	sys 0.064s
I20260709 13:19:16.820062 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1650) took 1993 ms. Trace:
I20260709 13:19:16.819736 20892 consensus_queue.cc:260] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:16.821120 20892 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.820438 17521 rpcz_store.cc:276] 0709 13:19:14.826416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.841752 (+ 15336us) service_pool.cc:224] Handling call
0709 13:19:14.842149 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.912519 (+ 70370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.912551 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.963871 (+ 51320us) log.cc:844] Serialized 26 byte log entry
0709 13:19:16.092892 (+1129021us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b18003c6580. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab57060d1 00007f5ab5b21a0f
0709 13:19:16.819601 (+726709us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:16.819644 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.819714 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.819760 (+    46us) raft_consensus.cc:1685] finished
0709 13:19:16.819774 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.819993 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83074,"raft.queue_time_us":150794,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":2906,"spinlock_wait_cycles":77672704,"thread_start_us":726525,"threads_started":1,"wal-append.queue_time_us":1419299}
I20260709 13:19:15.972396 17448 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:16.823184 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1564) took 1579 ms. Trace:
I20260709 13:19:16.823652 17448 rpcz_store.cc:276] 0709 13:19:15.243629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.889530 (+645901us) service_pool.cc:224] Handling call
0709 13:19:16.823099 (+933569us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.825237 17448 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:16.757587 20712 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.826573 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1457) took 1291 ms. Trace:
I20260709 13:19:16.839665 17598 rpcz_store.cc:276] 0709 13:19:15.535363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.884091 (+348728us) service_pool.cc:224] Handling call
0709 13:19:16.826484 (+942393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.827052 20824 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:16.826014 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1562) took 1585 ms. Trace:
I20260709 13:19:16.844678 17448 rpcz_store.cc:276] 0709 13:19:15.240191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.824499 (+1584308us) service_pool.cc:224] Handling call
0709 13:19:16.824934 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.825713 (+   779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.825948 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:16.827790 17339 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet e57fe371976a485bbdedfdaa4659dec3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 5 but the committed config has opid_index of 8
I20260709 13:19:16.847914 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:16.835832 17446 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:16.696236 17451 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:16.838678 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:16.853538 17596 consensus_meta.cc:287] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.960s	user 0.013s	sys 0.000s
I20260709 13:19:16.855923 20914 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:16.842594 20784 consensus_queue.cc:237] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.858255 18193 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:19:16.866478 18193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42538 (request call id 335) took 1033 ms. Trace:
I20260709 13:19:16.868686 18193 rpcz_store.cc:276] 0709 13:19:15.837974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.844461 (+  6487us) service_pool.cc:224] Handling call
0709 13:19:16.847738 (+1003277us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b5800003c98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:19:16.866360 (+ 18622us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45264256}
I20260709 13:19:16.858603 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1558) took 1619 ms. Trace:
I20260709 13:19:16.871598 17446 rpcz_store.cc:276] 0709 13:19:15.238971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.809854 (+1570883us) service_pool.cc:224] Handling call
0709 13:19:16.835560 (+ 25706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.858255 (+ 22695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.858514 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.873543 17446 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:16.859382 17596 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:16.876739 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1649) took 1319 ms. Trace:
I20260709 13:19:16.877151 17596 rpcz_store.cc:276] 0709 13:19:15.557108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.892122 (+335014us) service_pool.cc:224] Handling call
0709 13:19:16.876657 (+984535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.878067 20887 raft_consensus.cc:2764] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:16.002660 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:16.879279 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1647) took 1329 ms. Trace:
I20260709 13:19:16.879719 17603 rpcz_store.cc:276] 0709 13:19:15.549980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.902829 (+352849us) service_pool.cc:224] Handling call
0709 13:19:16.879207 (+976378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.859686 20914 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:16.882812 20914 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:16.859336 17521 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.857999 17448 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:16.887787 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1570) took 1635 ms. Trace:
W20260709 13:19:16.887898 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.896893 17596 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:16.897344 17453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:19:16.897915 17453 raft_consensus.cc:606] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:16.898758 17596 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:16.899123 17453 raft_consensus.cc:614] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:16.899657 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43246 (request call id 5) took 1665 ms. Trace:
I20260709 13:19:16.899963 17453 rpcz_store.cc:276] 0709 13:19:15.234491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.921626 (+687135us) service_pool.cc:224] Handling call
0709 13:19:16.899551 (+977925us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.901336 17453 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:16.898759 17528 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:16.902469 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:16.902686 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:16.891987 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1892) took 2033 ms. Trace:
I20260709 13:19:16.903072 17520 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:19:16.898702 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:16.901818 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1899) took 1134 ms. Trace:
I20260709 13:19:16.904086 17524 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.904238 17453 rpcz_store.cc:276] 0709 13:19:15.767495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.900775 (+1133280us) service_pool.cc:224] Handling call
0709 13:19:16.901029 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.901627 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.901774 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.904892 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:16.905490 17453 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:16.906421 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:16.906628 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1901) took 1138 ms. Trace:
I20260709 13:19:16.906977 17602 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:16.907039 17453 rpcz_store.cc:276] 0709 13:19:15.768041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.905050 (+1137009us) service_pool.cc:224] Handling call
0709 13:19:16.905328 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.905882 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.906572 (+   690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.908221 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:16.908663 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1907) took 1139 ms. Trace:
I20260709 13:19:16.909030 17453 rpcz_store.cc:276] 0709 13:19:15.769267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.907933 (+1138666us) service_pool.cc:224] Handling call
0709 13:19:16.908189 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.908347 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.908373 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.908413 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:16.908451 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.908503 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.908610 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.909574 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:16.910176 20846 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:16.910815 20846 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:16.911182 17451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1548) took 1675 ms (client timeout 2215 ms). Trace:
I20260709 13:19:16.894284 20888 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:16.904232 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:16.903324 17525 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:16.895408 20849 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:16.896082 20863 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.912827 20846 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:16.912704 20863 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:16.913551 17451 rpcz_store.cc:269] 0709 13:19:15.235764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.780378 (+544614us) service_pool.cc:224] Handling call
0709 13:19:16.911033 (+1130655us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b540030ff54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:16.911129 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020567808}
I20260709 13:19:16.914786 20863 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:16.915122 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 297) took 1074 ms. Trace:
I20260709 13:19:16.915504 20802 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:16.916430 18166 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:16.917248 20227 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:16.905690 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:16.918097 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 80072.6us
I20260709 13:19:16.917671 20227 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:16.920292 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:16.920909 17523 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:19:16.924242 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1909) took 1154 ms. Trace:
I20260709 13:19:16.924688 17445 rpcz_store.cc:276] 0709 13:19:15.769714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.906338 (+136624us) service_pool.cc:224] Handling call
0709 13:19:16.924168 (+1017830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:15.928263 17600 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
W20260709 13:19:16.927423 17600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1653) took 1369 ms (client timeout 1754 ms). Trace:
W20260709 13:19:16.927798 17600 rpcz_store.cc:269] 0709 13:19:15.558120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.841131 (+283011us) service_pool.cc:224] Handling call
0709 13:19:16.927346 (+1086215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.919951 20227 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:16.936543 17447 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 1890) took 2079 ms (client timeout 1866 ms). Trace:
W20260709 13:19:16.937047 17447 rpcz_store.cc:269] 0709 13:19:14.857522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.866942 (+  9420us) service_pool.cc:224] Handling call
0709 13:19:16.936285 (+2069343us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b5400192b54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:16.936436 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504536960}
I20260709 13:19:16.939235 20841 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:16.886673 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1569) took 1639 ms. Trace:
I20260709 13:19:16.940281 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:16.941133 17529 raft_consensus.cc:2393] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:16.953982 20824 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.954568 20824 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.916931 17524 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:16.958849 18166 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:16.960001 20488 raft_consensus.cc:2804] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:16.960529 20488 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.960907 20488 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.962131 20712 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:16.963922 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1439) took 1599 ms. Trace:
I20260709 13:19:16.964336 17594 rpcz_store.cc:276] 0709 13:19:15.364688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.507577 (+142889us) service_pool.cc:224] Handling call
0709 13:19:15.531077 (+ 23500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:15.855057 (+323980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.963663 (+1108606us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54002a85d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:16.963856 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742688512}
I20260709 13:19:16.965204 20712 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:16.967516 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 1.40847e+06us
I20260709 13:19:16.969131 20488 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:16.970680 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:16.971975 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:16.972724 17526 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:16.972857 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:16.973513 17528 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.915525 17451 rpcz_store.cc:276] 0709 13:19:15.840537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.914360 (+1073823us) service_pool.cc:224] Handling call
0709 13:19:16.914626 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.914785 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.914810 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.914852 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:16.914904 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.914978 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.915072 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.980449 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1895) took 2121 ms. Trace:
W20260709 13:19:16.984135 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 320243us
I20260709 13:19:16.985306 17569 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:16.980880 17452 rpcz_store.cc:276] 0709 13:19:14.858952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.962999 (+104047us) service_pool.cc:224] Handling call
0709 13:19:14.963327 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:15.137626 (+174299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.137672 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:15.565432 (+427760us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b2c000014c8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446f372 00007f5ab5ba1a01 00007f5ab5b6643a 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2
0709 13:19:15.565934 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.802298 (+236364us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:15.828800 (+ 26502us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.980026 (+1151226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.980121 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.980161 (+    40us) raft_consensus.cc:1685] finished
0709 13:19:16.980249 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.980386 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1167921,"prepare.queue_time_us":26941,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":22638,"raft.queue_time_us":203287,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":14809,"spinlock_wait_cycles":35516160,"thread_start_us":282242,"threads_started":2,"wal-append.queue_time_us":457783}
I20260709 13:19:16.984735 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:16.989131 17529 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:16.903425 17450 rpcz_store.cc:276] 0709 13:19:14.858123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.875700 (+ 17577us) service_pool.cc:224] Handling call
0709 13:19:14.876015 (+   315us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:15.002689 (+126674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.002733 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:15.042494 (+ 39761us) log.cc:844] Serialized 78 byte log entry
0709 13:19:15.197729 (+155235us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:15.218764 (+ 21035us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.307619 (+ 88855us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.488466 (+180847us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.891187 (+1402721us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b18004384c0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab29f3c0a 00007f5abc133219 00007f5ab2a7ba40 00007f5ab2a764e4 00007f5ab2a76455 00007f5ab5b5e060 00007f5ab5b70716 00007f5ab5b81287 00007f5ab5b81208
0709 13:19:16.891425 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.891658 (+   233us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.891717 (+    59us) raft_consensus.cc:1685] finished
0709 13:19:16.891735 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.891916 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136545,"prepare.queue_time_us":25128,"prepare.run_cpu_time_us":163,"prepare.run_wall_time_us":3658,"raft.queue_time_us":336919,"raft.run_cpu_time_us":449,"raft.run_wall_time_us":54379,"spinlock_wait_cycles":73856768,"thread_start_us":416358,"threads_started":3,"wal-append.queue_time_us":445730,"wal-append.run_cpu_time_us":5792,"wal-append.run_wall_time_us":1303226}
I20260709 13:19:16.985396 17603 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:19:16.893493 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 49122.6us
I20260709 13:19:16.917510 17446 rpcz_store.cc:276] 0709 13:19:15.252674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.872707 (+1620033us) service_pool.cc:224] Handling call
0709 13:19:16.873130 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.887474 (+ 14344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.887720 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.994071 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:16.995555 17524 raft_consensus.cc:2393] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:16.940037 17448 rpcz_store.cc:276] 0709 13:19:15.247200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.857273 (+1610073us) service_pool.cc:224] Handling call
0709 13:19:16.857651 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.886324 (+ 28673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.886601 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.996788 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 296) took 1205 ms. Trace:
I20260709 13:19:17.007416 17453 rpcz_store.cc:276] 0709 13:19:15.791007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.909949 (+1118942us) service_pool.cc:224] Handling call
0709 13:19:16.996168 (+ 86219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.996384 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.996420 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.996474 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:16.996526 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.996591 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.996720 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.999511 17528 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
W20260709 13:19:17.032234 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 300101us
I20260709 13:19:17.034451 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:17.035861 20923 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:17.037319 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1559) took 1798 ms. Trace:
I20260709 13:19:17.039506 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:17.039846 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 48047.4us
W20260709 13:19:17.040836 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 55603.4us
I20260709 13:19:17.041071 17568 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:17.037828 17454 rpcz_store.cc:276] 0709 13:19:15.239304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.811958 (+1572654us) service_pool.cc:224] Handling call
0709 13:19:16.812258 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.812476 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.812500 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.812917 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.035177 (+222260us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:17.035224 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.035302 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.037078 (+  1776us) raft_consensus.cc:1685] finished
0709 13:19:17.037099 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.037251 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":221902,"threads_started":1,"wal-append.queue_time_us":222086}
I20260709 13:19:17.052850 17521 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:17.062601 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:17.099220 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:16.988765 20842 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:17.101711 20842 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:17.100497 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:17.096639 20845 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:17.105017 20845 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:17.105342 17568 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:17.106098 20845 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.110652 20769 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:17.112215 17594 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:17.112483 20769 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:17.100340 20846 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:17.102355 20915 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:17.113770 20915 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.114248 20915 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.116334 20227 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:17.118481 20769 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.110802 17597 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:17.121246 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:17.124567 17528 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:17.125105 20488 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:16.988765 20797 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:19:17.121907 17526 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:17.127283 20835 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:17.130318 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:16.983976 20851 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:17.070677 18194 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:17.132892 17528 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:17.084347 20841 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:19:17.086434 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.036896 20923 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:17.143916 17529 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
W20260709 13:19:17.160290 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 73958.1us
I20260709 13:19:17.160465 17568 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:17.074858 20881 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:17.066345 20914 raft_consensus.cc:2764] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:19:17.168571 17528 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:17.170558 18166 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:17.173564 20882 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:17.174398 20882 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.173688 20227 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:17.178519 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.188046 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:17.189620 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:17.164296 20919 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:17.174850 20842 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:17.192255 20914 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.192854 20914 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.194823 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:17.152127 20892 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:17.195851 20892 consensus_queue.cc:1243] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:17.161938 20488 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:19:17.199301 18197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42536 (request call id 228) took 1389 ms (client timeout 1690 ms). Trace:
I20260709 13:19:17.187748 20773 raft_consensus.cc:2804] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:17.200619 20773 raft_consensus.cc:697] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:17.201305 17601 pending_rounds.cc:85] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 7
I20260709 13:19:17.201627 17601 pending_rounds.cc:107] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:19:17.201879 17601 raft_consensus.cc:2889] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:17.201493 20773 consensus_queue.cc:237] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:17.203366 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.203902 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.199896 18197 rpcz_store.cc:269] 0709 13:19:15.810287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.810453 (+   166us) service_pool.cc:224] Handling call
0709 13:19:17.198979 (+1388526us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400438354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:17.199143 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1776758016}
I20260709 13:19:17.180366 20882 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.211987 17528 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:17.214769 20923 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:17.167393 20887 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:19:17.218907 20887 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:17.219388 20887 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:17.220337 20887 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:17.188133 20881 raft_consensus.cc:697] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:17.191110 20784 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.173875 20824 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.195506 20914 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:17.241030 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 53940.4us
I20260709 13:19:17.164860 20903 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:17.247737 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:17.251447 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 97164.9us
I20260709 13:19:17.253988 20775 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:17.254649 17569 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.255358 20770 raft_consensus.cc:1064] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:19:17.260584 17569 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.257436 17528 raft_consensus.cc:2468] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:17.270128 18166 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:17.251854 20887 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.248672 20846 raft_consensus.cc:697] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:17.258059 20797 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:17.282012 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.253232 20914 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:19:17.286264 20944 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:19:17.283139 20947 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:19:17.292580 17569 leader_election.cc:400] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9.
I20260709 13:19:17.293143 17569 leader_election.cc:403] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:19:17.277451 20775 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:17.294592 17528 raft_consensus.cc:3055] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:17.249220 20784 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.276274 20835 raft_consensus.cc:697] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:17.276688 20749 raft_consensus.cc:2804] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:17.298622 17528 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:17.303320 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.261272 20915 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.283440 18193 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:17.295162 20888 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:17.282085 20853 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:19:17.319375 17528 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:17.334456 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.309238 20863 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:17.340832 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.289721 20846 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:17.341008 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 76800.1us
I20260709 13:19:17.335661 18194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42538 (request call id 334) took 1509 ms. Trace:
I20260709 13:19:17.343040 17528 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:17.342734 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.345329 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:17.331248 20940 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:19:17.345149 18194 rpcz_store.cc:276] 0709 13:19:15.826399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.826526 (+   127us) service_pool.cc:224] Handling call
0709 13:19:15.833091 (+  6565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.134314 (+1301223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.335214 (+200900us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54006cf054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:17.335469 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2845448576}
I20260709 13:19:17.317917 20749 raft_consensus.cc:697] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:17.329836 20816 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.302543 20881 consensus_queue.cc:237] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.353744 20784 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:17.354094 20712 consensus_queue.cc:1059] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:17.354965 20712 raft_consensus.cc:3055] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:17.350610 20914 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:17.355530 20712 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:17.349238 20824 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:17.332207 20947 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:19:17.356398 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:17.356880 20816 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.361433 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:17.362828 20816 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:17.363060 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:19:17.363972 18192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42536 (request call id 227) took 1555 ms (client timeout 1583 ms). Trace:
W20260709 13:19:17.364457 18192 rpcz_store.cc:269] 0709 13:19:15.808623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.809679 (+  1056us) service_pool.cc:224] Handling call
0709 13:19:17.362944 (+1553265us) spinlock_profiling.cc:243] Waited 917 us on lock 0x7b5800003c98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41eee 0000000000375939 00007f5abaab51e0 00007f5abab7e0c4 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:19:17.363908 (+   964us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2109824}
I20260709 13:19:17.363601 20712 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.354920 20903 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:17.338140 20948 consensus_queue.cc:1059] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:19:17.357033 20914 raft_consensus.cc:697] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:17.371315 17528 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:19:17.373288 17528 pending_rounds.cc:85] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 4
I20260709 13:19:17.373581 17528 pending_rounds.cc:107] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:17.373879 17528 raft_consensus.cc:2889] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:17.372262 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.346859 20949 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:19:17.369676 20712 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.332026 20945 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:19:17.370379 20955 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:17.399298 20955 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.400120 20955 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.401335 20948 raft_consensus.cc:3055] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:17.401793 20948 raft_consensus.cc:740] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:17.370008 20915 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:17.448138 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 91810.4us
I20260709 13:19:17.450568 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:17.448365 20926 log.cc:927] Time spent T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:19:17.359665 20835 consensus_queue.cc:237] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:17.457947 20950 log.cc:927] Time spent T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:19:17.458803 20952 log.cc:927] Time spent T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:17.453058 20945 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:17.461732 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.437224 20749 consensus_queue.cc:237] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:17.474179 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3f40 after lost signal to thread 16329
W20260709 13:19:17.474772 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7f40 after lost signal to thread 16332
W20260709 13:19:17.475749 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7fc0 after lost signal to thread 17386
W20260709 13:19:17.476080 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3c00 after lost signal to thread 17400
I20260709 13:19:17.466856 20945 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:17.477434 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7700 after lost signal to thread 17478
W20260709 13:19:17.478664 18222 debug-util.cc:398] Leaking SignalData structure 0x7b0800179820 after lost signal to thread 17553
W20260709 13:19:17.479034 18222 debug-util.cc:398] Leaking SignalData structure 0x7b0800310ee0 after lost signal to thread 17554
W20260709 13:19:17.480188 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08002395a0 after lost signal to thread 17627
W20260709 13:19:17.480505 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08001cd700 after lost signal to thread 17628
W20260709 13:19:17.481694 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08003725a0 after lost signal to thread 18225
I20260709 13:19:17.477742 20945 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.455965 20914 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:17.481909 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08000fbf40 after lost signal to thread 18226
W20260709 13:19:17.483042 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08003bcde0 after lost signal to thread 20710
I20260709 13:19:17.485955 20923 raft_consensus.cc:3055] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:17.486465 20923 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:17.487407 20923 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.488783 20923 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.490195 20955 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.492697 20955 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:17.494182 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 194499us
I20260709 13:19:17.495334 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:17.495999 17528 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:17.498697 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.502753 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:17.503366 17596 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:17.503551 20888 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:17.506559 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1580 after lost signal to thread 20716
W20260709 13:19:17.507033 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08003a99a0 after lost signal to thread 20719
W20260709 13:19:17.507213 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.507303 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf260 after lost signal to thread 20720
W20260709 13:19:17.508112 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3460 after lost signal to thread 20771
W20260709 13:19:17.508463 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08003524a0 after lost signal to thread 20792
I20260709 13:19:17.509889 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:17.509923 17527 raft_consensus.cc:3055] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:17.512881 17527 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:17.516681 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:17.518006 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:17.519423 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:17.513741 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:17.521612 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:17.522962 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:17.526192 17594 raft_consensus.cc:2368] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8.
I20260709 13:19:17.474608 20846 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:17.529232 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:17.530435 17599 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:17.532171 17521 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:17.532097 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:17.533161 17603 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:17.543529 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:17.545542 17525 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:17.545957 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:17.528412 17527 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.546962 17528 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:17.547185 17602 raft_consensus.cc:2410] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:17.467809 20882 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.555899 17527 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:17.571864 17520 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:17.573269 17599 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:17.573925 17527 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:17.575204 17596 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:17.576576 18167 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:17.586628 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:17.590173 18222 debug-util.cc:398] Leaking SignalData structure 0x7b0800201980 after lost signal to thread 20834
W20260709 13:19:17.590770 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08003252e0 after lost signal to thread 20844
W20260709 13:19:17.591144 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08001710e0 after lost signal to thread 20847
W20260709 13:19:17.591532 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf680 after lost signal to thread 20856
W20260709 13:19:17.591917 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08000d19c0 after lost signal to thread 20861
W20260709 13:19:17.592278 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08002f46e0 after lost signal to thread 20867
W20260709 13:19:17.592638 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08002f8820 after lost signal to thread 20875
W20260709 13:19:17.593118 18222 debug-util.cc:398] Leaking SignalData structure 0x7b0800314c80 after lost signal to thread 20884
W20260709 13:19:17.593474 18222 debug-util.cc:398] Leaking SignalData structure 0x7b0800283fc0 after lost signal to thread 20889
W20260709 13:19:17.593768 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2880 after lost signal to thread 20890
W20260709 13:19:17.594091 20883 raft_consensus.cc:670] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } [suppressed 5 similar messages]
I20260709 13:19:17.594342 20834 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.595094 20834 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.545356 20846 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:17.600835 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:17.601964 17495 leader_election.cc:400] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8.
I20260709 13:19:17.606652 17495 leader_election.cc:403] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:17.613931 17521 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:17.616508 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:17.617470 17495 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.583s (SENT) [suppressed 11 similar messages]
I20260709 13:19:17.620455 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:17.621449 17596 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.624408 17594 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:17.618443 20955 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:17.608192 20834 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:17.621920 20835 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8.
I20260709 13:19:17.646202 20958 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:17.646883 20958 raft_consensus.cc:697] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:17.630779 20849 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:17.650374 17596 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:17.638617 20863 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9.
I20260709 13:19:17.641687 20955 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.648478 20846 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:17.682178 20955 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.691287 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:17.691794 17352 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 99) took 4693 ms. Trace:
I20260709 13:19:17.693310 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:17.692200 17352 rpcz_store.cc:276] 0709 13:19:12.998842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.999027 (+   185us) service_pool.cc:224] Handling call
0709 13:19:17.691703 (+4692676us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:14.565127 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:14.885120 (+319993us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:14.894403 (+  9283us) write_op.cc:435] Acquired schema lock
0709 13:19:14.897454 (+  3051us) tablet.cc:662] Decoding operations
0709 13:19:15.088760 (+191306us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:15.106648 (+ 17888us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:15.124481 (+ 17833us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:19:15.219827 (+ 95346us) tablet.cc:701] Row locks acquired
0709 13:19:15.245408 (+ 25581us) write_op.cc:260] PREPARE: finished
0709 13:19:15.245583 (+   175us) write_op.cc:270] Start()
0709 13:19:15.245715 (+   132us) write_op.cc:276] Timestamp: P: 1783603155245517 usec, L: 0
0709 13:19:15.245740 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:19:15.246388 (+   648us) log.cc:844] Serialized 2035 byte log entry
0709 13:19:16.184184 (+937796us) op_driver.cc:464] REPLICATION: finished
0709 13:19:16.419835 (+235651us) write_op.cc:301] APPLY: starting
0709 13:19:16.419925 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:16.420108 (+   183us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:16.420223 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:16.420823 (+   600us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:16.421053 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:19:16.421097 (+    44us) write_op.cc:312] APPLY: finished
0709 13:19:16.421327 (+   230us) log.cc:844] Serialized 47 byte log entry
0709 13:19:16.422129 (+   802us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:16.422228 (+    99us) write_op.cc:454] Released schema lock
0709 13:19:16.422268 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:16.422656 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:16.422683 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63486,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":235381,"apply.run_cpu_time_us":2180,"apply.run_wall_time_us":2789,"num_ops":5,"prepare.queue_time_us":162318,"prepare.run_cpu_time_us":31436,"prepare.run_wall_time_us":778187,"raft.queue_time_us":307117,"raft.run_cpu_time_us":62274,"raft.run_wall_time_us":236358,"replication_time_us":938254,"thread_start_us":661326,"threads_started":4,"wal-append.queue_time_us":275455,"wal-append.run_cpu_time_us":163321,"wal-append.run_wall_time_us":1912660}]]}
I20260709 13:19:17.681133 17419 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:17.698336 17597 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:17.704182 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:17.706216 20834 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.706727 20834 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:17.708664 20834 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:17.709102 20834 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:17.709703 17598 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:17.710295 20869 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.697371 20955 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.710798 20869 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.712859 20869 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:17.713560 20955 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:17.714924 20875 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.679131 20849 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:17.718390 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.719017 17454 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:17.720147 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.720743 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:17.721164 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.721500 17451 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:17.722806 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.723599 17451 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:17.724408 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:17.723621 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.725373 17445 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.727195 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:17.728379 17451 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:17.731637 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.735363 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.735710 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.736570 17450 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:17.740036 17419 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:17.740993 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:17.737871 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.742426 17450 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 6.
I20260709 13:19:17.715370 20875 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.763366 17420 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.686420 20851 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:17.709537 20834 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:17.750279 17448 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:17.757391 17445 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:17.698398 20816 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:17.801623 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 61636.5us
I20260709 13:19:17.761024 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:17.762681 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.680966 20847 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:17.767463 17521 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:17.770759 20884 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:17.778208 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.807727 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 126557us
I20260709 13:19:17.778880 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:17.780925 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.783169 20849 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:17.787492 20882 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:17.739125 20720 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:17.791604 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:17.858474 17526 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:17.792449 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.805135 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:17.807179 17446 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:17.859421 17595 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:17.829910 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.648129 20958 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.801395 20856 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:17.856644 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:17.864643 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.870090 17451 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
W20260709 13:19:17.855268 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 74453.8us
W20260709 13:19:17.872897 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 255421us
I20260709 13:19:17.879040 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:17.806934 20771 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:17.804661 20716 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:17.858732 20824 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:17.898661 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:17.900306 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.804661 20851 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.902403 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:17.906561 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:17.907862 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:17.858203 20923 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:17.860666 20720 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.913173 17569 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.871390 20861 raft_consensus.cc:2764] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:17.915563 17448 raft_consensus.cc:3060] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:17.806924 20816 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.869516 20889 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:17.913913 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.903383 20775 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:17.920425 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.811327 20847 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:17.921530 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
W20260709 13:19:17.928997 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 127941us
I20260709 13:19:17.922262 20797 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:17.909816 20771 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:17.929023 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 126511us
I20260709 13:19:17.912269 20716 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.931710 17419 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:17.932217 20971 log.cc:927] Time spent T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:19:17.933017 20716 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:17.933542 20964 log.cc:927] Time spent T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:19:17.936180 20847 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:17.918046 20892 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:17.936580 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.871544 20884 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:17.937774 20969 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:19:17.925966 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:17.899781 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:17.926515 18167 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.929737 17569 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.960677 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.912221 20863 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:17.923571 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.965090 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:17.967283 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:17.922724 20775 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:17.938835 20884 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:17.939311 17454 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:17.920213 20923 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:17.951687 20797 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:17.942821 20970 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:19:17.943590 20942 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.786s	user 0.007s	sys 0.000s
I20260709 13:19:17.944525 17448 raft_consensus.cc:2468] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:17.946790 17520 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:17.949029 20816 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:17.917825 20720 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.969197 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:17.985359 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:17.985589 17526 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:17.986120 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:17.970535 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.971227 17601 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:19:17.988070 17601 pending_rounds.cc:85] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 6
I20260709 13:19:17.988504 17601 pending_rounds.cc:107] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:19:17.971450 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:17.930012 20824 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:17.899807 20890 consensus_queue.cc:1059] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:19:17.929845 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.928448 20889 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:17.942427 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:17.880352 20856 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:17.959784 20861 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:17.978132 17569 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.973531 20845 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:17.988950 17601 raft_consensus.cc:2889] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:17.976114 20769 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:17.974001 20892 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:17.990350 20773 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:17.990639 20851 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:17.991834 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1561) took 2752 ms. Trace:
I20260709 13:19:17.994971 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:17.973800 20846 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:18.020923 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:17.997614 17520 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:17.999347 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 69581.5us
I20260709 13:19:17.974213 20775 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:17.983453 20797 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.008520 17569 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:17.998399 20955 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:17.985639 20863 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:19:18.019124 17449 rpcz_store.cc:276] 0709 13:19:15.239908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.816505 (+1576597us) service_pool.cc:224] Handling call
0709 13:19:16.816854 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:17.647191 (+830337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.647233 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:17.647880 (+   647us) log.cc:844] Serialized 52 byte log entry
0709 13:19:17.913928 (+266048us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:17.913976 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.914166 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.991614 (+ 77448us) raft_consensus.cc:1685] finished
0709 13:19:17.991634 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.991771 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":875495,"raft.queue_time_us":857700,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":10762,"thread_start_us":265641,"threads_started":1,"wal-append.queue_time_us":301953}
I20260709 13:19:18.005271 20816 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:18.006275 20890 consensus_queue.cc:1243] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer 2158c0f750fd4b21afe24135c52167b2 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:18.002750 20845 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:18.024726 17521 raft_consensus.cc:1240] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:18.012229 20824 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.010814 20861 raft_consensus.cc:697] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:18.031227 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:18.032857 17449 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.033556 17420 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.022773 20945 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:18.035979 20960 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:18.038123 20816 consensus_queue.cc:1059] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:18.042488 17449 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:18.023582 20835 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:18.048062 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.050729 20816 consensus_queue.cc:1243] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:18.050937 20869 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:18.051261 20883 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:18.051493 20890 raft_consensus.cc:2764] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:18.051779 20856 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:18.032678 20845 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.053421 17420 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.054294 20856 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:18.032498 20887 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:18.058897 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:18.059468 17521 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:18.060283 17420 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.061321 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:18.067010 20856 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:18.077405 17521 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:18.046324 20889 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:18.082809 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:18.070420 20856 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:18.058607 20945 raft_consensus.cc:697] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:18.047936 20875 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:18.063534 20887 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:18.086001 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.091207 20887 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:18.111644 20856 raft_consensus.cc:697] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:18.090934 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:18.119204 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.144863 20976 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.145219 17420 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.120157 20816 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:18.146636 20923 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:18.147469 20816 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:18.105423 20861 consensus_queue.cc:237] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:18.094772 20890 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:18.150295 20890 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.136457 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:18.150388 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:18.105522 20771 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:18.152834 20919 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:18.153144 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:18.153514 20919 raft_consensus.cc:697] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:18.153810 17525 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:18.145444 20945 consensus_queue.cc:237] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:18.150738 20890 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.154461 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:18.154682 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:18.168613 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:18.169229 20919 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:18.173923 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:18.174966 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:18.156217 17419 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:18.157608 18197 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:18.139148 20720 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:18.161924 17420 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.185513 17420 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.169638 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:18.154747 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.188171 17527 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:18.191386 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:18.192085 18193 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 3.
I20260709 13:19:18.194047 17454 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:18.195366 17454 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:18.198359 17569 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.204315 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:18.204916 17420 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.193502 20890 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:18.210079 17446 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:18.214602 20887 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:18.218205 20769 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:18.219945 20769 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:18.222443 17451 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:18.224067 17451 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:19:18.229635 20979 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.179s	user 0.000s	sys 0.003s
I20260709 13:19:18.239287 17452 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:18.240916 17445 raft_consensus.cc:3055] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:18.294915 17445 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:18.295918 17445 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:18.297348 17445 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:18.250777 18194 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:18.259300 17528 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:18.278671 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.300187 17597 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:18.301908 17597 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:18.289916 20834 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:18.303808 17597 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:18.282675 17594 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:18.284162 17600 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:18.314935 20773 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:18.318393 20773 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:18.320875 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.288239 17453 raft_consensus.cc:1275] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:18.217808 17448 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:18.291992 17529 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:18.280421 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:18.335019 17451 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:18.336766 20772 consensus_queue.cc:1048] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:19:18.343546 17598 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.141467 20856 consensus_queue.cc:237] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:18.355075 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 144834us
I20260709 13:19:18.197130 20859 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:18.374598 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 162213us
I20260709 13:19:18.379048 17420 leader_election.cc:400] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9.
I20260709 13:19:18.203876 20882 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.379953 17419 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:18.201980 20797 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:18.209892 20816 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:18.210779 20960 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:19:18.410426 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.425999 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46098.6us
I20260709 13:19:18.374576 20772 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.374670 20859 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:18.436664 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.464118 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.354681 20869 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:19:18.354405 20884 consensus_queue.cc:1059] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:19:18.469113 20710 raft_consensus.cc:3055] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:18.469678 20710 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:18.479492 20890 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:18.487110 20720 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:18.494869 17523 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:18.501039 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:18.502251 17529 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:18.380003 17420 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.437613 17598 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:18.377246 20875 raft_consensus.cc:2764] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:18.431418 20851 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:18.432883 20960 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:18.513612 20851 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.513805 20960 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.514129 20851 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.515602 20948 consensus_queue.cc:260] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:18.517192 20948 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:18.517275 20845 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:18.516463 20797 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:18.518440 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:18.519343 17527 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:18.519860 20845 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:18.520233 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:18.492895 20772 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:18.521904 20977 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:19:18.525898 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.379014 20870 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:19:18.359079 20976 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 13:19:18.527559 20887 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:18.546922 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.549103 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45417.4us
I20260709 13:19:18.494072 20859 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.552431 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:18.558055 17451 raft_consensus.cc:3055] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:18.558611 17451 raft_consensus.cc:740] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:18.575763 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 195812us
I20260709 13:19:18.576894 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.579869 20875 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.583784 17420 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:18.549250 20720 consensus_queue.cc:1059] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:19:18.574354 17451 consensus_queue.cc:260] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:18.594739 17452 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:18.605388 17452 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:18.586913 20719 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.580161 20870 consensus_queue.cc:1243] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:18.559288 20797 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:19:18.612807 17451 raft_consensus.cc:3060] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.617363 17452 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:18.576960 20845 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:18.660804 17452 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:18.603542 20951 raft_consensus.cc:2764] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:19:18.585402 20882 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:19:18.619397 20720 consensus_queue.cc:1243] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:19:18.675935 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 461823us
I20260709 13:19:18.677304 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:18.604581 20976 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 13:19:18.683957 17447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.014s	sys 0.031s
I20260709 13:19:18.652427 20870 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:18.607548 20754 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:19:18.685523 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:18.616223 20881 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:19:18.698885 18194 raft_consensus.cc:2393] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
W20260709 13:19:18.695144 17447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.014s	sys 0.031s
W20260709 13:19:18.703354 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.712396 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.713209 17596 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:18.716051 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:18.717649 17595 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:18.726197 17595 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:18.732753 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:18.736375 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.738320 17600 raft_consensus.cc:2410] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:18.739830 17595 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.775381 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.787992 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:18.788818 17599 raft_consensus.cc:2393] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:18.789573 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.778954 17452 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:18.783118 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.794142 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.796447 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.785362 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.783497 17451 raft_consensus.cc:1275] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:19:18.805202 20890 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:19:18.805678 17599 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:18.806546 17603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.008s	sys 0.024s
I20260709 13:19:18.806401 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.811643 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.810393 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.787266 20792 raft_consensus.cc:3055] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:18.794811 20772 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:18.813988 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:18.807088 20863 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.021s
I20260709 13:19:18.814847 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:18.813606 17603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.008s	sys 0.024s
I20260709 13:19:18.831321 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.834683 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:18.855372 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.857215 17597 raft_consensus.cc:1217] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[7.8-10.9]   Dedup: 10.9->[]
I20260709 13:19:18.858561 17600 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
W20260709 13:19:18.901947 17454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.010s	sys 0.027s
I20260709 13:19:18.743856 20870 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:18.931663 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.893338 17595 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:18.805719 20771 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.938723 17450 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:18.939210 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:18.935201 17454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.014s	sys 0.027s
W20260709 13:19:18.825496 20955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.017s	sys 0.010s
I20260709 13:19:18.934217 17597 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: [7.8-10.9]
I20260709 13:19:18.939281 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:18.940384 17596 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:18.952790 17595 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:19:18.829981 20889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.009s	sys 0.023s
W20260709 13:19:18.846127 20958 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.004s	sys 0.022s
W20260709 13:19:18.930578 20919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.016s	sys 0.013s
W20260709 13:19:18.842437 20846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.011s	sys 0.015s
I20260709 13:19:18.959386 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:18.976903 17599 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:18.963766 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:18.938179 20863 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.008s	sys 0.033s
I20260709 13:19:18.824656 20792 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:18.790266 20985 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 13:19:18.956566 20955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.023s	sys 0.015s
I20260709 13:19:18.937714 20824 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:18.960528 20889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.018s	sys 0.037s
I20260709 13:19:18.991221 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.016182 17450 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:18.970081 20958 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.008s	sys 0.023s
I20260709 13:19:18.955288 20882 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.959340 17436 tablet_service.cc:1558] Processing DeleteTablet for tablet e57fe371976a485bbdedfdaa4659dec3 with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:55872
I20260709 13:19:19.016909 20882 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.019663 20882 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:19.022644 20792 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.024117 20792 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:19.027585 20870 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:19.029280 20775 consensus_meta.cc:287] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.001s	user 0.010s	sys 0.002s
I20260709 13:19:19.029846 20775 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:19.032583 20775 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:19.034752 17602 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:19.036509 20986 log.cc:927] Time spent T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.340s	user 0.000s	sys 0.000s
W20260709 13:19:19.040261 20988 log.cc:927] Time spent T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:19.058176 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1930) took 1290 ms. Trace:
I20260709 13:19:19.058709 17449 rpcz_store.cc:276] 0709 13:19:17.768083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.068842 (+300759us) service_pool.cc:224] Handling call
0709 13:19:18.069135 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.072345 (+  3210us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:18.100016 (+ 27671us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.586371 (+486355us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.657889 (+ 71518us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.658130 (+   241us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:18.658487 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.668789 (+ 10302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.668905 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.057876 (+388971us) raft_consensus.cc:1685] finished
0709 13:19:19.057904 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.058096 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13301,"prepare.queue_time_us":26570,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":20656,"raft.queue_time_us":13097,"raft.run_cpu_time_us":538,"raft.run_wall_time_us":34153,"spinlock_wait_cycles":5677824,"thread_start_us":448855,"threads_started":1,"wal-append.queue_time_us":688686}
I20260709 13:19:19.051142 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.062700 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:19.047278 20945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.023s	sys 0.027s
I20260709 13:19:19.067796 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:18.976468 20846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.013s	sys 0.017s
I20260709 13:19:19.084347 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:19.064471 20945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.024s	sys 0.027s
I20260709 13:19:19.100486 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.102197 17449 raft_consensus.cc:2368] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11.
I20260709 13:19:19.103129 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:19.105720 17568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.015s	sys 0.038s
W20260709 13:19:19.106227 17568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.016s	sys 0.038s
W20260709 13:19:19.106580 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 528041us
I20260709 13:19:19.042861 20919 consensus_queue.cc:1059] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:19:19.096798 20987 log.cc:927] Time spent T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
W20260709 13:19:19.113474 17526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.008s	sys 0.030s
I20260709 13:19:19.115281 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:19.168129 17526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.009s	sys 0.030s
I20260709 13:19:19.190682 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1676) took 1095 ms. Trace:
I20260709 13:19:19.194929 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:19.176753 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 54505.3us
I20260709 13:19:19.198371 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.199505 17449 raft_consensus.cc:2376] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8. Re-sending same reply.
I20260709 13:19:19.200770 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.201503 17449 raft_consensus.cc:2376] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9. Re-sending same reply.
I20260709 13:19:19.205669 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:19.191432 17526 rpcz_store.cc:276] 0709 13:19:18.095322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.095608 (+   286us) service_pool.cc:224] Handling call
0709 13:19:18.096003 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.096281 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:18.606892 (+510611us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.189882 (+582990us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.190248 (+   366us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:19.190323 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.190421 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.190598 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34059,"prepare.queue_time_us":76728,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"thread_start_us":999706,"threads_started":2}
W20260709 13:19:19.217622 17446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.019s	sys 0.007s
W20260709 13:19:19.254457 17446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.023s	sys 0.010s
I20260709 13:19:19.258307 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1931) took 1489 ms. Trace:
I20260709 13:19:19.262866 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1949) took 1110 ms. Trace:
I20260709 13:19:19.281004 17448 rpcz_store.cc:276] 0709 13:19:18.152454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.339585 (+187131us) service_pool.cc:224] Handling call
0709 13:19:18.339914 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.340181 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.340216 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.340783 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.796708 (+455925us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:18.796752 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.796821 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.262557 (+465736us) raft_consensus.cc:1685] finished
0709 13:19:19.262590 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.262790 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":455524,"threads_started":1,"wal-append.queue_time_us":848136}
I20260709 13:19:19.258890 17447 rpcz_store.cc:276] 0709 13:19:17.768469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.147339 (+378870us) service_pool.cc:224] Handling call
0709 13:19:18.147700 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:18.148057 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.148117 (+    60us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:18.148890 (+   773us) log.cc:844] Serialized 52 byte log entry
0709 13:19:18.701003 (+552113us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:18.801648 (+100645us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.802075 (+   427us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.803497 (+  1422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.803610 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.257993 (+454383us) raft_consensus.cc:1685] finished
0709 13:19:19.258036 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.258228 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1179,"prepare.queue_time_us":152056,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2392,"raft.queue_time_us":5086,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":9464,"spinlock_wait_cycles":288576512,"thread_start_us":551615,"threads_started":1,"wal-append.queue_time_us":1105923}
I20260709 13:19:19.283855 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.285243 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.211306 20919 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:19:19.264652 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 412) took 1199 ms. Trace:
I20260709 13:19:19.173009 20875 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:19.280018 17495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.006s	sys 0.079s
W20260709 13:19:19.293362 17495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.007s	sys 0.079s
I20260709 13:19:19.291577 17601 rpcz_store.cc:276] 0709 13:19:18.065335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.065523 (+   188us) service_pool.cc:224] Handling call
0709 13:19:18.065919 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.075921 (+ 10002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.075953 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.076427 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.439351 (+362924us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:18.439410 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.439507 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.250736 (+811229us) raft_consensus.cc:1685] finished
0709 13:19:19.250767 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.264565 (+ 13798us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21295,"raft.queue_time_us":14218,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4410,"thread_start_us":357358,"threads_started":1,"wal-append.queue_time_us":586127}
W20260709 13:19:19.298676 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.299145 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.302671 20846 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:19.303236 20846 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.289970 17447 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:19.315884 17493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.009s	sys 0.017s
W20260709 13:19:19.316440 17493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.009s	sys 0.017s
W20260709 13:19:19.317600 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.317508 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:19.315270 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 95191us
I20260709 13:19:19.333300 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.334995 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:19.318524 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.351598 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.351961 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:19.352483 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.353188 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.364908 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:19.332268 20960 consensus_meta.cc:287] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.814s	user 0.013s	sys 0.000s
I20260709 13:19:19.375759 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:19.376219 17521 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:19.378741 17527 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:19.362771 20998 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:19.376796 17566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.014s	sys 0.034s
W20260709 13:19:19.383698 17566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.014s	sys 0.034s
I20260709 13:19:19.359089 20958 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.359884 20945 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.305153 20875 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.369132 20999 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.363080 20835 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:19.410007 17595 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:19.370203 21002 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.417922 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.417601 17447 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:19.425377 17596 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:19.419097 17448 raft_consensus.cc:2368] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:19.419070 17601 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:19:19.427786 17494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.012s	sys 0.021s
W20260709 13:19:19.416342 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 93352.3us
I20260709 13:19:19.416977 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:19.414711 17599 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:19:19.412112 20948 consensus_meta.cc:287] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.885s	user 0.003s	sys 0.011s
W20260709 13:19:19.428172 17494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.012s	sys 0.021s
W20260709 13:19:19.419067 17567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.030s	sys 0.023s
W20260709 13:19:19.430081 17569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.053s	sys 0.117s
W20260709 13:19:19.431383 17569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.054s	sys 0.118s
W20260709 13:19:19.431876 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 571217us
I20260709 13:19:19.384258 20997 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:19.432693 17596 raft_consensus.cc:1240] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:19.433877 17567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.030s	sys 0.023s
I20260709 13:19:19.437449 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.438148 17448 raft_consensus.cc:2376] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8. Re-sending same reply.
I20260709 13:19:19.429279 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.443979 17520 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:19.446758 17445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.012s	sys 0.025s
I20260709 13:19:19.378813 21012 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:19:19.419878 20846 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:19.448570 17445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.012s	sys 0.025s
I20260709 13:19:19.449106 17599 raft_consensus.cc:1240] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:19.380537 20960 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:19.454546 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:19.464323 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 94539us
I20260709 13:19:19.410856 20945 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.493255 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.414950 20958 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.499398 17448 raft_consensus.cc:2393] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:19.500553 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:19.406867 20998 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.445236 20996 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.427922 20835 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.506788 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:19.453543 20856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.008s	sys 0.031s
I20260709 13:19:19.432287 20771 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:19:19.517232 17526 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:19.420192 20999 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.451778 20948 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 13:19:19.520092 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 103243us
W20260709 13:19:19.510238 20856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.008s	sys 0.031s
I20260709 13:19:19.449585 20977 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:19:19.429731 21002 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.521075 17521 raft_consensus.cc:3055] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:19.541286 17521 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:19.542121 17521 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:19.528872 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
W20260709 13:19:19.518173 20851 consensus_meta.cc:287] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 1.004s	user 0.013s	sys 0.008s
I20260709 13:19:19.524151 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.465090 20841 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:19:19.543066 17521 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:19.549636 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:19.550736 17448 raft_consensus.cc:2376] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9. Re-sending same reply.
I20260709 13:19:19.551364 17601 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:19.551586 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:19.442807 20997 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.510874 20846 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 13:19:19.545022 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 103766us
W20260709 13:19:19.540720 21004 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:19:19.551471 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:19.553789 17448 raft_consensus.cc:2393] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:19.518956 21016 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:19.574793 17599 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:19.574728 20994 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 13:19:19.575244 21005 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:19:19.575682 21017 log.cc:927] Time spent T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:19:19.576040 21013 log.cc:927] Time spent T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 13:19:19.567525 21011 log.cc:927] Time spent T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:19:19.579445 21014 log.cc:927] Time spent T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:19:19.616034 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 146804us
I20260709 13:19:19.552810 20977 consensus_queue.cc:1243] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:19.511452 20996 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.515085 21000 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:19:19.582541 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.616693 17521 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:19:19.620440 17521 pending_rounds.cc:85] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 8
I20260709 13:19:19.620735 17521 pending_rounds.cc:107] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:19:19.621052 17521 raft_consensus.cc:2889] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.589915 21022 tablet_replica.cc:333] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:19:19.518740 21019 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
W20260709 13:19:19.592717 20792 consensus_meta.cc:287] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.568s	user 0.015s	sys 0.000s
I20260709 13:19:19.628192 20923 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.623720 21001 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.633281 21001 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.553268 20851 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:19.634656 21015 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:19:19.635449 21001 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:19.636029 20851 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:19.636046 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1689) took 1085 ms. Trace:
I20260709 13:19:19.637888 17522 rpcz_store.cc:276] 0709 13:19:18.550801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.550957 (+   156us) service_pool.cc:224] Handling call
0709 13:19:18.574584 (+ 23627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.575006 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.575052 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.582491 (+  7439us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.109858 (+527367us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:19.109893 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.109968 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.635782 (+525814us) raft_consensus.cc:1685] finished
0709 13:19:19.635803 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.635965 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":463482,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":457588,"threads_started":1,"wal-append.queue_time_us":822575}
I20260709 13:19:19.636799 17451 raft_consensus.cc:2368] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:19.642299 21016 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:19.642729 21021 log.cc:927] Time spent T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:19.643074 21016 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.646507 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 448) took 1432 ms. Trace:
I20260709 13:19:19.647050 17524 rpcz_store.cc:276] 0709 13:19:18.213890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.245948 (+ 32058us) service_pool.cc:224] Handling call
0709 13:19:18.246378 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.606079 (+359701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.606107 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.610874 (+  4767us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.110223 (+499349us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:19.110273 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.110338 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.646189 (+535851us) raft_consensus.cc:1685] finished
0709 13:19:19.646227 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.646429 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":705080,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":15820,"thread_start_us":856034,"threads_started":2,"wal-append.queue_time_us":808795}
I20260709 13:19:19.650938 17450 raft_consensus.cc:2410] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:19.652544 18167 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:19.656165 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 314) took 1301 ms. Trace:
I20260709 13:19:19.656692 17446 rpcz_store.cc:276] 0709 13:19:18.354890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.590654 (+235764us) service_pool.cc:224] Handling call
0709 13:19:18.618255 (+ 27601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.657383 (+ 39128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.657431 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.664293 (+  6862us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.254955 (+590662us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:19.254997 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.255071 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.655848 (+400777us) raft_consensus.cc:1685] finished
0709 13:19:19.655889 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.656082 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38647,"raft.queue_time_us":43060,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":10733,"thread_start_us":564507,"threads_started":1,"wal-append.queue_time_us":782519}
I20260709 13:19:19.652293 21032 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.682314 21032 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.684896 21032 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:19.672206 20892 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:19.674785 21001 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:19.675875 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 103252us
I20260709 13:19:19.677627 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:19.685586 20892 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.679175 20997 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:19.681728 20859 consensus_meta.cc:287] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 1.103s	user 0.012s	sys 0.000s
W20260709 13:19:19.679057 20990 log.cc:927] Time spent T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:19:19.702919 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1947) took 1658 ms. Trace:
I20260709 13:19:19.687661 20875 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:19.704229 20998 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:19.728825 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 199993us
I20260709 13:19:19.708194 17446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:19:19.685792 21001 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:19.723140 17453 rpcz_store.cc:276] 0709 13:19:18.044490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.336912 (+292422us) service_pool.cc:224] Handling call
0709 13:19:18.337305 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:18.380776 (+ 43471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.380818 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:18.381601 (+   783us) log.cc:844] Serialized 52 byte log entry
0709 13:19:18.854341 (+472740us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:18.854403 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.854502 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.702684 (+848182us) raft_consensus.cc:1685] finished
0709 13:19:19.702704 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.702854 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42965,"raft.queue_time_us":43107,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":41926,"thread_start_us":425631,"threads_started":1,"wal-append.queue_time_us":903567}
I20260709 13:19:19.730623 17446 raft_consensus.cc:606] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.731416 17446 raft_consensus.cc:614] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:19.699187 17420 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.732353 17453 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:19:19.706609 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 53049.5us
I20260709 13:19:19.733522 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.735163 17420 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.736756 17453 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:19.737818 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.738984 17420 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.707698 20892 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:19.741778 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.741930 17453 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:19.747417 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:19.740562 17420 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.754691 17446 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:19.769145 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:19.768327 17495 leader_election.cc:400] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11.
I20260709 13:19:19.770457 17495 leader_election.cc:403] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:19.710408 21032 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.735471 20875 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:19.741182 20834 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:19.750644 17420 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.706192 21012 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:19:19.773306 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:19.721045 20882 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:19:19.770932 17596 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:19.784191 17596 pending_rounds.cc:85] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 5
I20260709 13:19:19.749971 20889 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:19.741302 20792 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:19.784461 17596 pending_rounds.cc:107] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:19.788067 17596 raft_consensus.cc:2889] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.786818 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.747596 20851 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:19.786011 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:19.790757 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1685) took 2253 ms. Trace:
I20260709 13:19:19.771299 21019 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.727116 20859 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.772753 20998 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:19.791222 17603 rpcz_store.cc:276] 0709 13:19:17.534586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.535118 (+   532us) service_pool.cc:224] Handling call
0709 13:19:17.538334 (+  3216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.554773 (+ 16439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.554819 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:17.555408 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.152267 (+596859us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b18003d31e0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab57060d1 00007f5ab5b21a0f
0709 13:19:18.931647 (+779380us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:18.931698 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.931768 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.784783 (+853015us) raft_consensus.cc:1685] finished
0709 13:19:19.784804 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.787554 (+  2750us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15913,"raft.queue_time_us":16828,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":9486,"spinlock_wait_cycles":9653504,"thread_start_us":779173,"threads_started":1,"wal-append.queue_time_us":1882011}
I20260709 13:19:19.776966 20997 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11.
I20260709 13:19:19.741945 20771 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:19.793190 20816 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:19:19.796535 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:19.793581 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 54478.5us
I20260709 13:19:19.787559 20977 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:19.795644 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.812829 20977 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:19.802052 21025 log.cc:927] Time spent T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:19:19.814064 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.814905 20977 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:19.799379 20948 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:19.816493 17420 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.802040 20824 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:19.802146 21029 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.802716 21039 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:19.803150 21048 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.821583 20998 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:19.817562 20977 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:19.822254 20998 raft_consensus.cc:697] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:19.820672 20824 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.822196 21029 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.823539 20998 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.821859 21048 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.804397 21001 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:19.791286 20834 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:19.799152 21019 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.830564 21039 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:19.806694 20992 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.791s	user 0.000s	sys 0.004s
I20260709 13:19:19.831313 21002 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:19.806950 17448 raft_consensus.cc:2368] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8.
W20260709 13:19:19.832628 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.832862 21039 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:19.801853 21043 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:19.818188 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 313) took 1497 ms. Trace:
I20260709 13:19:19.818495 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:19.834241 17601 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:19.833623 17445 rpcz_store.cc:276] 0709 13:19:18.320926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.501670 (+180744us) service_pool.cc:224] Handling call
0709 13:19:18.502098 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.591868 (+ 89770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.591914 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.592491 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.454586 (+862095us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:19.600187 (+145601us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.614741 (+ 14554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.614814 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.817926 (+203112us) raft_consensus.cc:1685] finished
0709 13:19:19.817948 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.818121 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90550,"prepare.queue_time_us":228541,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":95786,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":13215,"thread_start_us":879014,"threads_started":2,"wal-append.queue_time_us":906326}
I20260709 13:19:19.832118 21002 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:19.784482 21032 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.817325 21047 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:19:19.819960 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.838650 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:19.807564 20859 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:19.840013 20948 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:19.862793 20985 consensus_queue.cc:1048] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:19.840809 20997 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:19.864418 20997 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:19.864859 20997 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:19.865998 20824 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.868311 20958 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:19.841403 21000 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:19.844034 20889 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:19.844151 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.844372 20851 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:19.846122 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.847014 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.847985 21039 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:19.861370 20923 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:19.861974 21022 raft_consensus.cc:2243] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:19.862010 21043 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:19.869073 20824 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:19.841406 17569 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:19.885068 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 65193.8us
I20260709 13:19:19.886060 17446 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.890365 17445 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.903252 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:19.908964 17452 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:19.912147 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:19.914546 21022 pending_rounds.cc:70] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Trying to abort 1 pending ops.
I20260709 13:19:19.904814 20851 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.888057 20859 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:19.915051 21022 pending_rounds.cc:77] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting op as it isn't in flight: id { term: 7 index: 7 } timestamp: 7305638457410109440 op_type: NO_OP noop_request { }
I20260709 13:19:19.915656 21022 raft_consensus.cc:2889] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:19.916203 21022 raft_consensus.cc:2272] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:19.916747 20851 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:19.918503 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 77174.2us
I20260709 13:19:19.852923 20771 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 13:19:19.925248 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.928112 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 67213.1us
I20260709 13:19:19.888865 21032 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:19.892692 20958 consensus_queue.cc:1059] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:19:19.941164 17452 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:19.943040 17569 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:19:19.949929 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 66727.1us
I20260709 13:19:19.917726 20892 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:19.855918 21002 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:19.952174 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 87446.3us
I20260709 13:19:19.924155 21043 raft_consensus.cc:697] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:19.954885 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:19.967679 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:19.968143 17452 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:19.892673 20889 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:19.933375 21001 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:19.969923 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:19.968792 17446 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:19.971143 17569 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:19.971204 17445 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:19.972716 17569 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:19.945432 20771 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:19.954378 20775 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:19.972709 20792 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.971907 20816 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.951467 21032 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:19:19.978366 20887 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:19.945024 21051 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:19:19.980333 20824 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:19.965076 20997 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:19.975521 21018 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:19.975925 20833 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:19.986477 21035 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.972568 20875 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:19:19.996445 21019 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:19.999989 21018 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.998494 20887 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:20.016846 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:20.019138 21041 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:19:20.005362 21045 raft_consensus.cc:3055] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:20.001947 20824 raft_consensus.cc:697] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:20.019510 20889 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:19.991109 20792 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:20.021912 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:20.022660 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:20.023552 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:19.998231 21039 consensus_queue.cc:1059] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:19:20.036264 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:20.038625 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:19.995276 20816 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.015758 21018 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.040557 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:20.046314 17597 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:20.041461 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:20.003713 21035 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:20.051721 21035 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:20.054471 20824 consensus_queue.cc:237] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.003796 20833 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:20.058739 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:20.058764 21054 log.cc:927] Time spent T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:19:20.059274 21048 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:20.059588 20833 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:20.060117 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:20.016043 20775 raft_consensus.cc:697] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:20.072464 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.086999 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:20.082098 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 57282us
I20260709 13:19:20.007432 20923 consensus_queue.cc:1059] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:19:20.026991 21045 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:20.095525 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.100957 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:20.067993 21032 raft_consensus.cc:3055] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:20.127419 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.128144 17524 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
W20260709 13:19:20.138617 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 145166us
I20260709 13:19:20.110064 21032 raft_consensus.cc:740] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:20.007026 21043 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.145823 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:20.139261 20999 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:20.152555 21058 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:20.158424 21058 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:20.158872 20816 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:20.158473 21032 consensus_queue.cc:260] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.159724 21032 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.159843 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.159089 21058 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.160463 17524 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:20.161844 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:20.147297 20892 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:20.177188 17495 leader_election.cc:336] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.616s (SENT)
I20260709 13:19:20.181586 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.182479 17568 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:20.155992 21022 ts_tablet_manager.cc:1916] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:20.116104 20887 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.185361 17524 raft_consensus.cc:2410] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:20.142475 21045 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.183813 20919 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:20.157298 21064 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.186198 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.191296 20833 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:20.180868 20792 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:20.203953 17495 leader_election.cc:336] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.881s (SENT)
I20260709 13:19:20.207676 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:20.148190 21062 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.205s
W20260709 13:19:20.213442 17495 leader_election.cc:336] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.926s (SENT)
I20260709 13:19:20.211763 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.199616 17522 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
W20260709 13:19:20.215636 17495 leader_election.cc:336] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.933s (SENT)
I20260709 13:19:20.194921 21070 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:20.156337 20775 consensus_queue.cc:237] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.216076 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:20.196904 17419 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:20.194662 20995 log.cc:927] Time spent T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.983s	user 0.005s	sys 0.000s
W20260709 13:19:20.229013 17495 leader_election.cc:336] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.966s (SENT)
I20260709 13:19:20.229558 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:20.211333 21045 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.238636 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.269833 21026 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:20.269033 21061 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:20.217023 20958 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:20.287719 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.291572 18198 raft_consensus.cc:1240] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:20.200027 20833 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:20.287104 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:20.294039 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:20.238353 21060 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:20.238695 21029 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:20.315451 17452 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:19:20.298617 17495 leader_election.cc:336] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 2.084s (SENT)
I20260709 13:19:20.316429 17495 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:20.298539 20889 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:20.316771 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:20.317229 20889 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:20.298599 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:20.318604 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2097) took 2294 ms. Trace:
I20260709 13:19:20.318769 21029 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.312361 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.313680 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:20.238153 20771 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:20.231133 20999 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:20.315105 17451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1574) took 1502 ms (client timeout 1898 ms). Trace:
W20260709 13:19:20.358769 17451 rpcz_store.cc:269] 0709 13:19:18.812765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.834385 (+ 21620us) service_pool.cc:224] Handling call
0709 13:19:20.314902 (+1480517us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b5400215554. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:20.315048 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616144128}
I20260709 13:19:20.360446 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:20.312453 18192 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:20.321914 17522 raft_consensus.cc:2410] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:19:20.322434 20960 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:20.323357 21016 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:20.324924 20889 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:20.319243 21029 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:20.388057 21000 raft_consensus.cc:3055] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:20.388572 21000 raft_consensus.cc:740] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:20.388811 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:20.330402 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.203871 21064 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:20.332647 20845 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:20.319003 17520 rpcz_store.cc:276] 0709 13:19:18.023917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.024075 (+   158us) service_pool.cc:224] Handling call
0709 13:19:18.024366 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.444470 (+1420104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.318397 (+873927us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002021d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:20.318551 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3263846144}
I20260709 13:19:20.317322 20835 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:20.392688 21051 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:20.393280 20833 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:20.385015 21060 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:20.231016 21070 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:20.386152 21048 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:20.389413 17522 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.396675 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:20.404738 17594 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:20.405175 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:20.401533 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.410734 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.337081 20771 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:20.413532 17520 raft_consensus.cc:2393] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 10: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:19:20.416204 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 117597us
I20260709 13:19:20.393317 21029 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:20.431313 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 44197.9us
I20260709 13:19:20.414111 21000 consensus_queue.cc:260] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.435987 21075 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.415602 20771 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.444747 17525 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:20.336303 21061 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:20.412987 21048 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.461747 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 413) took 2348 ms. Trace:
I20260709 13:19:20.448647 21001 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:20.465253 17602 rpcz_store.cc:276] 0709 13:19:18.113498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.113699 (+   201us) service_pool.cc:224] Handling call
0709 13:19:18.114231 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.035282 (+921051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.461428 (+1426146us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54003eb554. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:20.461662 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116318464}
I20260709 13:19:20.456717 21000 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:20.468165 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:20.484829 17602 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:20.650622 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.361986 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:20.654417 17445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.006s	sys 0.011s
W20260709 13:19:20.655020 17446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.001s	sys 0.017s
I20260709 13:19:20.334792 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:20.661131 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.662333 17494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.002s	sys 0.016s
W20260709 13:19:20.744912 17494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.003s	sys 0.016s
W20260709 13:19:20.746894 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.448259 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:20.749240 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 300868us
W20260709 13:19:20.666494 17528 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.067s	sys 0.063s
I20260709 13:19:20.749485 21043 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:20.750356 17528 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.068s	sys 0.064s
I20260709 13:19:20.750487 21043 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.751437 21043 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.586503 21018 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.568476 21048 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:20.572772 21058 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:20.771982 20834 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:20.772935 20834 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.775481 21058 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:20.776925 21095 log.cc:927] Time spent T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 13:19:20.509229 21064 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:20.778155 17520 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:20.562420 21077 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:19:20.779217 20890 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.780128 20890 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.785310 17529 raft_consensus.cc:1240] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:20.785787 20998 consensus_queue.cc:1059] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:20.718079 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 419194us
W20260709 13:19:20.739090 20824 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.017s	sys 0.042s
W20260709 13:19:20.787758 20824 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.017s	sys 0.043s
I20260709 13:19:20.788067 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 1690) took 1423 ms. Trace:
I20260709 13:19:20.739403 17451 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:20.788691 17526 rpcz_store.cc:276] 0709 13:19:19.364321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.364559 (+   238us) service_pool.cc:224] Handling call
0709 13:19:20.787587 (+1423028us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001def54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:20.787787 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348261120}
I20260709 13:19:20.789753 17420 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:20.790585 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:20.791793 17451 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
W20260709 13:19:20.761328 17445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.006s	sys 0.012s
W20260709 13:19:20.762862 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.761147 17446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.001s	sys 0.017s
I20260709 13:19:20.564775 21060 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:20.583395 21061 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:20.554474 21070 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:20.809576 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:20.794214 20890 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:20.788563 17419 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:20.802639 20754 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.803637 20998 raft_consensus.cc:3055] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:20.793303 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:20.817248 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:20.818200 20754 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:20.818755 20754 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:20.819243 20754 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.813364 20998 raft_consensus.cc:740] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:20.822011 20998 consensus_queue.cc:260] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:20.822956 17451 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:20.824215 20998 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.827889 20710 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.797816 20834 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:20.824736 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:20.836998 17451 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:20.838452 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1610) took 1526 ms. Trace:
I20260709 13:19:20.839200 20996 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:20.835635 17524 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:20.844066 21018 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:20.841949 17448 rpcz_store.cc:276] 0709 13:19:19.311988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.570961 (+258973us) service_pool.cc:224] Handling call
0709 13:19:20.837505 (+1266544us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54002003d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:20.838113 (+   608us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428563712}
I20260709 13:19:20.851557 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:20.857999 17445 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.868992 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:20.882664 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:20.894548 20710 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.901726 17602 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:20.909217 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.910205 20884 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:20.912734 17448 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 6.
I20260709 13:19:20.926347 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:20.930529 17451 raft_consensus.cc:2410] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:20.932668 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:20.918681 20884 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:20.942472 17495 leader_election.cc:336] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.549s (SENT)
I20260709 13:19:20.943204 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:20.944067 20997 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:20.945091 20997 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:20.940497 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.941406 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:20.949687 21098 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:19:20.932314 20834 consensus_queue.cc:1059] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:19:20.953603 21070 consensus_queue.cc:1059] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:20.954864 21070 raft_consensus.cc:3055] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:20.955320 21070 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:20.955717 20945 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:20.949676 18196 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:19:20.956625 21070 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:20.952590 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1959) took 1106 ms. Trace:
I20260709 13:19:20.947595 17522 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:20.969668 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.970170 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:20.974749 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:20.978546 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:20.980932 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:20.974473 21070 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.996049 17419 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:20.997605 17448 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:20.988468 20890 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:21.012455 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 47807.8us
I20260709 13:19:21.017405 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:20.980619 20771 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:20.965521 17446 rpcz_store.cc:276] 0709 13:19:19.856084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.987817 (+131733us) service_pool.cc:224] Handling call
0709 13:19:20.000702 (+ 12885us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.002481 (+  1779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.002527 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.006910 (+  4383us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.810501 (+803591us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:20.922728 (+112227us) log.cc:844] Serialized 14 byte log entry
0709 13:19:20.938360 (+ 15632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.940492 (+  2132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.940841 (+   349us) raft_consensus.cc:1685] finished
0709 13:19:20.940861 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.952535 (+ 11674us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173,"prepare.queue_time_us":129078,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":956,"raft.queue_time_us":20171,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":3174,"thread_start_us":883384,"threads_started":2,"wal-append.queue_time_us":515078}
W20260709 13:19:21.024509 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 78769.9us
I20260709 13:19:21.026499 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:21.033619 21022 ts_tablet_manager.cc:1929] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:19:21.035733 21022 log.cc:1199] T e57fe371976a485bbdedfdaa4659dec3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/e57fe371976a485bbdedfdaa4659dec3
I20260709 13:19:21.043838 20771 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.045325 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:21.046205 20859 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:21.046806 20859 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:21.047293 20859 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.047667 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:21.052893 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:21.054488 20997 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:21.057525 20771 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.059055 20884 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.040629 20890 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.059845 20884 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.059633 20771 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.060588 20884 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.061340 20863 raft_consensus.cc:3055] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:21.061935 20771 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.061743 20890 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.066197 17449 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:21.052855 20996 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:21.069272 17528 raft_consensus.cc:1240] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:21.082674 21022 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55872 (request call id 71) took 2326 ms. Trace:
I20260709 13:19:21.083686 17448 raft_consensus.cc:2393] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:21.085132 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:21.086705 17445 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:21.086949 21043 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.088402 17529 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:21.089452 21043 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:21.090222 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 66230us
I20260709 13:19:21.091782 17419 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:21.061751 20863 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:21.093590 20863 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:21.099195 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 51833us
I20260709 13:19:21.095379 20863 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:21.095381 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:21.124092 20884 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.124910 20884 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:21.125525 20884 raft_consensus.cc:697] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:21.130968 20770 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.133147 17448 raft_consensus.cc:2410] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:21.018154 20834 consensus_queue.cc:1243] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:21.150197 21000 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:21.150506 20996 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:21.151163 21000 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.151404 20996 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.155464 20996 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:21.160848 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:21.083381 21022 rpcz_store.cc:276] 0709 13:19:18.802264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.861378 (+ 59114us) service_pool.cc:224] Handling call
0709 13:19:19.555510 (+694132us) ts_tablet_manager.cc:1151] Deleting tablet e57fe371976a485bbdedfdaa4659dec3
0709 13:19:19.589454 (+ 33944us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:19:20.589382 (+999928us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:21.028246 (+438864us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:21.082472 (+ 54226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":227389,"tablet-delete.queue_time_us":523515,"thread_start_us":409452,"threads_started":1}
I20260709 13:19:21.164547 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:21.167182 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:21.167737 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:21.170418 18200 raft_consensus.cc:2393] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
W20260709 13:19:21.166515 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 72519us
I20260709 13:19:21.167925 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:21.168006 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:21.087803 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:21.174857 17445 raft_consensus.cc:2410] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:21.176811 21000 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:21.177572 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.181488 20710 consensus_queue.cc:1059] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:21.183625 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 82121.5us
I20260709 13:19:21.177640 21000 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:21.187417 21000 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.190320 21043 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:21.192732 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:21.193670 17520 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:21.206085 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:21.206233 20884 consensus_queue.cc:237] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.206390 17447 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:21.209635 17419 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:21.212677 17446 raft_consensus.cc:2410] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:19:21.212911 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.186553 20859 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.213446 20875 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.213352 20996 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:21.214249 20875 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.219470 17523 raft_consensus.cc:2410] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:21.216902 21070 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:21.222788 21070 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.224207 21070 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.193548 20754 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.212175 21043 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:19:21.224869 21000 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:21.234200 17445 raft_consensus.cc:1240] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:21.236517 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:21.239775 20977 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:21.240828 20754 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.240506 20977 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.243355 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1490) took 1477 ms. Trace:
I20260709 13:19:21.244263 17601 rpcz_store.cc:276] 0709 13:19:19.764707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.768815 (+  4108us) service_pool.cc:224] Handling call
0709 13:19:21.230214 (+1461399us) spinlock_profiling.cc:243] Waited 63.9 ms on lock 0x7b54003aded4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:21.241929 (+ 11715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147034368}
I20260709 13:19:21.248037 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet e57fe371976a485bbdedfdaa4659dec3 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:19:21.238068 20998 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:19:21.245129 20859 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.273684 17524 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:21.277757 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1936) took 3507 ms. Trace:
W20260709 13:19:21.279320 21089 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.725s	user 0.013s	sys 0.000s
I20260709 13:19:21.279482 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:21.282817 21000 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:21.283309 21000 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:21.283727 21000 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.278554 17454 rpcz_store.cc:276] 0709 13:19:17.770495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.196007 (+425512us) service_pool.cc:224] Handling call
0709 13:19:18.196273 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.204481 (+  8208us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:18.209643 (+  5162us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.952796 (+743153us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.023234 (+2070438us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b2c000014c8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446f372 00007f5ab5ba1a01 00007f5ab5b6643a 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2
0709 13:19:21.026527 (+  3293us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.209433 (+182906us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:21.228361 (+ 18928us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.230918 (+  2557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.235014 (+  4096us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.277130 (+ 42116us) raft_consensus.cc:1685] finished
0709 13:19:21.277173 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.277422 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7842,"prepare.queue_time_us":24075,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":992,"raft.queue_time_us":13406,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":170602,"spinlock_wait_cycles":6089600,"thread_start_us":925181,"threads_started":2,"wal-append.queue_time_us":1170394,"wal-append.run_cpu_time_us":1951,"wal-append.run_wall_time_us":1083187}
I20260709 13:19:21.282720 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:21.287235 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:21.288170 20996 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:21.288255 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:21.288600 20996 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:21.290232 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:21.290387 20996 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.264329 20710 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:21.299217 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:21.300997 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:21.303114 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:21.304080 17454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a372191e02cc468bbc747310e2818f07"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:19:21.312937 17454 raft_consensus.cc:606] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:21.313408 17454 raft_consensus.cc:614] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:21.304205 20710 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:21.305991 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.321273 21031 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:21.321570 17419 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:21.321826 21031 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.322264 21031 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:21.325543 20859 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:21.334429 20754 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:21.335381 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 45336.3us
I20260709 13:19:21.335134 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1951) took 1491 ms. Trace:
I20260709 13:19:21.338745 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1962) took 1481 ms. Trace:
I20260709 13:19:21.339416 17603 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:21.340143 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1719) took 1249 ms. Trace:
I20260709 13:19:21.339131 17454 rpcz_store.cc:276] 0709 13:19:19.857226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.337804 (+1480578us) service_pool.cc:224] Handling call
0709 13:19:21.338178 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.338370 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.338394 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.338433 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:21.338491 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.338542 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.338667 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.337827 17452 rpcz_store.cc:276] 0709 13:19:19.844051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.969516 (+125465us) service_pool.cc:224] Handling call
0709 13:19:20.315153 (+345637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.316034 (+   881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.334764 (+1018730us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b5400215550. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:21.334951 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783944064}
I20260709 13:19:21.335175 20996 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.350425 20816 raft_consensus.cc:3055] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:21.350951 20816 raft_consensus.cc:740] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:21.350626 21000 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.352008 20816 consensus_queue.cc:260] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.353592 20816 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.353817 20996 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.354598 20720 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:21.354674 21103 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:21.355305 20720 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.355544 21103 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:19:21.357333 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 902954us
I20260709 13:19:21.357553 20720 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:21.358880 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.359030 17597 raft_consensus.cc:1240] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:21.359632 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1718) took 1269 ms. Trace:
I20260709 13:19:21.359925 21070 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:21.361210 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.363551 20710 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:21.363656 21103 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.369155 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:21.369902 17525 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:21.370106 21103 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.371922 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:21.370940 21103 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.340471 17603 rpcz_store.cc:276] 0709 13:19:20.091073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.742622 (+651549us) service_pool.cc:224] Handling call
0709 13:19:21.338878 (+596256us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b58001a1398. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab3ffc0 00007f5abab2a929 00007f5abab2a3d2 00007f5ab40a1bd4
0709 13:19:21.339080 (+   202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.339849 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.340081 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30367616}
I20260709 13:19:21.374343 21001 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:21.359974 17597 rpcz_store.cc:276] 0709 13:19:20.090285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.738399 (+648114us) service_pool.cc:224] Handling call
0709 13:19:21.358396 (+619997us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b58001a1398. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab3ffc0 00007f5abab2a929 00007f5abab2a3d2 00007f5ab40a1bd4
0709 13:19:21.358610 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.359398 (+   788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.359580 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40149760}
I20260709 13:19:21.333434 20859 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:21.379848 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:21.374536 20784 raft_consensus.cc:1027] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: attempt to promote peer 2158c0f750fd4b21afe24135c52167b2: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260709 13:19:21.381214 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 78207.5us
I20260709 13:19:21.382351 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:21.378307 21001 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:21.389302 17449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1622) took 1228 ms (client timeout 1630 ms). Trace:
W20260709 13:19:21.391129 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.392297 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.396461 21051 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.397225 21051 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.397624 20859 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.401654 17520 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
W20260709 13:19:21.389981 17449 rpcz_store.cc:269] 0709 13:19:20.160471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.334511 (+174040us) service_pool.cc:224] Handling call
0709 13:19:21.389052 (+1054541us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54000d89d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:21.389224 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686154624}
I20260709 13:19:21.401085 21058 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:21.411895 20875 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.409235 21058 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:21.413076 21058 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:21.412298 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1716) took 1386 ms. Trace:
I20260709 13:19:21.413972 17594 rpcz_store.cc:276] 0709 13:19:20.026251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.405699 (+379448us) service_pool.cc:224] Handling call
0709 13:19:20.407111 (+  1412us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:20.414075 (+  6964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.414105 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:20.414768 (+   663us) log.cc:844] Serialized 78 byte log entry
0709 13:19:20.893395 (+478627us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:20.904103 (+ 10708us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.411762 (+507659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.411888 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.411932 (+    44us) raft_consensus.cc:1685] finished
0709 13:19:21.411944 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.412138 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":507948,"prepare.queue_time_us":10339,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":2279,"raft.queue_time_us":511730,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":1540,"thread_start_us":366545,"threads_started":1,"wal-append.queue_time_us":432357}
W20260709 13:19:21.416982 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.417418 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1700) took 1250 ms. Trace:
I20260709 13:19:21.417789 20863 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:21.418911 21065 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:21.418648 20863 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.419553 21065 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.421347 20863 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:21.417833 17529 rpcz_store.cc:276] 0709 13:19:20.167297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.786795 (+619498us) service_pool.cc:224] Handling call
0709 13:19:20.787239 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.088882 (+301643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.417158 (+328276us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400413554. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:21.417347 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691989248}
W20260709 13:19:21.412197 17450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1594) took 2456 ms (client timeout 1616 ms). Trace:
I20260709 13:19:21.430197 17420 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:21.432574 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:21.433326 17451 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:21.433548 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1960) took 1577 ms. Trace:
I20260709 13:19:21.433961 17448 rpcz_store.cc:276] 0709 13:19:19.856425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.134012 (+1277587us) service_pool.cc:224] Handling call
0709 13:19:21.134732 (+   720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.135127 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.135157 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.135686 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.312635 (+176949us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:21.312696 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.312785 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.433288 (+120503us) raft_consensus.cc:1685] finished
0709 13:19:21.433311 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.433460 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1318,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":143,"thread_start_us":176359,"threads_started":1,"wal-append.queue_time_us":286465}
W20260709 13:19:21.428612 17450 rpcz_store.cc:269] 0709 13:19:18.956157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.083962 (+127805us) service_pool.cc:224] Handling call
0709 13:19:21.411691 (+2327729us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54000b4354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:21.411935 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299525376}
I20260709 13:19:21.440024 17448 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:21.422466 20710 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:21.437412 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:21.421983 21065 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:21.446300 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1613) took 1340 ms. Trace:
I20260709 13:19:21.452275 17448 rpcz_store.cc:276] 0709 13:19:20.100710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.435509 (+1334799us) service_pool.cc:224] Handling call
0709 13:19:21.435901 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.440484 (+  4583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.440746 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.454298 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 317) took 1504 ms. Trace:
I20260709 13:19:21.455819 20948 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:21.456535 20948 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.457585 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.459865 17603 raft_consensus.cc:2410] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:19:21.468458 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 90330.4us
I20260709 13:19:21.469633 17495 leader_election.cc:400] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8.
I20260709 13:19:21.470053 17495 leader_election.cc:403] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:21.470307 20890 raft_consensus.cc:3055] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:21.470963 20890 raft_consensus.cc:740] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:21.471711 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:21.472136 20890 consensus_queue.cc:260] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.473366 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:21.440572 20977 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:21.477459 17447 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1604) took 2167 ms (client timeout 2113 ms). Trace:
I20260709 13:19:21.478688 17453 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:21.474931 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1489) took 1710 ms. Trace:
I20260709 13:19:21.482479 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.482108 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:21.479789 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:21.491518 17447 rpcz_store.cc:269] 0709 13:19:19.310152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.428818 (+118666us) service_pool.cc:224] Handling call
0709 13:19:21.477242 (+2048424us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b5400352ad4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:21.477397 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4002214272}
W20260709 13:19:21.497416 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 67388.4us
I20260709 13:19:21.497393 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:21.498751 17520 raft_consensus.cc:2393] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 4: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:19:21.501192 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.447994 21018 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:21.481530 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:21.477295 21070 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.454900 21000 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.477653 20754 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:21.475227 20996 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8.
I20260709 13:19:21.473951 20890 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:21.479678 21045 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:21.477916 20797 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:21.515672 17600 raft_consensus.cc:1240] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:21.518170 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:21.519026 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:21.515699 17448 raft_consensus.cc:1240] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:21.523862 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.530226 20998 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:21.475167 21103 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.476293 21051 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:21.535460 17450 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:19:21.535725 17603 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:21.536029 17520 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:21.473846 21002 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:21.454788 17452 rpcz_store.cc:276] 0709 13:19:19.947298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.343416 (+1396118us) service_pool.cc:224] Handling call
0709 13:19:21.343849 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.344093 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:21.344400 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.450752 (+106352us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.451274 (+   522us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:21.451335 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.451410 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.451560 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":162,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":29729,"spinlock_wait_cycles":13568,"thread_start_us":105823,"threads_started":1}
I20260709 13:19:21.556340 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:21.543141 17596 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.535488 21070 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.547905 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1616) took 1428 ms. Trace:
I20260709 13:19:21.506919 20875 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:21.510732 20977 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:21.481204 21058 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.514266 20884 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:21.493260 17599 rpcz_store.cc:276] 0709 13:19:19.764360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.766128 (+  1768us) service_pool.cc:224] Handling call
0709 13:19:19.781855 (+ 15727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.837470 (+ 55615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.837500 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.837986 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.859500 (+ 21514us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:19.865592 (+  6092us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.865791 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.474273 (+1608482us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b54000370d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:21.474343 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.474428 (+    85us) raft_consensus.cc:1685] finished
0709 13:19:21.474554 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.474739 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7552,"prepare.queue_time_us":9991,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":36,"raft.queue_time_us":21830,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":9427,"spinlock_wait_cycles":109601024,"thread_start_us":19575,"threads_started":1,"wal-append.queue_time_us":99659,"wal-append.run_cpu_time_us":3476,"wal-append.run_wall_time_us":1110471}
I20260709 13:19:21.555243 20797 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.548959 17419 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:21.558005 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1615) took 1446 ms. Trace:
I20260709 13:19:21.559255 17447 raft_consensus.cc:1240] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:19:21.551962 20998 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:21.561287 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1961) took 1704 ms. Trace:
I20260709 13:19:21.564647 17448 rpcz_store.cc:276] 0709 13:19:20.119387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.453241 (+1333854us) service_pool.cc:224] Handling call
0709 13:19:21.515455 (+ 62214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.547590 (+ 32135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.547841 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.565917 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:21.576649 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:21.572693 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:21.591799 17526 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.589450 17445 rpcz_store.cc:276] 0709 13:19:19.857049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.175747 (+1318698us) service_pool.cc:224] Handling call
0709 13:19:21.176102 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.234686 (+ 58584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.560965 (+326279us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b54000dc5d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:21.561212 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133125504}
I20260709 13:19:21.560981 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:21.582712 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1620) took 1447 ms. Trace:
I20260709 13:19:21.597564 17447 rpcz_store.cc:276] 0709 13:19:20.135633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.506990 (+1371357us) service_pool.cc:224] Handling call
0709 13:19:21.537989 (+ 30999us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:21.582379 (+ 44390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.582648 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:21.598456 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 49627.4us
I20260709 13:19:21.583103 17450 rpcz_store.cc:276] 0709 13:19:20.111869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.439235 (+1327366us) service_pool.cc:224] Handling call
0709 13:19:21.512270 (+ 73035us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:21.554486 (+ 42216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.557960 (+  3474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.599869 17419 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:21.600494 21001 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.601023 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1972) took 1398 ms. Trace:
I20260709 13:19:21.601197 20720 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:21.548199 20863 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.601454 17450 rpcz_store.cc:276] 0709 13:19:20.202863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.600142 (+1397279us) service_pool.cc:224] Handling call
0709 13:19:21.600525 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.600711 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.600731 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.600766 (+    35us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:21.600815 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.600869 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.600966 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.588032 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.601696 20720 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:21.597182 20998 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.628154 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1612) took 2212 ms. Trace:
I20260709 13:19:21.628422 20710 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:21.602241 20863 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.639056 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:21.629472 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.566872 20754 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:21.642355 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 108745us
I20260709 13:19:21.643158 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:21.643265 20754 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.644630 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:21.634176 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 44513.2us
I20260709 13:19:21.635054 17453 rpcz_store.cc:276] 0709 13:19:19.416275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.747937 (+331662us) service_pool.cc:224] Handling call
0709 13:19:21.478177 (+1730240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.492581 (+ 14404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.627814 (+135233us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400352ad0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:21.628063 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3978258688}
I20260709 13:19:21.648391 17445 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:21.557261 21018 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.616098 21002 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:21.577308 21070 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.652496 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1970) took 1447 ms. Trace:
I20260709 13:19:21.656494 17445 rpcz_store.cc:276] 0709 13:19:20.202450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.595989 (+1393539us) service_pool.cc:224] Handling call
0709 13:19:21.648195 (+ 52206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.649156 (+   961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.649399 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.618861 20720 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.584690 21031 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.618434 21103 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:21.663973 20903 consensus_queue.cc:1059] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:19:21.664855 21045 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:21.665318 21045 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:21.665374 20903 raft_consensus.cc:3055] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:21.665798 21045 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.665989 20903 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:21.676772 17595 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:21.677759 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.679682 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:21.680370 17595 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:21.681097 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.681948 21051 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.688398 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1967) took 1486 ms. Trace:
I20260709 13:19:21.688941 21058 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.688670 21051 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.689815 21000 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:21.690490 21000 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.691174 21051 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:21.691540 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:21.692615 21000 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.694437 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.695667 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.696683 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.697671 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.652287 20948 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:21.694475 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 460) took 1783 ms. Trace:
I20260709 13:19:21.633096 20884 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.701160 17525 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:21.701380 20884 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.698885 17527 rpcz_store.cc:276] 0709 13:19:19.875656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.876045 (+   389us) service_pool.cc:224] Handling call
0709 13:19:19.892317 (+ 16272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.976195 (+ 83878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.976227 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.976268 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:19.976312 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.582133 (+1605821us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b54002319d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:21.593991 (+ 11858us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.658614 (+ 64623us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192443136}
I20260709 13:19:21.703768 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.704653 18167 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:21.688813 17448 rpcz_store.cc:276] 0709 13:19:20.201784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.591013 (+1389229us) service_pool.cc:224] Handling call
0709 13:19:21.652028 (+ 61015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.682226 (+ 30198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.682254 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.688132 (+  5878us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:21.688177 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.688238 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.688345 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.704682 17600 raft_consensus.cc:2393] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:21.709887 17597 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:21.682157 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.713762 21103 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:21.708474 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1975) took 1496 ms. Trace:
I20260709 13:19:21.715767 17453 rpcz_store.cc:276] 0709 13:19:20.212416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.652984 (+1440568us) service_pool.cc:224] Handling call
0709 13:19:21.668368 (+ 15384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.668666 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.668706 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.668764 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:21.668813 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.668891 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.669063 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.594710 20977 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.649808 21001 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:21.724308 17595 raft_consensus.cc:2410] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:19:21.724227 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 79675.5us
I20260709 13:19:21.725986 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:21.735349 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:21.735956 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.663023 20996 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:21.738158 17451 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:21.760005 20977 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.762238 21103 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:21.763202 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 316) took 1816 ms. Trace:
I20260709 13:19:21.764230 18166 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:21.763669 17454 rpcz_store.cc:276] 0709 13:19:19.946632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.366519 (+1419887us) service_pool.cc:224] Handling call
0709 13:19:21.367196 (+   677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.367819 (+   623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.367874 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.368645 (+   771us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.503877 (+135232us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:21.503919 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.503990 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.762920 (+258930us) raft_consensus.cc:1685] finished
0709 13:19:21.762954 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.763140 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16507,"raft.queue_time_us":8382,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4840,"thread_start_us":134619,"threads_started":1,"wal-append.queue_time_us":348212}
I20260709 13:19:21.765483 21041 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:21.767285 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:21.767526 21070 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:21.768818 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.770074 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:21.771131 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.771309 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:21.772185 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.772563 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.773718 21041 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:21.721385 20903 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.775574 20903 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:21.776327 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1978) took 1477 ms. Trace:
I20260709 13:19:21.776726 17454 rpcz_store.cc:276] 0709 13:19:20.299386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.765904 (+1466518us) service_pool.cc:224] Handling call
0709 13:19:21.775756 (+  9852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.775970 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.775996 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.776058 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:21.776094 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.776145 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.776249 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.774200 17595 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:21.778538 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 318) took 1123 ms. Trace:
I20260709 13:19:21.774415 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:21.778895 17454 rpcz_store.cc:276] 0709 13:19:20.655116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.777694 (+1122578us) service_pool.cc:224] Handling call
0709 13:19:21.777995 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.778228 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.778258 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.778305 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:21.778340 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.778393 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.778487 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:21.779466 21052 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:21.780452 21052 raft_consensus.cc:697] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:21.802841 20797 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:21.813962 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 43988.7us
I20260709 13:19:21.819957 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:21.829774 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.833449 17446 raft_consensus.cc:1275] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:19:21.836506 17526 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
W20260709 13:19:21.841346 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.834034 17446 pending_rounds.cc:85] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 5
I20260709 13:19:21.835865 20996 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:21.781750 21052 consensus_queue.cc:237] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:21.851975 20775 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:21.847712 17446 pending_rounds.cc:107] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:19:21.864055 17446 raft_consensus.cc:2889] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:21.847535 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:21.858577 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1977) took 1612 ms. Trace:
I20260709 13:19:21.714488 17347 catalog_manager.cc:5697] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 8 to 7, leader changed from <none> to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 7 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:21.867250 17451 rpcz_store.cc:276] 0709 13:19:20.246098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.824093 (+1577995us) service_pool.cc:224] Handling call
0709 13:19:21.846393 (+ 22300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.850160 (+  3767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.850200 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.858012 (+  7812us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:21.858091 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.858173 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.858511 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:21.861984 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 294253us
W20260709 13:19:21.893137 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 293307us
I20260709 13:19:21.857719 20996 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:21.895617 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.931180 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.900393 20996 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:21.941130 17420 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:22.017179 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 76204.9us
W20260709 13:19:22.001894 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.928218 17347 catalog_manager.cc:5697] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 5 to 6, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 6 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:22.017835 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 171719us
I20260709 13:19:22.034883 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 320) took 1375 ms. Trace:
I20260709 13:19:22.035763 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1980) took 1373 ms. Trace:
I20260709 13:19:22.036166 17451 rpcz_store.cc:276] 0709 13:19:20.656271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.876460 (+1220189us) service_pool.cc:224] Handling call
0709 13:19:21.932104 (+ 55644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.031054 (+ 98950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.031109 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.031172 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:22.031254 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.031384 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.031639 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:22.036355 17453 rpcz_store.cc:276] 0709 13:19:20.657755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.899461 (+1241706us) service_pool.cc:224] Handling call
0709 13:19:21.930484 (+ 31023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.016233 (+ 85749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.016285 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.030571 (+ 14286us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:22.030611 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.030671 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.030795 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:22.055758 17419 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:22.065913 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 322) took 1325 ms. Trace:
I20260709 13:19:22.071419 17448 rpcz_store.cc:276] 0709 13:19:20.740765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.017149 (+1276384us) service_pool.cc:224] Handling call
0709 13:19:22.052586 (+ 35437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.065410 (+ 12824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.065455 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.065505 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:22.065548 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.065623 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.065759 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:22.067646 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 139372us
I20260709 13:19:22.028431 20977 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:22.083164 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1617) took 1954 ms. Trace:
I20260709 13:19:22.083609 17446 rpcz_store.cc:276] 0709 13:19:20.128334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.468824 (+1340490us) service_pool.cc:224] Handling call
0709 13:19:21.469219 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.889849 (+420630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.075507 (+185658us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400369554. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:22.083036 (+  7529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822229248}
I20260709 13:19:22.035527 20948 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.089367 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 324) took 1262 ms. Trace:
I20260709 13:19:22.083302 17453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:19:22.089829 17451 rpcz_store.cc:276] 0709 13:19:20.819359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.058437 (+1239078us) service_pool.cc:224] Handling call
0709 13:19:22.080855 (+ 22418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.081071 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.081124 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.081177 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:22.081220 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.081290 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.081424 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:22.074877 21113 log.cc:927] Time spent T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:22.054240 21031 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:22.090495 17453 raft_consensus.cc:606] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:22.101888 17453 raft_consensus.cc:614] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:22.068390 21018 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:22.107170 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 51530us
I20260709 13:19:22.088250 20884 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:22.114821 20890 consensus_meta.cc:287] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.575s	user 0.013s	sys 0.000s
I20260709 13:19:22.115311 20881 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:22.117720 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.114866 20859 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:22.119737 21122 log.cc:927] Time spent T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 13:19:22.118173 20977 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.145882 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:22.085552 21086 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.280s
I20260709 13:19:22.146682 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 325) took 1324 ms. Trace:
I20260709 13:19:22.146947 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:22.147517 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:22.148557 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1973) took 1943 ms. Trace:
W20260709 13:19:22.171944 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.032970 20816 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:19:22.058359 21047 consensus_queue.cc:1059] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.273s
I20260709 13:19:22.156136 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:22.158344 17596 consensus_meta.cc:287] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.002s
I20260709 13:19:22.171459 17448 rpcz_store.cc:276] 0709 13:19:20.822439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.072865 (+1250426us) service_pool.cc:224] Handling call
0709 13:19:22.092756 (+ 19891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.106527 (+ 13771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.106569 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.146411 (+ 39842us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:22.146462 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.146522 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.146625 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:22.171792 17450 rpcz_store.cc:276] 0709 13:19:20.204941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.603267 (+1398326us) service_pool.cc:224] Handling call
0709 13:19:21.614141 (+ 10874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.621925 (+  7784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.621956 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.632294 (+ 10338us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.863596 (+231302us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:21.863650 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.863747 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.148293 (+284546us) raft_consensus.cc:1685] finished
0709 13:19:22.148312 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.148483 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17334,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":77,"thread_start_us":230776,"threads_started":1,"wal-append.queue_time_us":497892}
I20260709 13:19:22.094271 20948 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:22.185714 17522 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:22.178274 17528 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:22.182631 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:22.190737 17596 raft_consensus.cc:2410] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:22.164134 21002 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.174369 20720 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:19:22.204296 21129 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:19:22.204555 20720 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:22.205322 21002 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:22.178375 20884 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:22.206228 21123 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:19:22.207608 21002 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:22.207894 20884 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:22.208725 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1717) took 2174 ms. Trace:
I20260709 13:19:22.210636 17445 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:22.185482 20816 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:22.209453 17601 raft_consensus.cc:1240] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:22.221017 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.223778 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:22.230515 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1966) took 2029 ms. Trace:
I20260709 13:19:22.230960 17452 rpcz_store.cc:276] 0709 13:19:20.201562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.567238 (+1365676us) service_pool.cc:224] Handling call
0709 13:19:21.623042 (+ 55804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.659151 (+ 36109us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:21.659201 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.721824 (+ 62623us) log.cc:844] Serialized 26 byte log entry
0709 13:19:22.033747 (+311923us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:22.033784 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.033849 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.134871 (+101022us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b48003303d8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abaa8faa1 00007f5abaa86b37 00007f5abaa869ca 00007f5abab7e26f 00007f5abab7df37 00007f5abab9255c 00007f5abab92508 00007f5abab92488 00007f5abab92443 00007f5abab916ec 00007f5ab9abba96
0709 13:19:22.230208 (+ 95337us) raft_consensus.cc:1685] finished
0709 13:19:22.230236 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.230455 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66998,"raft.queue_time_us":6015,"raft.run_cpu_time_us":12645,"raft.run_wall_time_us":474049,"spinlock_wait_cycles":7140224,"thread_start_us":311502,"threads_started":1,"wal-append.queue_time_us":471171}
I20260709 13:19:22.234278 20816 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:22.235489 20816 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:22.237051 20816 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:22.240280 20998 consensus_meta.cc:287] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.001s
I20260709 13:19:22.240892 20998 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:22.244073 20948 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:22.244788 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1965) took 2043 ms. Trace:
I20260709 13:19:22.245246 17449 rpcz_store.cc:276] 0709 13:19:20.201310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.532072 (+1330762us) service_pool.cc:224] Handling call
0709 13:19:21.567056 (+ 34984us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.577911 (+ 10855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.577960 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.604810 (+ 26850us) log.cc:844] Serialized 26 byte log entry
0709 13:19:22.029459 (+424649us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:22.029498 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.029586 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.244520 (+214934us) raft_consensus.cc:1685] finished
0709 13:19:22.244550 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.244719 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3654,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":14990,"thread_start_us":372698,"threads_started":1,"wal-append.queue_time_us":608410}
I20260709 13:19:22.250113 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 319) took 1594 ms. Trace:
I20260709 13:19:22.214742 20863 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:22.250744 17454 rpcz_store.cc:276] 0709 13:19:20.655730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.779883 (+1124153us) service_pool.cc:224] Handling call
0709 13:19:21.780234 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.780526 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.780550 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.781057 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:19:22.027836 (+246779us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:22.052079 (+ 24243us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.151957 (+ 99878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.152032 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.249764 (+ 97732us) raft_consensus.cc:1685] finished
0709 13:19:22.249801 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.250001 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113850,"prepare.queue_time_us":29727,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":2527,"raft.queue_time_us":100762,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8948,"thread_start_us":156331,"threads_started":1,"wal-append.queue_time_us":465621}
I20260709 13:19:22.209100 17598 rpcz_store.cc:276] 0709 13:19:20.034288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.724868 (+690580us) service_pool.cc:224] Handling call
0709 13:19:20.764117 (+ 39249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.407845 (+643728us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:21.498356 (+ 90511us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.716270 (+217914us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.722034 (+  5764us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.729773 (+  7739us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:21.729814 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.729894 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.208417 (+478523us) raft_consensus.cc:1685] finished
0709 13:19:22.208451 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.208571 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":577096,"prepare.queue_time_us":240337,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":585476,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":6518,"thread_start_us":270227,"threads_started":2,"wal-append.queue_time_us":367215}
I20260709 13:19:22.183673 20977 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:22.262342 17524 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:22.263669 20998 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:22.265102 21045 consensus_meta.cc:287] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.003s
I20260709 13:19:22.267940 17347 catalog_manager.cc:5697] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 4 to 7, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 7 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:22.217034 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 379760us
I20260709 13:19:22.274443 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:22.261694 20977 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:22.222401 20859 raft_consensus.cc:697] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:22.292836 20863 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:22.293411 20863 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:22.297035 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1971) took 2094 ms. Trace:
W20260709 13:19:22.352298 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.392606 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:22.392711 20881 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:22.280517 21045 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:22.393512 20881 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:22.395787 21045 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:22.396900 20859 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:22.392627 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:22.402245 17569 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:22.290375 21103 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.405639 21103 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:22.410048 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:22.417380 21001 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:22.422842 20996 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:22.425165 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.426235 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.455314 21120 log.cc:927] Time spent T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.566s	user 0.004s	sys 0.000s
W20260709 13:19:22.435936 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 324868us
I20260709 13:19:22.429919 17419 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:22.466439 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1976) took 2233 ms. Trace:
I20260709 13:19:22.467044 17445 rpcz_store.cc:276] 0709 13:19:20.233123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.734054 (+1500931us) service_pool.cc:224] Handling call
0709 13:19:21.761093 (+ 27039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.219254 (+458161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.457949 (+238695us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54003cd7d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:22.466348 (+  8399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033372928}
I20260709 13:19:22.297889 17447 rpcz_store.cc:276] 0709 13:19:20.202661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.598354 (+1395693us) service_pool.cc:224] Handling call
0709 13:19:21.598826 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.599109 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:21.599500 (+   391us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.292565 (+693065us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.296542 (+  3977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.296618 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:22.296691 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.296784 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.296945 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59861,"prepare.queue_time_us":22885,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":68608,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":30195,"spinlock_wait_cycles":13238016,"thread_start_us":644810,"threads_started":2,"wal-append.queue_time_us":582608}
W20260709 13:19:23.028848 17596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.011s	sys 0.020s
I20260709 13:19:22.466552 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2110) took 2390 ms. Trace:
W20260709 13:19:23.033325 17596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.012s	sys 0.020s
I20260709 13:19:22.824297 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:22.726166 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.024230 17522 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:22.425967 20996 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:23.023342 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.041424 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:22.397725 17347 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 6 to 8, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 8 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:22.855749 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:22.762169 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.855264 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:23.041317 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 573827us
W20260709 13:19:23.057063 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.438902 21045 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.060256 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:23.062825 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 771074us
I20260709 13:19:23.061198 17523 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:23.063057 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 473) took 1204 ms. Trace:
W20260709 13:19:22.912496 20859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.023s
I20260709 13:19:22.877981 20977 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.025835 21103 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:23.071038 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:23.063808 17448 raft_consensus.cc:2368] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:23.064477 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:22.712850 21038 raft_consensus.cc:3055] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:23.070510 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:23.071192 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 438214us
I20260709 13:19:23.076231 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.075251 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:23.076864 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.077498 17522 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.033512 17521 rpcz_store.cc:276] 0709 13:19:20.067115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.095388 (+ 28273us) service_pool.cc:224] Handling call
0709 13:19:20.095765 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:20.096206 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.096232 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:20.096855 (+   623us) log.cc:844] Serialized 52 byte log entry
0709 13:19:21.410372 (+1313517us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b18003641e0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab57060d1 00007f5ab5b21a0f
0709 13:19:21.560957 (+150585us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:21.561023 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.570692 (+  9669us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.454626 (+883934us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:22.457392 (+  2766us) raft_consensus.cc:1685] finished
0709 13:19:22.457414 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.457609 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2434,"raft.queue_time_us":2652,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":28066,"spinlock_wait_cycles":15558400,"thread_start_us":99909,"threads_started":1,"wal-append.queue_time_us":1710530}
I20260709 13:19:23.076251 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:23.072737 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:23.078791 17447 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:23.063437 17526 rpcz_store.cc:276] 0709 13:19:21.858799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.859096 (+   297us) service_pool.cc:224] Handling call
0709 13:19:21.877989 (+ 18893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.918702 (+ 40713us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:22.286732 (+368030us) log.cc:844] Serialized 14 byte log entry
0709 13:19:23.061672 (+774940us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:23.062798 (+  1126us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:23.062843 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.062913 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.063009 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1932,"prepare.queue_time_us":131941,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":244086,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":901279,"threads_started":3,"wal-append.queue_time_us":758637}
I20260709 13:19:23.075603 17453 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:22.493739 20710 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:23.072460 20859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.013s	sys 0.028s
I20260709 13:19:22.493906 20998 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:23.086225 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:23.086987 17452 raft_consensus.cc:2368] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:23.083622 21152 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:23.077800 21038 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:23.083599 20710 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:23.060433 21065 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:19:23.061436 21153 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.089147 20863 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:23.075207 20996 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:23.084252 21147 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:19:23.104251 20448 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.104589 20996 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.104840 20448 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:23.106727 20996 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:23.107328 20996 consensus_queue.cc:1059] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:23.086243 17527 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:23.107779 17347 catalog_manager.cc:5697] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 7 to 9, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 9 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:23.109244 20996 raft_consensus.cc:3055] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:23.092015 17446 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:23.095889 17447 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:23.085295 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:23.098146 17449 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:23.097249 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:23.070562 21045 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:23.087996 20881 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:23.098598 20710 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:23.080703 20977 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.124634 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:23.109683 20996 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:23.090619 20998 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:23.134227 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 61868.1us
I20260709 13:19:23.132685 17445 raft_consensus.cc:1240] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:19:23.136567 20887 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:23.136750 20784 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.137313 20863 consensus_queue.cc:1059] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:23.106727 20448 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:23.140744 21142 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.145053 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.148641 17521 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:23.148792 21038 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:23.149797 20816 consensus_meta.cc:287] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.912s	user 0.013s	sys 0.000s
I20260709 13:19:23.149909 20863 raft_consensus.cc:3055] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:23.151834 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.162917 17453 raft_consensus.cc:2410] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:23.163997 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:23.165216 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:23.114765 21153 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.118922 21152 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.172283 17601 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:23.153932 20863 raft_consensus.cc:740] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:23.174319 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:23.175040 17451 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.109427 17347 catalog_manager.cc:5697] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 5 to 9, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 9 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.178112 21155 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:23.179440 17347 catalog_manager.cc:5697] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 4 to 7, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 7 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.182339 17450 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:23.184216 17522 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:23.165890 20797 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.165791 21103 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:23.146348 20784 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:23.170454 21038 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:23.191107 17451 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:23.192487 20998 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:23.193210 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:23.197654 17450 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:23.198035 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:23.200042 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:23.223541 17451 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:23.205641 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:23.204691 17454 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:23.224262 17594 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:23.158337 21142 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:23.226832 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 62931us
I20260709 13:19:23.229498 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:23.195845 21152 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:23.262372 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:23.264524 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1983) took 1898 ms. Trace:
I20260709 13:19:23.265057 17446 rpcz_store.cc:276] 0709 13:19:21.366411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.100213 (+733802us) service_pool.cc:224] Handling call
0709 13:19:22.149350 (+ 49137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.117038 (+967688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.264186 (+147148us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b5400185bd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:23.264442 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2167276928}
I20260709 13:19:23.195863 21103 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.286656 17452 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:23.292434 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.293062 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 60464.6us
I20260709 13:19:23.225590 21151 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.293784 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.298733 21149 log.cc:927] Time spent T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:19:23.301371 21158 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:23.302361 21158 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:23.302886 21158 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.202416 20996 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.305070 20996 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:23.310446 21158 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:23.310122 21151 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:23.314819 21153 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:23.315613 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.316911 21142 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:23.317189 21154 log.cc:927] Time spent T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:19:23.317806 21045 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:23.198338 20797 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:23.181171 17347 catalog_manager.cc:5697] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 7 to 10, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 10 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:23.447299 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.465708 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 386641us
I20260709 13:19:23.467046 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1729) took 1059 ms. Trace:
I20260709 13:19:23.479017 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:23.482372 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 406760us
I20260709 13:19:23.482594 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:23.483454 17596 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:23.484294 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:23.471253 17595 rpcz_store.cc:276] 0709 13:19:22.408084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.408533 (+   449us) service_pool.cc:224] Handling call
0709 13:19:22.408801 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.409134 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:22.409373 (+   239us) log.cc:844] Serialized 14 byte log entry
0709 13:19:23.466552 (+1057179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:23.466636 (+    84us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:23.466709 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.466799 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.466970 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":281259,"prepare.queue_time_us":626342,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":326933,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":770333,"threads_started":2,"wal-append.queue_time_us":687792}
I20260709 13:19:23.484894 17598 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:23.485442 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:23.486106 17594 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:23.483461 17569 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:23.487165 21142 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:23.488519 17569 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:23.496574 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:23.497311 17598 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:23.495815 17596 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:23.502828 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:23.503127 21142 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:23.505015 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:23.506487 17522 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:23.516851 17449 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:23.518483 17598 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:23.520207 17524 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:23.296514 20863 consensus_queue.cc:260] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.509910 17450 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:23.510154 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:23.512408 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.512974 17452 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:23.523231 17527 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:23.509477 17594 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
W20260709 13:19:23.528798 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 362309us
I20260709 13:19:23.531293 17596 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:23.536010 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.533650 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.533059 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:23.535341 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:23.542448 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:23.516100 21166 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:23.548563 17526 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:23.549717 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:23.551483 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:23.553133 17526 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:23.565105 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:23.567099 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 53305.6us
I20260709 13:19:23.539738 21142 raft_consensus.cc:697] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:23.534931 20816 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:23.565798 17598 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:23.588267 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:23.591540 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.592109 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:23.594097 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:23.572466 20863 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.599401 17526 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:23.605684 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:23.616442 20784 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:23.590359 20448 consensus_queue.cc:1059] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:19:23.619494 21041 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:23.616094 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:23.626199 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:23.626478 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:23.637513 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.639995 17523 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
W20260709 13:19:23.645324 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 111968us
I20260709 13:19:23.625582 20448 raft_consensus.cc:3055] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:23.631301 21055 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:19:23.647974 20448 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:23.648808 17419 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:23.649017 20448 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:23.650175 20769 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:23.597740 21103 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:23.622735 21048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.457s	user 0.014s	sys 0.029s
I20260709 13:19:23.593427 20816 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.667049 21157 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:23.667923 21157 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:23.678344 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 50165.9us
W20260709 13:19:23.656869 21048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.523s	user 0.014s	sys 0.029s
I20260709 13:19:23.574941 21166 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.618831 21167 consensus_queue.cc:1059] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:19:23.687222 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:23.673439 21103 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:23.690166 21167 raft_consensus.cc:3055] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:23.690215 21103 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.690722 21167 raft_consensus.cc:740] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:23.690845 21157 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:23.690996 17347 catalog_manager.cc:5697] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 5 to 8, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 8 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.694588 21158 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:23.695044 17495 leader_election.cc:400] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:23.695714 17495 leader_election.cc:403] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:23.697124 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:23.643188 21152 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:19:23.621821 21170 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 13:19:23.703033 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 142316us
W20260709 13:19:23.705255 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 79147.1us
I20260709 13:19:23.707608 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:23.707383 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:23.686755 20448 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:23.716217 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:23.693763 17347 catalog_manager.cc:5697] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 5 to 6, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 6 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:23.712988 21159 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:23.670851 21172 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:19:23.714591 21065 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:23.732440 17521 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:19:23.742693 17521 pending_rounds.cc:85] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 7
I20260709 13:19:23.743037 17521 pending_rounds.cc:107] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:19:23.743274 17521 raft_consensus.cc:2889] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:23.735752 17419 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:23.730976 20998 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:23.734848 21157 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:23.752928 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 45661us
I20260709 13:19:23.742237 21178 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:23.743598 21161 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:23.742478 21177 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.792196 20977 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:23.744272 21180 consensus_queue.cc:1059] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:19:23.761677 21178 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.793543 21161 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.794138 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.756381 20797 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:23.811441 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 51164.6us
I20260709 13:19:23.714118 21142 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:23.794692 21175 log.cc:927] Time spent T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:23.747608 20769 consensus_queue.cc:1059] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:19:23.831949 21187 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:23.828864 21152 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.847600 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:23.854710 21166 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:23.832191 21178 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:23.858407 21185 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.858915 21185 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:23.832141 21161 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:23.866609 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 150455us
I20260709 13:19:23.869946 17495 leader_election.cc:400] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
W20260709 13:19:23.849539 21179 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:19:23.877084 20797 raft_consensus.cc:3055] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:23.877552 20797 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:23.863416 21038 consensus_meta.cc:287] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.003s
I20260709 13:19:23.848896 20977 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.891978 17420 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.523s (SENT) [suppressed 30 similar messages]
I20260709 13:19:23.907876 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.908695 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.908965 17524 raft_consensus.cc:2393] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:23.872653 20769 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:23.883843 21170 raft_consensus.cc:3055] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:23.914203 21151 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:23.914240 21170 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:23.915371 21170 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.916673 21170 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:23.919281 21047 raft_consensus.cc:3055] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:23.919893 21047 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:23.906149 20977 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.923455 20977 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:23.925232 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.925254 21170 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:23.925907 21170 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.906095 21158 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:23.927767 17599 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:23.927690 21158 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.928409 21170 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:23.908938 21167 consensus_queue.cc:260] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.928933 21170 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.929531 21167 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:23.929421 21170 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:23.930281 20769 raft_consensus.cc:697] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:23.931229 20769 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.931885 21170 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:23.934829 21185 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:23.943284 20710 consensus_meta.cc:287] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.809s	user 0.011s	sys 0.001s
I20260709 13:19:23.943778 20710 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.860342 21152 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.946542 20797 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.947821 20797 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:23.950616 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.951819 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.952661 17520 raft_consensus.cc:2410] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:23.953470 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.956869 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.957517 17529 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:19:23.958431 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.959523 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.960197 17529 raft_consensus.cc:2393] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:23.872274 21187 raft_consensus.cc:697] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:23.968176 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:23.962471 17520 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:23.966626 17595 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:23.970283 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 59241.9us
W20260709 13:19:23.971284 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 79325.4us
I20260709 13:19:23.978881 17419 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:23.929813 21158 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:23.838114 21177 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:23.982795 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.988348 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:23.988636 17529 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
W20260709 13:19:23.985795 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 116189us
I20260709 13:19:23.987087 17419 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:23.991797 17568 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:23.984702 20977 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:23.978459 20903 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:19:23.996094 21155 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:23.983978 21156 consensus_queue.cc:1059] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:19:23.860749 17347 catalog_manager.cc:5697] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
W20260709 13:19:24.024545 17599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1724) took 1618 ms (client timeout 2142 ms). Trace:
W20260709 13:19:24.027101 17599 rpcz_store.cc:269] 0709 13:19:22.406405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.410794 (+  4389us) service_pool.cc:224] Handling call
0709 13:19:23.205440 (+794646us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b58001a1398. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:19:24.024280 (+818840us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b5400062a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:24.024382 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629278976}
I20260709 13:19:24.000964 20784 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:23.985719 20863 consensus_queue.cc:1059] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:19:24.017664 20977 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.017648 21170 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.996259 21048 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:19:24.017426 21185 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:23.996210 21163 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:19:23.996137 21164 consensus_queue.cc:1059] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:19:24.047822 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 57740.5us
I20260709 13:19:24.029982 20784 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:24.048030 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 50777us
I20260709 13:19:24.024055 21155 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.034487 21152 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:24.053753 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.038426 21190 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.038683 20977 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:24.099311 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 44730us
I20260709 13:19:24.100277 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:24.053989 21158 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:19:24.051471 20784 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:24.117113 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 64437.7us
I20260709 13:19:24.065991 21155 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.049806 21185 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:24.114759 21045 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:24.131419 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:24.134217 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.043815 21170 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:24.150851 17452 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:24.151171 17449 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:24.155174 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:24.155624 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 99179us
I20260709 13:19:24.156335 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:24.129973 20710 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:24.126427 17347 catalog_manager.cc:5697] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 5 to 9, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 9 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.177465 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:24.194677 17525 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 11: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:24.185516 17451 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:24.158618 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.158318 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.186621 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:24.155844 17446 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:24.178664 17529 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:24.196898 17520 raft_consensus.cc:2410] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:19:24.187952 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:24.134318 20769 raft_consensus.cc:3055] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:24.172740 18200 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:24.197357 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:24.221426 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 224415us
I20260709 13:19:24.157784 21162 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.157867 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.245478 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.245854 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.247232 17527 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:24.248361 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:24.166921 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.175719 21185 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:24.255771 17453 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:24.154716 21161 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:24.256223 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.256898 17451 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:24.257222 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:24.257684 21198 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:19:24.257884 21161 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:24.164717 21170 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:24.249697 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:24.260000 17522 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:24.260237 21103 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:24.201000 21159 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:24.167618 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.184468 21177 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:24.124462 21190 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:24.261724 18197 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:24.198776 20769 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:24.147847 21045 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:24.240969 21158 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:24.270015 21159 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:24.338164 21196 log.cc:927] Time spent T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.237s	user 0.000s	sys 0.002s
I20260709 13:19:24.338896 21159 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:24.339743 21045 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:24.338208 21158 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:24.281203 17447 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:24.281352 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.281391 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.348116 17452 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:24.283591 20769 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:24.169420 21178 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:24.286113 21152 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:24.100098 21187 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:24.291329 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.292445 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.355495 18195 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:24.293238 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.250177 21162 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:24.359273 18193 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 4.
I20260709 13:19:24.360499 21162 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:24.295389 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.361433 18192 raft_consensus.cc:2393] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 10: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:24.295514 21047 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:24.296156 21161 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:24.263217 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:24.296991 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.300058 21155 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:24.350906 20859 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:19:24.365965 21155 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:24.353150 20784 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:24.302429 17347 catalog_manager.cc:5697] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 5 to 8, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 8 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.369053 20784 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:24.370258 21152 raft_consensus.cc:3055] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:24.370831 21152 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:24.371984 21152 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:24.305853 21048 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:24.306257 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:24.374135 17451 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:24.308214 20816 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:24.293797 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:24.310405 17568 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:24.315379 21182 raft_consensus.cc:3055] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:24.277776 21153 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:24.323108 21190 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:24.329725 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:24.332067 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.335665 21142 raft_consensus.cc:3055] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:24.351073 21158 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:24.341275 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 63052.5us
I20260709 13:19:24.420732 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:24.280725 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.421540 17448 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
W20260709 13:19:24.320912 21157 consensus_meta.cc:287] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.000s
I20260709 13:19:24.376452 17419 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:24.390982 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 97261.6us
I20260709 13:19:24.431370 17420 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:24.433941 21170 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:24.404539 17449 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:24.408706 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 98355.8us
W20260709 13:19:24.337519 21192 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:19:24.409003 21142 raft_consensus.cc:740] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:24.411965 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:24.391669 21182 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:24.414592 20784 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:24.395406 21155 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:19:24.453037 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.446763 21157 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:24.453691 18194 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:24.418455 21152 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:24.418809 20769 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.426205 17451 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:24.428808 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:24.461503 21155 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:24.457835 21142 consensus_queue.cc:260] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:24.463152 21045 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:24.463644 21045 raft_consensus.cc:697] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:24.463793 21142 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.464546 21045 consensus_queue.cc:237] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:24.461956 21155 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.466935 21155 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:24.467204 21178 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:24.467856 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:24.417878 20977 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:24.445219 17420 leader_election.cc:336] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.994s (SENT)
I20260709 13:19:24.447685 17521 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 4.
I20260709 13:19:24.408812 20816 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:24.475999 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.451134 20784 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.447187 20998 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:24.374055 21048 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:24.458572 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 82219.8us
I20260709 13:19:24.472582 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:24.485584 17599 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.474511 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:24.436802 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.428092 21153 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:24.476847 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:24.492201 17527 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.481441 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:24.481874 18166 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:24.495114 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.499691 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:24.503288 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:24.504107 17596 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:24.506179 17446 raft_consensus.cc:2393] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 5: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:24.507653 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:24.501762 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:24.516505 17451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "347905859bee416fb447f19528527f52"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:19:24.475927 20816 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:24.517165 17451 raft_consensus.cc:606] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:24.517921 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:24.482542 20784 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.519871 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:24.524717 17600 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:24.520103 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.520107 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.528364 17447 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:24.519871 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.518421 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:24.521521 17523 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:24.521862 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.523186 17454 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.529325 17448 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:24.505517 21052 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:24.484997 21206 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:24.534674 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:24.514075 21162 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:24.516606 21185 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:24.514153 21177 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:24.524132 20816 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.580739 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.583739 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.584643 17448 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:24.591109 21153 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:24.519882 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:24.612880 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.613691 17446 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:24.605911 17599 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:24.638280 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:24.653771 17454 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:24.581295 21052 raft_consensus.cc:697] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:24.523964 21065 consensus_queue.cc:1059] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:19:24.556492 21162 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.557523 21177 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.558454 21185 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:24.663501 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:24.774850 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 180862us
I20260709 13:19:24.700453 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:24.684015 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:24.581674 21159 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.787338 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.788419 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.799927 17446 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:24.799903 17447 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:24.795086 17527 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:24.789366 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:24.803668 18201 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
W20260709 13:19:24.787763 17495 connection.cc:256] RPC call timeout handler was delayed by -1.0314753999998629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
I20260709 13:19:24.815762 20977 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:24.816954 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.817044 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:24.818364 21216 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:24.822964 21048 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:24.841842 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.852111 17595 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 7.
I20260709 13:19:24.863977 17449 raft_consensus.cc:2410] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:24.787887 21162 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.791461 21177 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:24.887943 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 70984.2us
I20260709 13:19:24.890429 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:24.892164 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.901444 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:24.681524 17600 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:24.663945 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:24.906533 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:24.700757 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:24.896265 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:24.948451 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:24.948779 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 47425.7us
I20260709 13:19:24.949565 17600 raft_consensus.cc:2368] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9.
I20260709 13:19:24.952579 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:24.956667 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:24.947320 21217 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:24.960444 17445 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:24.961066 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:24.967469 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:24.968204 17603 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:24.774565 21052 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:24.897959 21185 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.646380 21211 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:24.858425 21159 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:24.994160 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:24.950482 21065 consensus_queue.cc:1243] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:25.003901 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.004590 17603 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
W20260709 13:19:25.005566 17492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.011s	sys 0.055s
W20260709 13:19:25.031646 17492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.011s	sys 0.055s
I20260709 13:19:25.010434 17529 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:25.034181 17568 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:25.046840 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 85883.2us
I20260709 13:19:25.050706 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:25.065472 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:25.030709 20998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.000s	sys 0.014s
I20260709 13:19:25.085619 17527 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:25.076337 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.087105 17600 raft_consensus.cc:2368] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9.
I20260709 13:19:24.581184 21206 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.079360 21159 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.067265 21220 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:25.053896 21142 consensus_meta.cc:287] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.590s	user 0.013s	sys 0.000s
W20260709 13:19:25.093611 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 45559.4us
I20260709 13:19:25.102916 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:25.098476 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.110647 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.112874 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.132261 17600 raft_consensus.cc:2410] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:25.068982 21216 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:25.054710 21201 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:25.085292 20998 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:25.108807 20784 consensus_meta.cc:287] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.003s
I20260709 13:19:25.136780 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:25.151162 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.152133 17600 raft_consensus.cc:2368] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 9. Current term is 10.
I20260709 13:19:25.153122 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.154004 17600 raft_consensus.cc:2368] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12.
I20260709 13:19:25.154907 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.048414 21211 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.156826 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.161728 17600 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:25.138124 21045 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:25.162927 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:25.165891 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.169214 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.170142 17603 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:25.171854 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.172402 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.172710 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:25.172503 17600 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:25.175467 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.177145 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.189819 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:25.192521 17601 raft_consensus.cc:2410] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:25.160733 20784 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:25.197029 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.163517 21201 raft_consensus.cc:697] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:25.179117 17600 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:25.167687 21045 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:25.192822 21217 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:25.212060 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.212846 17600 raft_consensus.cc:2368] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12.
I20260709 13:19:25.177561 21222 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:25.215197 21219 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:19:25.220820 20816 consensus_meta.cc:287] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.000s
I20260709 13:19:25.222138 17594 raft_consensus.cc:2393] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:19:25.231002 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 141421us
I20260709 13:19:25.224248 20998 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:25.226337 21155 consensus_meta.cc:287] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.758s	user 0.009s	sys 0.003s
I20260709 13:19:25.226949 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.229331 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.203979 20903 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.234840 21217 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:25.254642 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.254560 20903 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:25.255577 17603 raft_consensus.cc:2410] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:19:25.255110 21217 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.204638 21045 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:25.203850 21220 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:25.223801 21206 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:25.237978 21224 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:25.258972 21182 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.260172 21182 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.257369 21155 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.262307 21155 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.252317 20816 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.264413 21222 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:25.264951 21222 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.268600 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:25.269810 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:25.270398 17520 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:25.243950 21156 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:25.276600 21156 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:25.277063 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.245733 21162 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:25.246829 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:25.249764 21158 consensus_meta.cc:287] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.814s	user 0.006s	sys 0.004s
I20260709 13:19:25.249852 21200 raft_consensus.cc:3055] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:25.220820 20769 consensus_meta.cc:287] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.004s
I20260709 13:19:25.215332 21211 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:25.258038 20903 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.258399 21220 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:25.242416 21201 consensus_queue.cc:237] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.269810 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.303690 17599 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
W20260709 13:19:25.304155 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.286221 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.304702 17598 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:25.286736 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.285210 18166 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:25.286352 17495 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:25.299526 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.305963 17600 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:25.306712 17603 raft_consensus.cc:2410] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:25.307134 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:25.289287 20784 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:25.309715 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:25.326068 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:25.297561 21200 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:25.323204 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.310351 20903 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:25.300773 20816 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.299106 21158 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.303772 21220 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.326439 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:25.342712 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.309242 21172 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:25.344815 17602 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:25.339461 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.345768 17520 raft_consensus.cc:2393] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 11: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:25.352900 17601 raft_consensus.cc:2393] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 7: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:25.341732 21177 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:25.364493 21227 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:25.365118 21158 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.364679 21185 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:25.325650 21224 consensus_queue.cc:1059] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:25.342686 20903 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.396389 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.342442 21159 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:25.396997 17600 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
I20260709 13:19:25.397137 21159 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.397876 21177 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:25.398797 21047 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:25.383411 21222 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.400192 21159 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:25.374217 21152 consensus_meta.cc:287] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.914s	user 0.002s	sys 0.012s
I20260709 13:19:25.367511 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.397841 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.365482 21218 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:25.383888 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.404258 17601 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:25.405582 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.349543 21172 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:25.385769 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.389756 21162 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:25.394274 20797 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:25.395550 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:25.396507 20903 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.375567 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:25.402874 17598 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:25.411175 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.415488 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.416138 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.416841 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.418409 21224 consensus_queue.cc:1243] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:25.418948 21224 raft_consensus.cc:3055] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:25.419261 21224 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:25.420083 21224 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.421279 21224 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:25.422883 17528 raft_consensus.cc:2410] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:25.423524 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.424660 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.425387 17600 raft_consensus.cc:2410] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:19:25.426316 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 99994.4us
I20260709 13:19:25.427314 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.429536 17453 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 11: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:25.428182 17600 raft_consensus.cc:2410] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:25.400980 21227 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:25.429646 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:25.412227 21158 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:25.413249 21172 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:25.445055 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.413457 21167 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.426800 20797 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:25.478525 20797 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.462602 20769 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:25.487167 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.489352 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:25.443687 21185 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:25.464488 21227 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.465765 21205 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:25.466514 21167 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.429292 21200 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.471546 21210 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:25.494724 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:25.474901 21247 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:25.476711 21158 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:25.454118 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:19:25.499222 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 45166.9us
I20260709 13:19:25.430927 21218 raft_consensus.cc:697] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:25.489753 17602 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:25.493939 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.437191 21045 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:25.497844 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:25.490751 20797 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:25.490635 20996 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:25.501164 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.493541 21222 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:25.500914 17600 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:25.502893 17569 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:25.506678 17523 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:25.506464 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:25.510257 17569 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:25.507041 17601 raft_consensus.cc:2410] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:25.510918 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:25.512214 21218 consensus_queue.cc:237] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.502655 21065 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:25.498510 21247 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:25.522607 17529 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:25.501806 21216 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:25.499071 21210 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:25.508821 21214 log.cc:927] Time spent T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.790s	user 0.005s	sys 0.000s
I20260709 13:19:25.523310 17569 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:25.515584 21065 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.496438 20769 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.509475 21206 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:25.507035 21217 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:25.518879 20998 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:25.552443 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:25.541194 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:25.553021 21065 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:25.510794 21222 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:25.539106 21048 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:19:25.555295 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.522415 21239 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:25.513761 21220 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:25.495792 21205 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.537895 21247 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.556838 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:25.551447 21153 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.540001 21216 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:25.551676 21152 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:25.558297 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:25.555284 21211 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:25.518702 20996 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.584407 20863 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:25.537860 21163 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:19:25.556550 20998 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:25.584481 21222 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:25.550993 21142 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:25.586764 21159 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:25.599192 20996 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.593964 21211 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.594127 21152 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:25.607837 21220 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:25.608029 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.609515 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:25.631866 17454 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:25.632396 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1667) took 1017 ms. Trace:
I20260709 13:19:25.632929 17454 rpcz_store.cc:276] 0709 13:19:24.615153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.733209 (+118056us) service_pool.cc:224] Handling call
0709 13:19:25.609356 (+876147us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b5800002798. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:19:25.632317 (+ 22961us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4221696}
I20260709 13:19:25.610664 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:25.611610 18196 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
W20260709 13:19:25.612032 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.612843 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 56075.3us
I20260709 13:19:25.614652 20769 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:25.615756 21210 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:25.618363 20903 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:25.556238 21158 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.592164 21206 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:25.619747 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.620196 21167 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:25.595541 21216 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:25.641114 21162 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.653231 21162 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:25.603418 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 496) took 1222 ms. Trace:
I20260709 13:19:25.627182 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:25.634346 17520 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:25.631011 21159 raft_consensus.cc:697] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:25.634868 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:25.635488 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.639746 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.670401 17602 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:25.623690 20998 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:25.646499 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.654698 21205 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:25.631095 21152 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.631222 21211 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.681146 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.681633 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.681756 17595 raft_consensus.cc:2376] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11. Re-sending same reply.
I20260709 13:19:25.660480 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 1762) took 1332 ms. Trace:
I20260709 13:19:25.682248 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1537) took 1044 ms. Trace:
I20260709 13:19:25.682603 17595 rpcz_store.cc:276] 0709 13:19:24.637560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.872405 (+234845us) service_pool.cc:224] Handling call
0709 13:19:25.680993 (+808588us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b58001a1398. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:19:25.682196 (+  1203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12504320}
I20260709 13:19:25.683825 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.684321 17595 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.671518 17599 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.670524 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1530) took 1034 ms. Trace:
I20260709 13:19:25.636988 20903 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.675278 17522 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:19:25.698220 17522 pending_rounds.cc:85] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 4
I20260709 13:19:25.698479 17522 pending_rounds.cc:107] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:19:25.698727 17522 raft_consensus.cc:2889] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:25.686702 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 1993) took 1491 ms. Trace:
I20260709 13:19:25.597180 21153 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:25.704085 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:25.695856 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1657) took 1178 ms. Trace:
I20260709 13:19:25.654330 17525 rpcz_store.cc:276] 0709 13:19:24.381029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.381293 (+   264us) service_pool.cc:224] Handling call
0709 13:19:24.412708 (+ 31415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.413029 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.413056 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:24.413478 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.506448 (+ 92970us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:24.506485 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.506548 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:25.469696 (+963148us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:25.592505 (+122809us) raft_consensus.cc:1685] finished
0709 13:19:25.592535 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.603323 (+ 10788us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1337,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":42377088,"thread_start_us":92611,"threads_started":1,"wal-append.queue_time_us":119680}
I20260709 13:19:25.705015 17527 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.705240 17453 rpcz_store.cc:276] 0709 13:19:24.517870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.518121 (+   251us) service_pool.cc:224] Handling call
0709 13:19:25.695642 (+1177521us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b5400186ad4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:25.695792 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2063529856}
I20260709 13:19:25.697095 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1528) took 1062 ms. Trace:
I20260709 13:19:25.682446 17528 rpcz_store.cc:276] 0709 13:19:24.328414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.329396 (+   982us) service_pool.cc:224] Handling call
0709 13:19:25.660294 (+1330898us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000ff354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:25.660423 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340845440}
I20260709 13:19:25.699649 17450 rpcz_store.cc:276] 0709 13:19:24.195660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.195789 (+   129us) service_pool.cc:224] Handling call
0709 13:19:24.196056 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.196248 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:24.351027 (+154779us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.521800 (+170773us) log.cc:844] Serialized 14 byte log entry
0709 13:19:25.391762 (+869962us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b18003c1660. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a472a6 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1
0709 13:19:25.393704 (+  1942us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b18003c1660. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:19:25.686051 (+292347us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b18003c1660. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab29f3c0a 00007f5abc133219 00007f5ab2a7ba40 00007f5ab2a764e4 00007f5ab2a76455 00007f5ab5b5e060 00007f5ab5b70716 00007f5ab5b81287 00007f5ab5b81208
0709 13:19:25.686236 (+   185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:25.686307 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:25.686376 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.686464 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.686629 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2252,"prepare.queue_time_us":257840,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":85,"raft.queue_time_us":2181,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":6660,"spinlock_wait_cycles":64704000,"thread_start_us":209484,"threads_started":2,"wal-append.queue_time_us":183905,"wal-append.run_cpu_time_us":1487,"wal-append.run_wall_time_us":1002393}
I20260709 13:19:25.685369 17600 rpcz_store.cc:276] 0709 13:19:24.635626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.635206 (+999580us) service_pool.cc:224] Handling call
0709 13:19:25.670465 (+ 35259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:25.637257 21156 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:25.703011 17568 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:25.710453 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:25.706230 17596 rpcz_store.cc:276] 0709 13:19:24.635060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.799262 (+164202us) service_pool.cc:224] Handling call
0709 13:19:25.681509 (+882247us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b58001a1398. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:19:25.697037 (+ 15528us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30439808}
I20260709 13:19:25.690340 17520 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 5.
I20260709 13:19:25.713647 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:25.716053 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:25.716915 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.717458 17597 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:25.717550 17599 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
W20260709 13:19:25.701958 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 67170.9us
I20260709 13:19:25.716259 17595 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:25.719537 21156 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:25.674463 21246 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:25.718673 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:25.722967 17599 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:25.724900 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:25.725319 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:25.729183 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:25.730553 18196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42548 (request call id 346) took 1530 ms (client timeout 1519 ms). Trace:
I20260709 13:19:25.704752 21205 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:25.664513 21172 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.750633 17596 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:25.751005 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:25.751271 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1531) took 1115 ms. Trace:
I20260709 13:19:25.751605 17596 rpcz_store.cc:276] 0709 13:19:24.635904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.722488 (+1086584us) service_pool.cc:224] Handling call
0709 13:19:25.750432 (+ 27944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.751058 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.751222 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:25.730986 18196 rpcz_store.cc:269] 0709 13:19:24.191292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.198182 (+  6890us) service_pool.cc:224] Handling call
0709 13:19:25.721424 (+1523242us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400438354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:25.721573 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2702885248}
I20260709 13:19:25.746480 17594 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:19:25.747413 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1533) took 1110 ms. Trace:
I20260709 13:19:25.706219 21227 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:25.748245 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:25.754129 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.756287 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:25.708127 21220 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:25.758458 17600 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:19:25.761504 17521 raft_consensus.cc:2393] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:25.753363 17594 pending_rounds.cc:85] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 4
I20260709 13:19:25.715000 21217 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.763571 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:25.754328 17599 rpcz_store.cc:276] 0709 13:19:24.636467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.719102 (+1082635us) service_pool.cc:224] Handling call
0709 13:19:25.722810 (+  3708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.727836 (+  5026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.747313 (+ 19477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:25.764720 17528 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:25.781243 17596 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:25.787719 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:25.788394 17450 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:25.727144 21246 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:25.791172 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:25.793026 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.786398 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:25.793414 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.753362 21156 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.785599 17527 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
I20260709 13:19:25.749131 20903 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:25.794334 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:25.795055 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:25.752091 21045 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:25.796121 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:25.804454 17445 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:25.805716 17452 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:25.803701 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:25.810401 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:25.797960 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:25.812933 17450 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:25.764062 17594 pending_rounds.cc:107] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260709 13:19:25.813997 17594 raft_consensus.cc:2917] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
I20260709 13:19:25.814563 17594 raft_consensus.cc:2889] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:25.798877 17448 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:25.769512 21167 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:25.817916 17445 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:25.802541 17569 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:25.769068 20784 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:25.822162 17521 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:25.815433 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:25.816565 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:25.823550 18196 raft_consensus.cc:2393] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 5: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:25.799319 21155 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.796209 21246 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.826972 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:25.770162 21227 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.804811 21205 raft_consensus.cc:2764] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:25.833922 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:25.835081 18201 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:25.835227 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:25.829622 21249 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:19:25.812501 20903 raft_consensus.cc:697] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:25.792428 21220 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.817800 21158 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:25.829824 21177 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.833339 21185 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.884727 17597 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:25.878082 17529 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:25.885838 17596 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:25.837739 21045 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:25.830157 21156 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:25.831619 21182 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.850317 21157 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.868554 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52562 (request call id 9) took 21577 ms. Trace:
I20260709 13:19:25.828992 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:25.836254 21155 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:25.876478 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.922616 18166 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:25.923336 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.884513 21218 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:25.891149 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:25.839695 21170 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:25.912930 21243 consensus_queue.cc:1059] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:25.936223 17524 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:25.915042 21156 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:25.831972 20784 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.817054 21159 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:25.923904 17595 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.923794 17569 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:25.913898 17594 rpcz_store.cc:276] 0709 13:19:04.291594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.291729 (+   135us) service_pool.cc:224] Handling call
0709 13:19:05.143094 (+851365us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b2c00007508. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446ea0a 00007f5ab446e693 00007f5ab446e631 00007f5ab5ba1902 00007f5ab5ba16dd 00007f5ab5b6cf3f 00007f5ab5b6c6b3 00007f5abab2cd29 00007f5ab40ab1d4 00007f5ab40ab162
0709 13:19:06.382016 (+1238922us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b58003902d0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5ac20aa 00007f5ab5b44447 00007f5ab5b6170a 00007f5ab5b6276a 00007f5ab5b6191b 00007f5ab5b6d03c 00007f5ab5b6c6b3 00007f5abab2cd29 00007f5ab40ab1d4 00007f5ab40ab162
0709 13:19:06.525304 (+143288us) log.cc:844] Serialized 506 byte log entry
0709 13:19:25.868426 (+19343122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33370,"raft.queue_time_us":756138,"raft.run_cpu_time_us":2120,"raft.run_wall_time_us":14593,"spinlock_wait_cycles":932724224,"thread_start_us":1058676,"threads_started":4,"wal-append.queue_time_us":595120,"wal-append.run_cpu_time_us":1901,"wal-append.run_wall_time_us":1056568}
I20260709 13:19:25.883515 20710 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:25.854516 18201 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:25.927989 21200 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:25.946822 21156 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:25.955720 18192 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 11: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:19:25.974545 21255 log.cc:927] Time spent T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:19:25.974857 21259 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:25.975416 21259 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:25.919862 21182 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.947551 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:25.978454 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:25.981050 21224 consensus_meta.cc:287] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.002s
I20260709 13:19:25.981870 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:25.982658 17445 raft_consensus.cc:2393] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 5: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:25.982939 20784 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:25.983830 17450 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:25.926864 21206 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:25.984261 21152 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.984607 21206 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.985450 17523 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:25.921581 21157 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.986824 21206 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:25.927518 21218 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:25.987241 21152 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.987552 21218 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:25.988011 21157 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.891775 21177 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.989691 21247 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.990415 21220 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.991791 21247 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.932512 21052 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:25.895973 21185 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:25.983909 21172 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:25.971596 21158 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:25.997867 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:26.000675 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 76974.2us
I20260709 13:19:26.031267 17569 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:25.946323 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 112505us
I20260709 13:19:26.011413 17595 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:26.060428 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:26.119807 17450 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:19:26.122905 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 91709.6us
W20260709 13:19:26.160508 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 216762us
I20260709 13:19:26.162680 17529 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:25.935281 21170 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:26.176719 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.182593 21227 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:26.022565 21153 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:26.020716 21205 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:26.190973 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
W20260709 13:19:26.186792 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 59212.5us
I20260709 13:19:26.196568 17569 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.136333 21048 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:26.205768 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:25.998960 20710 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:26.207397 17453 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
W20260709 13:19:26.216253 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 220069us
I20260709 13:19:26.216390 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:26.222519 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:26.224124 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:25.996037 20903 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:26.233580 17453 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:26.239600 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:26.243731 17453 raft_consensus.cc:2393] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:26.118902 21158 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:26.235150 21227 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:26.259712 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:26.266784 17453 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.239916 21152 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:26.270273 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1529) took 1635 ms. Trace:
I20260709 13:19:26.270798 17594 rpcz_store.cc:276] 0709 13:19:24.635349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.718185 (+1082836us) service_pool.cc:224] Handling call
0709 13:19:25.746149 (+ 27964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.269911 (+523762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.270196 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:26.272524 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:26.246572 21142 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:26.211146 21156 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:26.269413 21222 consensus_meta.cc:287] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.638s	user 0.013s	sys 0.003s
I20260709 13:19:26.308979 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:26.315526 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 97025.8us
I20260709 13:19:26.332221 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:26.278684 21142 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:26.342698 21142 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.349396 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:26.350215 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 135990us
I20260709 13:19:26.353433 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.338357 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:26.336522 21152 raft_consensus.cc:697] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:26.263841 21218 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:26.336524 21155 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:26.340344 21156 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:26.340621 21065 consensus_meta.cc:287] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.752s	user 0.009s	sys 0.006s
I20260709 13:19:26.368332 17453 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
W20260709 13:19:26.386610 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:26.412614 17454 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.006s
W20260709 13:19:26.393860 21238 log.cc:927] Time spent T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 1.048s	user 0.007s	sys 0.007s
I20260709 13:19:26.314735 21222 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:26.430785 21152 consensus_queue.cc:237] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:26.431479 21065 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:26.432407 21222 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:26.435228 20710 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:26.436522 21158 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:26.398566 21205 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:26.437948 17521 raft_consensus.cc:1240] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:26.426177 21224 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:26.437968 21205 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:26.359337 21184 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:19:26.372905 21243 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:19:26.429220 17454 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.000s	sys 0.007s
I20260709 13:19:26.449738 17597 raft_consensus.cc:2393] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:26.355455 17420 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.358980 21191 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:26.422267 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 64797.7us
I20260709 13:19:26.463824 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.423584 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:26.428584 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:26.429030 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.433770 21065 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:26.466547 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:26.469182 17451 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.471266 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:26.471961 17453 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
W20260709 13:19:26.458477 21216 consensus_meta.cc:287] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.807s	user 0.012s	sys 0.001s
I20260709 13:19:26.445823 21243 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:26.476580 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:26.476994 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:26.477988 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:26.511996 17453 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:26.430907 21218 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:26.517979 17453 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:26.468204 21227 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:26.523067 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:26.524153 17594 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:26.525916 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:26.526901 17452 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:26.510958 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 155621us
I20260709 13:19:26.537511 17420 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.527760 21165 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:19:26.506701 21185 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:26.566941 21261 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:19:26.567075 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:26.568145 18192 raft_consensus.cc:2393] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 11: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:26.568411 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 0c221353c2c64e8b96d73953eebea083: Aborted: Op aborted by new leader
I20260709 13:19:26.585217 21271 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:26.586110 21271 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:26.508174 21216 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:26.588963 21271 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:26.589354 17526 raft_consensus.cc:1240] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:26.519309 21156 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:26.597690 21268 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:19:26.597806 21156 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:26.603473 21279 log.cc:927] Time spent T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:19:26.543901 21246 consensus_meta.cc:287] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.695s	user 0.005s	sys 0.005s
I20260709 13:19:26.606356 21246 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:26.607906 17528 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:26.546547 17420 leader_election.cc:400] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9.
I20260709 13:19:26.553220 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:26.619140 17594 raft_consensus.cc:2410] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:26.509827 20977 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:26.524962 21262 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.168s	user 0.001s	sys 0.001s
I20260709 13:19:26.512015 21157 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:19:26.521548 21266 log.cc:927] Time spent T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:19:26.528470 21277 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:19:26.514133 21243 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:26.529031 21163 consensus_queue.cc:1059] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:19:26.648545 17451 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:26.649369 17452 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
W20260709 13:19:26.620237 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 79892.9us
I20260709 13:19:26.609275 21246 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:26.544934 20710 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:26.611439 21260 log.cc:927] Time spent T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.345s	user 0.002s	sys 0.000s
I20260709 13:19:26.623291 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:26.604588 21156 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.651467 17420 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.668418 17420 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.613986 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1666) took 1999 ms. Trace:
I20260709 13:19:26.609541 21170 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:26.618067 21216 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:26.611641 21052 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.024s	sys 0.061s
I20260709 13:19:26.660979 17452 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:26.654182 17453 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: [8.5-11.7]
I20260709 13:19:26.666597 17594 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:26.671660 17420 leader_election.cc:400] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 9. Current term is 10.
I20260709 13:19:26.675570 17420 leader_election.cc:403] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:26.669152 17449 rpcz_store.cc:276] 0709 13:19:24.614788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.874715 (+259927us) service_pool.cc:224] Handling call
0709 13:19:24.897953 (+ 23238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.755449 (+857496us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:26.100398 (+344949us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.301660 (+201262us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.302724 (+  1064us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:26.303300 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.303426 (+   126us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:26.354196 (+ 50770us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.420443 (+ 66247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.420598 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.613714 (+193116us) raft_consensus.cc:1685] finished
0709 13:19:26.613742 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.613908 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1041971,"prepare.queue_time_us":230452,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":12832,"raft.queue_time_us":924616,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":12778,"spinlock_wait_cycles":57513984,"thread_start_us":389155,"threads_started":2,"wal-append.queue_time_us":323822}
I20260709 13:19:26.678124 17452 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:26.678857 17449 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:26.672693 20998 consensus_meta.cc:287] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.962s	user 0.013s	sys 0.005s
I20260709 13:19:26.647679 21157 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:26.683634 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1665) took 2098 ms. Trace:
I20260709 13:19:26.685557 20859 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 9. Current term is 10.
I20260709 13:19:26.674396 21191 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:26.673194 20977 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:26.692919 20998 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:26.680279 21162 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:26.695844 21142 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:26.699009 21217 consensus_meta.cc:287] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.924s	user 0.016s	sys 0.005s
I20260709 13:19:26.699560 21217 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:26.701215 21157 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:26.702771 17521 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:26.703852 17527 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:26.602496 21227 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:26.682670 17452 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:26.699074 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:26.674279 21052 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.024s	sys 0.065s
I20260709 13:19:26.702898 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1669) took 1911 ms. Trace:
I20260709 13:19:26.706431 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:26.764019 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:26.766569 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:26.748241 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 49047.5us
I20260709 13:19:26.767771 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:26.767372 17447 rpcz_store.cc:276] 0709 13:19:24.791153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.910960 (+119807us) service_pool.cc:224] Handling call
0709 13:19:24.964104 (+ 53144us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.760583 (+796479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.760626 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.761103 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:19:25.998973 (+237870us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:25.999036 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.999144 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.702571 (+703427us) raft_consensus.cc:1685] finished
0709 13:19:26.702630 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.702791 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":759913,"raft.queue_time_us":765121,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":19759,"thread_start_us":210212,"threads_started":1,"wal-append.queue_time_us":413506}
I20260709 13:19:26.689013 17446 rpcz_store.cc:276] 0709 13:19:24.585054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.818294 (+233240us) service_pool.cc:224] Handling call
0709 13:19:24.818683 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.755354 (+936671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.755381 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.755827 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:19:25.930531 (+174704us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:25.952479 (+ 21948us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b48003303d8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abaa8faa1 00007f5abaa86b37 00007f5abaa869ca 00007f5abab7e26f 00007f5abab7df37 00007f5abab9255c 00007f5abab92508 00007f5abab92488 00007f5abab92443 00007f5abab916ec 00007f5ab9abba96
0709 13:19:25.958320 (+  5841us) log.cc:844] Serialized 14 byte log entry
0709 13:19:25.958692 (+   372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.958812 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.683287 (+724475us) raft_consensus.cc:1685] finished
0709 13:19:26.683404 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.683560 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":926791,"prepare.queue_time_us":332161,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":7886,"raft.queue_time_us":946450,"raft.run_cpu_time_us":3314,"raft.run_wall_time_us":199644,"spinlock_wait_cycles":6477184,"thread_start_us":127940,"threads_started":1,"wal-append.queue_time_us":441854}
W20260709 13:19:26.767868 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 96368.9us
I20260709 13:19:26.771116 17420 leader_election.cc:400] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12.
I20260709 13:19:26.714846 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2175) took 2256 ms. Trace:
I20260709 13:19:26.709779 17594 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:26.774281 17449 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:26.775098 17452 raft_consensus.cc:2393] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 11: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:26.778379 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 72013.6us
I20260709 13:19:26.782685 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:26.783530 17447 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.778512 21142 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:26.782657 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.779170 20998 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:26.779973 21259 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:26.778952 21205 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:26.772018 17522 rpcz_store.cc:276] 0709 13:19:24.458231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.470242 (+ 12011us) service_pool.cc:224] Handling call
0709 13:19:25.660819 (+1190577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.718398 (+ 57579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.714524 (+996126us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000ff350. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:26.714753 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2705912192}
W20260709 13:19:26.751705 21211 consensus_meta.cc:287] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.046s	user 0.017s	sys 0.003s
I20260709 13:19:26.785274 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:26.792964 17450 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:19:26.779973 21200 consensus_meta.cc:287] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.808s	user 0.010s	sys 0.002s
I20260709 13:19:26.794890 17450 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:26.804747 17447 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:26.820732 17568 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.821121 17446 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:26.822312 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 51354.1us
I20260709 13:19:26.822763 17569 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:26.823945 17420 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.827298 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:26.821151 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:26.830493 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.832082 17420 leader_election.cc:400] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12.
I20260709 13:19:26.832830 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.786195 20769 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.773665 21052 raft_consensus.cc:697] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:26.859719 20769 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:26.833858 21165 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:19:26.819995 21284 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:26.793380 21205 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.863332 17598 raft_consensus.cc:2410] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:26.864288 21156 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:26.865330 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:26.795086 21211 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:26.866536 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:26.868198 21182 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:26.869730 17420 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.877077 17525 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:26.872807 21163 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:26.902372 21205 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.906450 21163 raft_consensus.cc:697] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:26.907413 21163 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:26.908993 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 454) took 1998 ms. Trace:
I20260709 13:19:26.909369 17601 rpcz_store.cc:276] 0709 13:19:24.916603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.724354 (+807751us) service_pool.cc:224] Handling call
0709 13:19:25.724648 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.791893 (+ 67245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.791938 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:25.791990 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:25.792028 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.908771 (+1116743us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b5400063454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:26.908819 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.908939 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154111872}
I20260709 13:19:26.911022 17601 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:26.911530 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1760) took 1429 ms. Trace:
I20260709 13:19:26.911820 17601 rpcz_store.cc:276] 0709 13:19:25.482655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.910447 (+1427792us) service_pool.cc:224] Handling call
0709 13:19:26.910705 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.911320 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.911479 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:26.912763 17594 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:26.913204 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1761) took 1429 ms. Trace:
I20260709 13:19:26.681521 21243 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:26.839653 21259 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:26.878369 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 452) took 1969 ms. Trace:
I20260709 13:19:26.792507 21047 consensus_queue.cc:1059] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:19:26.874573 20784 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:26.882171 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:26.754601 21201 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:19:26.891314 17521 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:26.834805 21187 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:26.902770 17522 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
W20260709 13:19:26.916483 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 46857.2us
I20260709 13:19:26.913600 17601 rpcz_store.cc:276] 0709 13:19:25.483863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.912484 (+1428621us) service_pool.cc:224] Handling call
0709 13:19:26.912730 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.912897 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.912923 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:26.912965 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:26.913000 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.913061 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.913158 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:26.952805 17603 rpcz_store.cc:276] 0709 13:19:24.909620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.722097 (+812477us) service_pool.cc:224] Handling call
0709 13:19:25.750337 (+ 28240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.819195 (+ 68858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.819225 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:25.819261 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:25.819288 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.878130 (+1058842us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b54003eb054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:26.878184 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.878316 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157921024}
I20260709 13:19:26.956605 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:26.957715 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 137054us
I20260709 13:19:26.959103 17568 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.962136 17601 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:26.962911 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1764) took 1477 ms. Trace:
W20260709 13:19:26.963740 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.964021 17601 rpcz_store.cc:276] 0709 13:19:25.485112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.956311 (+1471199us) service_pool.cc:224] Handling call
0709 13:19:26.956859 (+   548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.962634 (+  5775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.962855 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:26.965070 17601 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:26.965585 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1768) took 1323 ms. Trace:
I20260709 13:19:26.965876 17601 rpcz_store.cc:276] 0709 13:19:25.641930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.964746 (+1322816us) service_pool.cc:224] Handling call
0709 13:19:26.964956 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.965410 (+   454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.965546 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:26.913684 21182 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:26.967195 17600 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:26.971350 17603 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:26.965219 17420 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.972127 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1765) took 1486 ms. Trace:
I20260709 13:19:26.972467 17603 rpcz_store.cc:276] 0709 13:19:25.485462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.956792 (+1471330us) service_pool.cc:224] Handling call
0709 13:19:26.971127 (+ 14335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.971845 (+   718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.972055 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:26.969810 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1767) took 1483 ms. Trace:
I20260709 13:19:26.973587 17600 rpcz_store.cc:276] 0709 13:19:25.486733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.958402 (+1471669us) service_pool.cc:224] Handling call
0709 13:19:26.962248 (+  3846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.969549 (+  7301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.969757 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:26.974560 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:19:26.977294 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 154622us
I20260709 13:19:26.917778 21211 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:26.973125 17420 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.991899 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:26.954815 21259 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:26.993216 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:26.921139 20769 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:26.996373 17603 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:26.962620 21284 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:26.962055 20977 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:26.915594 21184 consensus_queue.cc:1059] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:19:26.974184 20859 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:27.012858 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet da520cc299d940b68e5655cd8094d48e: Illegal state: Replica 0480cf54c3cc424ab94b963ef2ff5bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:27.020365 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.012696 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:26.994545 21185 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:26.969925 21270 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:27.024304 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.002295 21187 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:27.015432 21182 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:26.946560 21052 consensus_queue.cc:237] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:27.025807 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:27.002476 21259 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.021710 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:27.012176 21291 consensus_queue.cc:1059] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:19:27.026518 20710 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:27.028807 21299 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.029592 21184 consensus_queue.cc:1243] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:27.043987 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:27.052417 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1773) took 1099 ms. Trace:
I20260709 13:19:27.052912 18166 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:27.053726 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1753) took 2022 ms. Trace:
W20260709 13:19:27.054152 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.057858 21177 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:27.030750 21211 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.018980 20769 consensus_queue.cc:1059] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:19:27.085631 20710 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:27.086063 21298 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:27.058813 18192 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:27.092756 21300 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:27.093353 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 49453us
I20260709 13:19:27.107175 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.108093 20710 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.108491 17420 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.109326 20710 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:27.034898 21182 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:27.109783 20710 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:27.110184 21182 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:27.110641 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2203) took 1378 ms. Trace:
I20260709 13:19:27.110927 20710 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:27.115952 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:27.103204 21280 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:27.117610 21280 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.117967 21280 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.118149 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:27.109714 21156 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:27.066066 21299 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.105574 21038 raft_consensus.cc:3055] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:27.104049 21211 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.105885 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1768) took 1396 ms. Trace:
I20260709 13:19:27.110991 17526 rpcz_store.cc:276] 0709 13:19:25.731949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.979801 (+247852us) service_pool.cc:224] Handling call
0709 13:19:25.980138 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.589981 (+609843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.110386 (+520405us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400089154. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:27.110563 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400439552}
I20260709 13:19:27.116955 20996 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:27.063009 21185 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:27.121033 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:27.104233 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 457) took 1863 ms. Trace:
I20260709 13:19:27.122159 21142 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.128499 21185 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:27.126533 21038 raft_consensus.cc:740] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:27.131036 17596 rpcz_store.cc:276] 0709 13:19:25.241028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.782406 (+541378us) service_pool.cc:224] Handling call
0709 13:19:25.885491 (+103085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.896547 (+ 11056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.104009 (+1207462us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b54003ea150. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:27.104170 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188413696}
I20260709 13:19:27.125736 17420 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.126065 17524 rpcz_store.cc:276] 0709 13:19:25.709699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.943338 (+233639us) service_pool.cc:224] Handling call
0709 13:19:26.013467 (+ 70129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.013686 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.013723 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:26.013780 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:26.013824 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.013894 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.105719 (+1091825us) spinlock_profiling.cc:243] Waited 69.8 ms on lock 0x7b5400090950. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:27.105829 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160474368}
I20260709 13:19:27.133363 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:27.097369 17599 rpcz_store.cc:276] 0709 13:19:25.031434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.786690 (+755256us) service_pool.cc:224] Handling call
0709 13:19:25.790669 (+  3979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.837081 (+ 46412us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:25.864974 (+ 27893us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.188718 (+323744us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.188932 (+   214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:26.188991 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:26.189071 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.053454 (+864383us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b54003ae8d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:27.053513 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.053657 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74522,"prepare.queue_time_us":39886,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":52628,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":8250,"spinlock_wait_cycles":128238976,"thread_start_us":271816,"threads_started":1,"wal-append.queue_time_us":491284}
I20260709 13:19:27.134460 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:27.096827 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 44043.7us
I20260709 13:19:27.135929 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:27.136327 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1571) took 1874 ms. Trace:
I20260709 13:19:27.136788 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:27.136677 17602 rpcz_store.cc:276] 0709 13:19:25.261736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.763371 (+1501635us) service_pool.cc:224] Handling call
0709 13:19:26.763688 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.763919 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:26.893310 (+129391us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.136001 (+242691us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.136049 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:27.136098 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.136174 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.136276 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3975,"prepare.queue_time_us":235224,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":34325,"spinlock_wait_cycles":3331328,"thread_start_us":367239,"threads_started":3,"wal-append.queue_time_us":223655}
I20260709 13:19:27.139236 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:27.139449 17524 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:27.141232 17596 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:27.149859 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:27.136425 17495 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:27.080554 17529 rpcz_store.cc:276] 0709 13:19:25.952517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.196634 (+244117us) service_pool.cc:224] Handling call
0709 13:19:26.224293 (+ 27659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.224523 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:26.420960 (+196437us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.051674 (+630714us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b1800393ac0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab570e4bc 00007f5ab2a5c48b 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab570623a
0709 13:19:27.051952 (+   278us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.052021 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:27.052084 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.052177 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.052334 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":312890,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":73,"raft.queue_time_us":4294,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":40432896,"thread_start_us":377153,"threads_started":2,"wal-append.queue_time_us":353159}
I20260709 13:19:27.131270 21211 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:27.139972 17600 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:27.143071 20784 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:27.147753 21187 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.138501 21185 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.120358 21300 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.155002 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:27.152810 21159 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:27.160876 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1575) took 1238 ms. Trace:
I20260709 13:19:27.156239 17600 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.145653 17420 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.157181 17599 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:27.158500 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:27.143805 20769 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.132642 21038 consensus_queue.cc:260] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:27.164417 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:27.161376 17601 rpcz_store.cc:276] 0709 13:19:25.922493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.966478 (+1043985us) service_pool.cc:224] Handling call
0709 13:19:26.966683 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.966824 (+   141us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:27.104403 (+137579us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.160582 (+ 56179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.160629 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:27.160671 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.160729 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.160830 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1309,"prepare.queue_time_us":63672,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":181545,"threads_started":2}
I20260709 13:19:27.138916 21177 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:19:27.134969 20996 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.151866 21284 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.138810 21156 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:19:27.163538 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.154258 21205 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.190428 21038 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.190681 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:27.191879 17420 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.192011 21205 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:27.192247 17602 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:27.154083 21172 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:19:27.192991 17420 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.156095 21271 consensus_queue.cc:1059] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:19:27.155861 21157 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:27.165284 21152 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:19:27.195700 21177 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:27.196395 21177 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.197027 21177 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:27.197485 21177 raft_consensus.cc:697] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:27.168176 21246 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:27.198351 21246 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:27.198900 21246 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.186918 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:27.200423 17596 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:27.201637 17596 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:27.204110 20996 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:27.204279 21177 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.164352 21307 consensus_queue.cc:1059] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:19:27.205562 21284 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.165896 20710 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.170774 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:27.208639 21284 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:27.149742 20859 consensus_queue.cc:1059] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:19:27.156224 21247 consensus_queue.cc:1059] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:27.210743 20859 raft_consensus.cc:3055] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:27.211139 20859 raft_consensus.cc:740] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:27.198422 21278 raft_consensus.cc:3055] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:27.211748 21278 raft_consensus.cc:740] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:27.212131 20859 consensus_queue.cc:260] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.212608 21278 consensus_queue.cc:260] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:27.213531 20859 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.213814 21278 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.215094 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:27.211165 21247 raft_consensus.cc:3055] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:27.216107 21247 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:27.216928 21247 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.218160 21247 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.169668 20769 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.221005 20769 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:27.223582 21300 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:27.224643 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1758) took 1768 ms. Trace:
I20260709 13:19:27.225059 17594 rpcz_store.cc:276] 0709 13:19:25.456714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.787230 (+1330516us) service_pool.cc:224] Handling call
0709 13:19:26.787567 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.913255 (+125688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.224389 (+311134us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400328554. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:27.224578 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287226240}
I20260709 13:19:27.226920 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1578) took 1303 ms. Trace:
I20260709 13:19:27.227308 17597 rpcz_store.cc:276] 0709 13:19:25.923493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.978177 (+ 54684us) service_pool.cc:224] Handling call
0709 13:19:27.226729 (+1248552us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400328f54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:27.226863 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081918208}
W20260709 13:19:27.233860 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.239188 21299 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:27.155990 20998 consensus_queue.cc:1059] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:19:27.240589 20998 raft_consensus.cc:3055] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:27.241008 20998 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:27.144002 21142 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.241961 20998 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:27.243501 20998 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.244077 21142 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:27.245532 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:27.155109 21217 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:27.247699 17602 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:27.249343 17600 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:27.251055 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:27.251911 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 57955.3us
I20260709 13:19:27.252645 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.163075 20903 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:19:27.259285 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.253984 17600 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:27.171324 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:27.264137 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 92883.6us
I20260709 13:19:27.265885 17594 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:27.266793 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:27.267100 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:27.267434 17450 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.270097 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:27.254802 21197 raft_consensus.cc:2764] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:27.276182 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.276973 17446 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:27.284579 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.257838 20710 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:27.286351 17452 raft_consensus.cc:2410] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:19:27.287204 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:27.259011 20977 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.289053 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.295192 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.296066 17420 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.300067 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.296052 17452 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:27.277978 20996 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:27.303640 17450 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:27.301030 17446 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:27.297497 21157 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:27.308022 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.309850 17446 raft_consensus.cc:2410] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:27.309652 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.298558 21263 raft_consensus.cc:2764] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:27.276245 21153 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:27.287030 21247 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:19:27.262614 21217 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.282598 21259 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.285843 21216 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:19:27.307920 21177 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.306607 20996 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:27.298681 21152 consensus_queue.cc:1059] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:19:27.328526 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2195) took 1952 ms. Trace:
I20260709 13:19:27.314330 21157 raft_consensus.cc:697] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:27.301695 21271 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:19:27.333616 20996 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.337244 21065 raft_consensus.cc:3055] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:27.354238 21065 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:27.355118 21065 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.356149 21065 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.346098 21182 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:27.359611 21217 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:27.360895 21182 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:27.361680 17453 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:27.362566 21157 consensus_queue.cc:237] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.341481 21280 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:27.363526 21185 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:27.364638 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.365002 21280 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:27.298264 20710 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.345719 17523 rpcz_store.cc:276] 0709 13:19:25.376063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.708008 (+331945us) service_pool.cc:224] Handling call
0709 13:19:25.708439 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.985838 (+277399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.328183 (+1342345us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54002c8654. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:27.328440 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636621184}
I20260709 13:19:27.313851 21159 raft_consensus.cc:697] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:27.351358 21310 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:19:27.339715 21205 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:27.368124 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:27.369196 21246 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:27.375718 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 79737.6us
I20260709 13:19:27.379225 17452 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:27.381039 17524 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.383123 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:27.387112 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.365608 18192 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:27.387820 17569 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:27.371558 20784 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:27.391759 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2006) took 1631 ms. Trace:
I20260709 13:19:27.423094 17452 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:27.422993 17454 rpcz_store.cc:276] 0709 13:19:25.760334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.760453 (+   119us) service_pool.cc:224] Handling call
0709 13:19:25.760697 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.760880 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:26.450275 (+689395us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.391090 (+940815us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b18003d32a0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab29f3c0a 00007f5abc133219 00007f5ab2a7ba40 00007f5ab2a764e4 00007f5ab2a76455 00007f5ab955e3c7 00007f5ab5b709a7 00007f5ab5b800bf 00007f5ab5b80038
0709 13:19:27.391280 (+   190us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.391443 (+   163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.391483 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:27.391523 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.391599 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.391705 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81127,"prepare.queue_time_us":1169957,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":7911,"raft.queue_time_us":1759,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":5643,"spinlock_wait_cycles":3789184,"thread_start_us":812783,"threads_started":2,"wal-append.queue_time_us":302594}
I20260709 13:19:27.393231 21191 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:27.396272 17598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1757) took 2320 ms (client timeout 2789 ms). Trace:
I20260709 13:19:27.400530 17595 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:19:27.442435 17595 pending_rounds.cc:85] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 5
I20260709 13:19:27.442996 17595 pending_rounds.cc:107] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 10.6
W20260709 13:19:27.442273 17598 rpcz_store.cc:269] 0709 13:19:25.075703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.416581 (+340878us) service_pool.cc:224] Handling call
0709 13:19:27.396026 (+1979445us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400328054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:27.396200 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3309205888}
I20260709 13:19:27.443269 17595 raft_consensus.cc:2889] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:27.365568 21185 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:27.402755 21159 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.404198 21309 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.405591 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2023) took 1394 ms. Trace:
I20260709 13:19:27.410573 21247 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:27.411188 21259 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:27.380823 21205 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:27.415937 21246 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:27.419034 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:27.409931 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:27.444540 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:27.388903 17420 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.505136 17598 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.417459 21182 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.417183 21197 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.494372 17451 rpcz_store.cc:276] 0709 13:19:26.011232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.649633 (+638401us) service_pool.cc:224] Handling call
0709 13:19:26.650120 (+   487us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:26.664060 (+ 13940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.664101 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:26.671255 (+  7154us) log.cc:844] Serialized 52 byte log entry
0709 13:19:26.978754 (+307499us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:27.404727 (+425973us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.405062 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.405265 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.405342 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.405386 (+    44us) raft_consensus.cc:1685] finished
0709 13:19:27.405402 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.405532 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":431050,"prepare.queue_time_us":428260,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":3590,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":4216,"spinlock_wait_cycles":163840,"thread_start_us":231447,"threads_started":1,"wal-append.queue_time_us":409750}
I20260709 13:19:27.496701 21200 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:27.426918 20784 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:27.510926 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 91983.2us
W20260709 13:19:27.506497 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 117665us
I20260709 13:19:27.516660 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:27.427767 21142 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:27.516268 17569 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:27.519695 17524 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:27.521548 18166 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:27.526441 20903 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:27.502795 21309 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:27.514634 21200 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.509395 21185 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:27.540463 21185 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:27.541604 18201 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEARNER]: Advancing to term 8
I20260709 13:19:27.542577 20903 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:27.543505 20903 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:27.543941 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:27.541471 21185 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.548908 17451 raft_consensus.cc:1240] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:27.550143 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:27.550586 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:27.552819 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:27.533680 17598 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
W20260709 13:19:27.534442 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.539816 17447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:19:27.554371 17447 raft_consensus.cc:606] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.554829 17447 raft_consensus.cc:614] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:27.556972 18201 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:27.561268 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:27.562450 17447 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:19:27.562726 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.562846 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:27.564380 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:27.565798 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:27.567124 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 349) took 1589 ms. Trace:
I20260709 13:19:27.567556 17448 rpcz_store.cc:276] 0709 13:19:25.977838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.981191 (+  3353us) service_pool.cc:224] Handling call
0709 13:19:25.981495 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.206316 (+224821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.206367 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:26.206443 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:26.206496 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.566895 (+1360399us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54000db6d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:27.566943 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.567068 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516397824}
I20260709 13:19:27.571024 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:27.573484 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:27.575953 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:27.577877 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:27.579380 17420 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.582691 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:27.547914 21200 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:27.586397 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:27.558636 21246 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.589708 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:27.558825 20998 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:27.549686 21321 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:27.521957 21142 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.595644 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:27.595898 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.581857 20797 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.581933 21247 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.599449 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:27.576573 21217 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:27.607016 17596 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:27.598091 21182 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:27.617539 17598 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:27.582818 21156 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:27.597278 21152 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:27.600785 20859 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:27.652807 21316 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.653364 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:27.653591 21276 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:19:27.655831 21308 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:27.613180 18193 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:27.561344 21205 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.586458 21216 consensus_queue.cc:1059] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:19:27.588871 21278 consensus_queue.cc:1059] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:19:27.662860 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:27.616847 21217 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.601984 21321 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:27.704445 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 108864us
I20260709 13:19:27.658635 21259 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:27.710234 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.711311 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.710011 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:27.717437 17450 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.624322 20797 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:27.712956 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:27.715193 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:27.728817 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.663719 21300 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.711889 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:27.658751 21156 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:27.681502 21152 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:27.746475 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:27.742357 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:27.747232 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.679600 20710 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:27.746140 17451 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:19:27.702353 20859 raft_consensus.cc:697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:27.708653 21217 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.749480 17450 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:27.751150 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.767099 17451 pending_rounds.cc:85] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 5
I20260709 13:19:27.725818 17420 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.767501 17451 pending_rounds.cc:107] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:19:27.767887 17451 raft_consensus.cc:2889] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:27.768563 17420 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.715914 21281 raft_consensus.cc:3055] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:27.770219 21281 raft_consensus.cc:740] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:27.772310 21216 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:27.772686 21311 consensus_queue.cc:1059] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.151s
I20260709 13:19:27.772948 21216 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:27.773501 21324 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:19:27.773883 21311 raft_consensus.cc:3055] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:27.774310 21311 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:27.775210 21216 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:27.756911 17446 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:27.711033 21321 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.775560 21311 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:27.776930 21311 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:27.780809 20859 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:27.699987 21319 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:19:27.743247 20769 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.782459 20769 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.784883 20769 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:27.787055 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:27.788359 20996 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.788988 17601 raft_consensus.cc:1240] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:27.790567 21327 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:19:27.756253 17452 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:19:27.772410 21259 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.791430 17452 pending_rounds.cc:85] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 6
I20260709 13:19:27.791702 17452 pending_rounds.cc:107] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:19:27.791925 17452 raft_consensus.cc:2889] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:27.792049 20797 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:27.792580 21325 log.cc:927] Time spent T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:19:27.792623 20710 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:27.770828 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:27.765256 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 166971us
I20260709 13:19:27.802556 17601 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:19:27.803164 17601 pending_rounds.cc:85] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 6
I20260709 13:19:27.803462 17601 pending_rounds.cc:107] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.7
I20260709 13:19:27.804860 17420 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.811856 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:27.810537 17601 raft_consensus.cc:2917] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Aborting config change with OpId 7.7: Aborted: Op aborted by new leader
I20260709 13:19:27.813498 18198 raft_consensus.cc:2410] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:27.814559 17601 raft_consensus.cc:2889] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:27.817368 17420 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.819563 17597 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:27.823360 21153 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:27.824754 21153 consensus_queue.cc:1059] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:27.831578 17449 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:27.753764 21300 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:27.855324 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.814879 21259 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:27.810055 21334 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:27.826514 21159 raft_consensus.cc:3055] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:27.833009 21170 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.809825 21216 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:19:27.810180 21316 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:19:27.816474 21182 consensus_queue.cc:1059] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:19:27.772859 21281 consensus_queue.cc:260] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.826356 20977 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:19:27.892660 21156 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:27.832576 21309 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:27.895828 21216 consensus_queue.cc:1243] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:19:27.873939 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 0c6864e5b711423291c531e98224c311: Illegal state: Replica abf46e430b7e4ad4919ca2a717f37e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } }
I20260709 13:19:27.834625 21152 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.904474 21321 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.826486 21336 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:19:27.891184 21045 raft_consensus.cc:3055] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:27.891320 21182 raft_consensus.cc:3055] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:27.868651 21159 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:27.891669 21300 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:27.837934 21308 raft_consensus.cc:697] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:27.928654 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2197) took 2243 ms. Trace:
I20260709 13:19:27.929214 17527 rpcz_store.cc:276] 0709 13:19:25.685692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.829589 (+143897us) service_pool.cc:224] Handling call
0709 13:19:25.853878 (+ 24289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.704298 (+850420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.928311 (+1224013us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54003412d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:27.928575 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1954238848}
W20260709 13:19:27.906860 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet a851f7fe7702439a9a695c117b09f6ae: Illegal state: Replica ddfe9cca0741489b994f8b0178c54fe7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:27.906800 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.937613 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:27.866466 21157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.012s	sys 0.009s
W20260709 13:19:27.912789 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 92341.5us
I20260709 13:19:27.906278 21205 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:27.925352 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:27.938513 17523 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:27.949435 17420 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:27.923429 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 109076us
I20260709 13:19:27.956773 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:27.872829 20996 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:27.920747 21182 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:27.873349 21315 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:27.966730 17521 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:19:27.970520 17521 pending_rounds.cc:85] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 6
I20260709 13:19:27.970849 17521 pending_rounds.cc:107] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:19:27.970338 21315 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.970719 21182 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:27.950152 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.921084 21045 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:27.972762 21045 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:27.973338 21315 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:27.923787 21281 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:27.948621 21157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.013s	sys 0.009s
I20260709 13:19:27.969084 17527 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:27.968024 17420 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:27.971145 17521 raft_consensus.cc:2889] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:27.954833 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:27.986418 17449 raft_consensus.cc:1240] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:27.975178 17522 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:27.955962 17451 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:27.992813 17419 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:28.020744 18167 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:28.039568 21321 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:28.050678 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 57917.4us
I20260709 13:19:28.053475 21348 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.055095 21170 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:28.078713 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.066578 17527 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:19:28.100654 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.083310 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.063004 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1568) took 2802 ms. Trace:
I20260709 13:19:28.109380 17595 rpcz_store.cc:276] 0709 13:19:25.260926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.063081 (+802155us) service_pool.cc:224] Handling call
0709 13:19:27.400050 (+1336969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.443962 (+ 43912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.062783 (+618821us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400328050. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:28.062936 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2923949312}
W20260709 13:19:28.057827 21329 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.286s	user 0.002s	sys 0.000s
I20260709 13:19:28.103137 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.046355 21315 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:28.008769 21159 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.116695 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:28.022470 21308 consensus_queue.cc:237] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:28.073679 21344 log.cc:927] Time spent T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:19:28.198222 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.162369 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.289609 17453 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:28.289390 17450 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:28.179270 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 158647us
I20260709 13:19:28.254739 20859 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:28.136420 17419 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:28.064188 20784 consensus_meta.cc:287] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.001s
W20260709 13:19:28.288672 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 320765us
I20260709 13:19:28.201351 21170 consensus_queue.cc:1059] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
W20260709 13:19:28.316898 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 180589us
I20260709 13:19:28.318014 21170 raft_consensus.cc:3055] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:28.318575 21170 raft_consensus.cc:740] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:28.316843 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:28.074731 21340 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.105s	user 0.005s	sys 0.000s
I20260709 13:19:28.264998 17352 catalog_manager.cc:5697] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.184219 21163 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.061132 21350 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:28.268752 21284 raft_consensus.cc:3055] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:28.253201 21354 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:28.346176 17449 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:28.349409 17527 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:28.276278 21263 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:28.058454 21357 consensus_queue.cc:1059] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.290s
I20260709 13:19:28.319360 21170 consensus_queue.cc:260] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.303066 21315 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.253157 21217 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.349831 17527 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:28.417064 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.464495 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.456869 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 213133us
W20260709 13:19:28.448498 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.465548 18167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.413746 17450 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:28.466674 17595 raft_consensus.cc:3055] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:28.320067 21348 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:28.467221 17595 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:28.468124 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 151355us
I20260709 13:19:28.323123 21299 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:28.470920 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:28.474810 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:28.427073 21351 log.cc:927] Time spent T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
W20260709 13:19:28.418627 21352 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
W20260709 13:19:28.421836 21311 consensus_meta.cc:287] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.000s
I20260709 13:19:28.476889 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:28.481606 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:28.481451 17602 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:28.323835 20859 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.471045 17595 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:28.486883 21361 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:19:28.487677 17595 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.330639 21350 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.488708 21350 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.473804 17569 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:28.323303 20784 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.349849 21354 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:28.478053 20769 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:28.472332 21259 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:28.486348 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2018) took 2490 ms. Trace:
I20260709 13:19:28.347800 21284 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:28.478511 17527 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.515066 17527 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.482326 17601 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:28.476179 21206 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.503047 17449 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: [8.5-11.7]
I20260709 13:19:28.380594 21272 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.350s
I20260709 13:19:28.509888 21349 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:28.469656 21300 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:19:28.498381 17445 rpcz_store.cc:276] 0709 13:19:25.996563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.996971 (+   408us) service_pool.cc:224] Handling call
0709 13:19:25.997293 (+   322us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:26.128060 (+130767us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:26.196238 (+ 68178us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.812628 (+1616390us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b1800139840. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab570e4bc 00007f5ab2a5c48b 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab570623a
0709 13:19:27.812829 (+   201us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:27.827106 (+ 14277us) log.cc:844] Serialized 78 byte log entry
0709 13:19:27.977080 (+149974us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:27.978046 (+   966us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.099897 (+121851us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.260370 (+160473us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.263930 (+  3560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.264060 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.486099 (+222039us) raft_consensus.cc:1685] finished
0709 13:19:28.486123 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.486281 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20150,"prepare.queue_time_us":290483,"prepare.run_cpu_time_us":3704,"prepare.run_wall_time_us":33403,"raft.queue_time_us":247000,"raft.run_cpu_time_us":731,"raft.run_wall_time_us":74707,"spinlock_wait_cycles":110085888,"thread_start_us":448924,"threads_started":4,"wal-append.queue_time_us":263060,"wal-append.run_cpu_time_us":1216,"wal-append.run_wall_time_us":1002606}
I20260709 13:19:28.510766 20769 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.397715 21359 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 13:19:28.512140 21361 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:28.334261 21163 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:28.492789 21200 consensus_meta.cc:287] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.892s	user 0.009s	sys 0.003s
I20260709 13:19:28.524710 17595 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:19:28.482851 21170 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.497905 21156 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:28.550225 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 79387us
I20260709 13:19:28.498332 21348 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:28.555969 17595 pending_rounds.cc:85] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 9
I20260709 13:19:28.558627 17527 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:28.563129 21217 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:28.472002 21263 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.590420 17595 pending_rounds.cc:107] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:19:28.593354 17595 raft_consensus.cc:2889] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:28.499835 21354 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:28.604573 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.609781 17595 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:28.527151 21206 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:28.601296 21348 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.599985 21156 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:28.622658 21156 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.627027 21206 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:28.628458 21348 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:28.629349 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.628516 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:28.630898 21348 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:28.632403 20769 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:28.633419 21315 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:28.635462 21247 raft_consensus.cc:3055] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:28.635658 21163 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:28.635915 21247 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:28.636793 21247 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.637791 21247 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:28.614789 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.615495 20784 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:28.609347 21357 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.639441 21357 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:28.640326 17527 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:28.641577 21357 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:28.642124 21357 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.642547 21357 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:28.644532 21357 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:28.607573 21284 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.552820 21216 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.637825 20859 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:28.646155 21284 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.646715 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:28.646505 21216 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:28.647032 21211 consensus_queue.cc:1175] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" responder_term: 12 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: [8.5-11.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:28.618397 17595 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:28.649557 21216 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:28.649791 21271 raft_consensus.cc:3055] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:28.650235 21271 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:28.651813 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:28.652451 17599 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:28.652490 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.653721 21271 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.654773 21271 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.664302 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.591948 21200 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.665542 17445 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:28.667713 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.646095 21142 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:28.668452 21281 consensus_meta.cc:287] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.000s
W20260709 13:19:28.685674 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.686779 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:28.687012 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:28.687899 17596 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:19:28.689306 17454 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:28.690574 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.691290 17454 raft_consensus.cc:2376] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9. Re-sending same reply.
I20260709 13:19:28.686861 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.692281 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.693120 17454 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:28.693338 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.694208 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.694810 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:28.695441 17454 raft_consensus.cc:2393] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:28.695593 17453 raft_consensus.cc:2376] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12. Re-sending same reply.
I20260709 13:19:28.697535 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.698416 17453 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:28.699469 17453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
W20260709 13:19:28.707070 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.710629 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.712003 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:28.714334 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:28.566174 21361 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.718842 17569 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:28.719079 17523 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:28.532859 21349 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.721570 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:28.721470 17445 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:28.722358 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:28.724550 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:28.719866 21216 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.725742 17445 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:28.728314 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:28.723199 21259 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:19:28.731760 21381 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:28.733599 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:28.734221 17523 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.727283 20769 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:19:28.719646 21163 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.749153 20769 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.750741 21361 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:28.751199 21156 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:28.716055 21373 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:28.749670 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:28.735957 21348 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:19:28.753033 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:28.753700 17527 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:28.756304 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:28.751631 21156 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:28.761919 17595 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.762004 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:28.759517 21206 consensus_queue.cc:1059] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:19:28.749660 20769 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:28.762645 21372 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:19:28.763803 20784 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:28.763885 21200 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:28.755457 21308 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:28.819948 21308 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:28.820588 21291 raft_consensus.cc:3055] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:28.820960 21291 raft_consensus.cc:740] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:28.767448 21349 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:28.771979 21350 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:28.821796 21291 consensus_queue.cc:260] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:28.823930 21350 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:28.751637 21369 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:19:28.754329 21359 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:19:28.755656 21373 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:28.825897 21220 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:19:28.762070 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:28.826684 21206 raft_consensus.cc:3055] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:28.827203 21206 raft_consensus.cc:740] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:28.782128 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:28.828188 21206 consensus_queue.cc:260] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.830684 21373 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:28.836447 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.802977 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:28.840564 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.804402 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:28.841522 17527 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
W20260709 13:19:28.799901 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 47146.2us
I20260709 13:19:28.842518 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:28.842834 21281 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:28.843694 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:28.843904 21281 raft_consensus.cc:3055] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:28.844314 21281 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:28.805241 17529 raft_consensus.cc:2410] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:28.845090 21281 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.845553 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:28.808605 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 84512.8us
I20260709 13:19:28.810312 21376 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:28.810969 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:28.811333 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:28.814288 20784 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:28.816805 21348 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.817390 21185 consensus_queue.cc:1059] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:28.836963 21200 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.837524 21315 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.800670 21300 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:28.802482 21156 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.755437 21163 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:28.852761 17446 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:28.860741 17525 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:28.727119 21216 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:28.747644 21259 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:19:28.850275 21187 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:28.869299 21376 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:28.893829 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.807853 17523 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:28.898309 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.906862 17453 raft_consensus.cc:606] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:28.909794 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.909904 17453 raft_consensus.cc:614] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:28.870851 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:28.902675 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:28.898223 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 46897.5us
I20260709 13:19:28.909569 17445 raft_consensus.cc:2393] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 7: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:28.898907 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.912909 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:28.913295 18167 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:28.914286 18166 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:28.914463 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:28.917655 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:28.922546 17603 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:28.923306 17529 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:28.911801 21291 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.898269 21281 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:28.915172 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.927075 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:28.927599 17445 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.902149 21243 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.932739 21163 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:28.935022 17520 raft_consensus.cc:1240] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:28.888667 21350 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:19:28.938511 17527 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:28.923591 21308 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:28.922065 21206 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:28.897486 21348 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.904124 21200 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.907632 21300 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:28.947755 17445 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
I20260709 13:19:28.902920 21315 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:28.956197 17526 raft_consensus.cc:2410] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:28.958870 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:28.956231 17520 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.959934 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:28.958415 20769 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:28.959326 21240 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:28.916497 21187 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.025194 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.026481 17527 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:19:29.045090 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.983186 21378 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:29.057654 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.040843 21216 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:29.035822 21382 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:29.055536 21378 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.054508 21185 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:29.119830 21187 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:29.122658 21383 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:19:29.121440 21373 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.294924 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.300067 17520 raft_consensus.cc:2410] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:29.305750 21185 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.275863 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.329437 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:29.251724 21284 consensus_meta.cc:287] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.006s
W20260709 13:19:29.270604 21354 consensus_meta.cc:287] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.002s
I20260709 13:19:29.338907 17594 raft_consensus.cc:2393] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:29.294225 21369 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.127254 21348 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:29.271222 21320 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.275295 20784 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:29.305203 21187 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.171056 21349 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:29.135082 21378 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.377319 21349 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.382607 21349 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:29.310338 21376 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:29.385108 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.365500 18193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42536 (request call id 254) took 1958 ms. Trace:
I20260709 13:19:29.387914 21301 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:29.389452 21301 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:29.391426 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.392230 17523 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: [10.5-10.5]
W20260709 13:19:29.393110 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.394673 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:29.384639 21348 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.397557 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:29.388377 21383 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:19:29.404124 21185 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:29.388058 18193 rpcz_store.cc:276] 0709 13:19:27.407123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.407284 (+   161us) service_pool.cc:224] Handling call
0709 13:19:27.407656 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.677962 (+270306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.331686 (+1653724us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400563454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:29.365399 (+ 33713us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379105664}
I20260709 13:19:29.405339 21319 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:29.405516 21373 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:29.416611 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:29.419950 21376 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:29.426728 21263 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:29.435254 21363 log.cc:927] Time spent T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.965s	user 0.002s	sys 0.002s
I20260709 13:19:29.386071 21187 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.467520 21348 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.452313 21200 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:29.371762 21369 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.363451 21354 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.393621 21315 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:29.518646 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:29.384435 21320 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:29.483181 21291 consensus_meta.cc:287] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.558s	user 0.004s	sys 0.007s
I20260709 13:19:29.469125 21278 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.492168 21187 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:29.511148 21263 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:29.531183 21263 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:29.533427 21263 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:29.535868 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1804) took 1061 ms. Trace:
I20260709 13:19:29.536298 17596 rpcz_store.cc:276] 0709 13:19:28.473965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.474086 (+   121us) service_pool.cc:224] Handling call
0709 13:19:28.474399 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.706806 (+232407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.535578 (+828772us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400062a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:29.535803 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490201344}
I20260709 13:19:29.538487 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:29.539131 17527 raft_consensus.cc:2376] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10. Re-sending same reply.
I20260709 13:19:29.541175 21369 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:29.522630 21349 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.542410 21349 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.544497 21349 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:29.492339 21376 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:29.548082 21376 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:29.550925 21348 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:29.551494 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.552000 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.488034 20977 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.488272 20710 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:29.557567 21315 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:29.571734 20710 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:29.571882 21315 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:29.557983 20998 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:29.574891 20998 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.555721 21278 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:29.577545 20998 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:29.580224 21315 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:29.581463 20977 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.584311 21191 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:29.585165 21191 consensus_queue.cc:1243] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:29.590054 21301 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:29.590941 21301 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.591593 21301 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.563077 21354 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:29.563702 17450 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:29.569303 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1797) took 2302 ms. Trace:
I20260709 13:19:29.558043 21172 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:29.595203 21172 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:29.594937 17600 rpcz_store.cc:276] 0709 13:19:27.266385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.268497 (+  2112us) service_pool.cc:224] Handling call
0709 13:19:27.268700 (+   203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.299258 (+ 30558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.299302 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.075707 (+776405us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b2c00007508. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446f372 00007f5ab5ba1a01 00007f5ab5b6643a 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2
0709 13:19:28.076219 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.315360 (+239141us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:28.315404 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.315478 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.434657 (+1119179us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:29.534787 (+100130us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b18003f9700. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:19:29.568961 (+ 34174us) raft_consensus.cc:1685] finished
0709 13:19:29.568996 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.569195 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30148,"raft.queue_time_us":34041,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":26138368,"thread_start_us":238730,"threads_started":1,"wal-append.queue_time_us":350871}
W20260709 13:19:29.600453 17569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.024s	sys 0.031s
W20260709 13:19:29.600775 17569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.024s	sys 0.031s
W20260709 13:19:29.601049 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.603048 17449 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:29.606261 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.486699 21319 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.606179 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:29.613818 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:29.614372 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:29.612129 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.616120 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.612920 17453 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
W20260709 13:19:29.617803 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.619127 17453 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:29.622756 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.615068 17449 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:29.577821 21278 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:29.599308 21206 consensus_meta.cc:287] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.004s
I20260709 13:19:29.633189 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:29.634182 17449 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:29.615453 21281 consensus_meta.cc:287] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.005s
W20260709 13:19:29.648672 18167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.067s	sys 0.111s
I20260709 13:19:29.606976 20998 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:29.649317 18167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.067s	sys 0.111s
I20260709 13:19:29.631959 20710 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:29.655030 18167 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.655869 21159 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:29.657033 20903 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.657614 20903 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:29.658036 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.659227 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:29.659242 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.659946 20903 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:29.721494 21378 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:29.722751 17522 raft_consensus.cc:2393] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:29.723719 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.728943 17522 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 5.
I20260709 13:19:29.686492 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:29.690373 17419 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.703204 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1707) took 1016 ms. Trace:
I20260709 13:19:29.731024 17446 rpcz_store.cc:276] 0709 13:19:28.686665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.686771 (+   106us) service_pool.cc:224] Handling call
0709 13:19:29.703035 (+1016264us) spinlock_profiling.cc:243] Waited 64.4 ms on lock 0x7b54003c7154. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:29.703145 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148170496}
I20260709 13:19:29.732674 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.661149 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.660362 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2065) took 1192 ms. Trace:
I20260709 13:19:29.734383 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:29.702014 21172 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:29.659312 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.727767 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:29.660014 17595 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:29.734645 17450 rpcz_store.cc:276] 0709 13:19:28.467752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.469663 (+  1911us) service_pool.cc:224] Handling call
0709 13:19:28.469929 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.594545 (+1124616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.660123 (+ 65578us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400369a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:29.660305 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2514868608}
I20260709 13:19:29.739253 17419 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.740927 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:29.741849 17446 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:29.742542 17450 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:29.744678 17448 raft_consensus.cc:2393] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:29.745440 17569 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:29.652143 21369 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:29.744948 21243 consensus_meta.cc:287] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.810s	user 0.010s	sys 0.002s
I20260709 13:19:29.753460 21263 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:29.753777 21407 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:19:29.754284 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:29.772256 17451 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
I20260709 13:19:29.773002 21405 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:29.773679 21405 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.774184 21405 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:29.754722 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.782752 17524 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:29.783345 21319 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:29.784382 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.779138 21301 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:29.781309 21320 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:29.756148 17568 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.788076 21315 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:29.744796 21349 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:29.792552 17568 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:29.793797 21319 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:29.794345 21319 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:29.794811 21319 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.799295 17568 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.799499 21299 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:29.759833 20784 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:19:29.759647 21369 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:29.658221 21161 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:29.748812 17419 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:29.789727 21156 consensus_meta.cc:287] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.874s	user 0.009s	sys 0.001s
I20260709 13:19:29.765244 21378 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:29.827790 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.827592 21156 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.828773 17525 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:29.816931 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:29.831029 20769 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:29.831480 20769 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.831842 20769 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.832079 17569 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:29.822302 21281 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:29.836501 21373 consensus_queue.cc:1059] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:29.837291 20784 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:29.838213 21398 raft_consensus.cc:3055] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:29.770339 21271 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.838644 21398 raft_consensus.cc:740] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:29.838907 21271 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.839758 21398 consensus_queue.cc:260] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.822727 21301 consensus_queue.cc:1059] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:19:29.824218 21299 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.843190 21301 raft_consensus.cc:3055] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:29.843552 21301 raft_consensus.cc:740] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:29.843998 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1597) took 1082 ms. Trace:
I20260709 13:19:29.844358 21301 consensus_queue.cc:260] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.844477 17594 rpcz_store.cc:276] 0709 13:19:28.761655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.761776 (+   121us) service_pool.cc:224] Handling call
0709 13:19:29.843787 (+1082011us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400075dd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:29.843934 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236930304}
I20260709 13:19:29.845539 21301 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.820451 17568 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.847851 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:29.848765 17446 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:29.850371 17523 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
W20260709 13:19:29.855008 17569 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.68:36313 timed out after 1.604s (SENT) [suppressed 36 similar messages]
I20260709 13:19:29.829865 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:29.856854 17525 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.858494 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:29.859257 17446 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:29.867244 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46878.4us
I20260709 13:19:29.868772 17568 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:29.887573 21369 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:29.888036 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.888757 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 2216) took 1177 ms. Trace:
I20260709 13:19:29.888934 21159 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:29.889185 17526 rpcz_store.cc:276] 0709 13:19:28.711169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.711299 (+   130us) service_pool.cc:224] Handling call
0709 13:19:29.888561 (+1177262us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54003c0ad4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:29.888702 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537259776}
I20260709 13:19:29.889652 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.817184 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:29.683421 20998 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:29.824906 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.893855 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 145132us
I20260709 13:19:29.894304 17568 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.896876 17595 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:29.897704 17594 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:29.899557 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:29.889510 21159 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:29.651398 21406 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:29.840997 21398 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.821357 17449 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:29.917626 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.918453 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:29.918900 17526 raft_consensus.cc:2410] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:29.919910 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:29.920679 17449 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:29.837772 20784 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.894788 17419 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.903465 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:29.903560 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.892398 21165 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:29.927980 18194 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:29.837766 21373 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:19:29.906997 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:29.929119 17568 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.825106 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.930898 17419 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:29.931068 17568 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.933490 17600 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:29.933578 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:29.934289 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:29.934540 21376 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:29.934890 17596 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:29.912180 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:29.913529 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:29.936525 17594 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:29.908650 17446 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:29.921856 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:29.925576 17595 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:29.934928 21376 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:29.938160 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 83190.7us
I20260709 13:19:29.916391 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.938562 21197 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:29.939353 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:29.940349 17446 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
W20260709 13:19:29.940529 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 57508.4us
I20260709 13:19:29.922376 17529 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:29.941738 17446 raft_consensus.cc:1217] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Deduplicated request from leader. Original: 5.3->[7.4-11.5]   Dedup: 7.4->[11.5-11.5]
I20260709 13:19:29.942382 17446 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: [7.4-11.5]
I20260709 13:19:29.942736 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:29.901831 21281 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:29.943411 18196 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:29.943804 17446 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:29.947654 17446 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:29.949154 17446 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:29.949560 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.949910 21172 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.950277 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.950580 21172 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:29.951603 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.952039 17495 connection.cc:256] RPC call timeout handler was delayed by -1.4573282460000883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
I20260709 13:19:29.944977 17568 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.898382 21161 raft_consensus.cc:697] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:29.939594 21197 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.940089 21376 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.961923 21153 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:29.902432 21156 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:29.953922 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:29.961925 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:29.911149 21321 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:29.962289 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.966239 17420 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.965668 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:29.979187 18196 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:29.970151 17525 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:29.976543 18200 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
W20260709 13:19:29.952486 17495 connection.cc:256] RPC call timeout handler was delayed by -1.3715779690001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 13:19:29.971880 21153 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:29.981395 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.972661 21388 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:29.953162 21172 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:29.885912 21299 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.940604 20784 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:29.981583 17495 connection.cc:256] RPC call timeout handler was delayed by -1.0961779690001094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
I20260709 13:19:29.972318 18193 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:19:29.983314 21414 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:19:30.012610 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:29.984191 21375 raft_consensus.cc:670] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } [suppressed 5 similar messages]
I20260709 13:19:29.940884 21349 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:29.929102 21038 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.944248 21163 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:29.988030 21197 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:29.973631 21401 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:29.988978 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:29.989631 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:29.991357 17569 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.975221 17568 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.944454 21339 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:29.991237 21331 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:19:29.983624 21320 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:29.958853 21319 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:29.946457 21281 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.014454 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:30.017755 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1708) took 1329 ms. Trace:
I20260709 13:19:30.026506 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:30.026998 18194 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:29.979911 21369 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:29.974511 20797 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.957135 20998 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.035732 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:30.041303 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1602) took 1205 ms. Trace:
I20260709 13:19:30.010133 21165 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:30.043102 17522 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:29.963873 21409 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:30.045209 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 53922.3us
W20260709 13:19:30.047387 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 72243.8us
I20260709 13:19:30.057766 18196 raft_consensus.cc:2393] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 10: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:30.055995 17452 rpcz_store.cc:276] 0709 13:19:28.688251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.688356 (+   105us) service_pool.cc:224] Handling call
0709 13:19:28.688640 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.716370 (+ 27730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.716399 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.716849 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.892747 (+1175898us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b1800113f80. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab57060d1 00007f5ab5b21a0f
0709 13:19:30.015031 (+122284us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:30.015079 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.015142 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.017458 (+  2316us) raft_consensus.cc:1685] finished
0709 13:19:30.017476 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.017694 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5571,"raft.queue_time_us":29795,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":6599,"spinlock_wait_cycles":13251328,"thread_start_us":122116,"threads_started":1,"wal-append.queue_time_us":1293375}
W20260709 13:19:30.062506 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 49995.6us
W20260709 13:19:30.063856 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.071985 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:30.072062 17568 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:29.926512 21406 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.049669 21387 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:30.049834 21388 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.066550 17599 rpcz_store.cc:276] 0709 13:19:28.836283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.838269 (+  1986us) service_pool.cc:224] Handling call
0709 13:19:28.838623 (+   354us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:19:28.839028 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.839057 (+    29us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:19:29.802350 (+963293us) spinlock_profiling.cc:243] Waited 77.1 ms on lock 0x7b2c00007508. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446f372 00007f5ab5ba1a01 00007f5ab5b6643a 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2
0709 13:19:29.803383 (+  1033us) log.cc:844] Serialized 104 byte log entry
0709 13:19:29.895933 (+ 92550us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:29.895966 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.896028 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.028920 (+132892us) raft_consensus.cc:1685] finished
0709 13:19:30.028947 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.041215 (+ 12268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":368,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":177291520,"thread_start_us":92074,"threads_started":1,"wal-append.queue_time_us":121741}
I20260709 13:19:30.073352 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:30.073486 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:30.080749 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:30.038815 21263 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:19:30.086395 21163 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:30.086839 21163 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:30.087164 21359 raft_consensus.cc:3055] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:30.087697 21359 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:30.087258 20769 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.088524 21359 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.089087 17601 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:30.072417 20797 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.060097 21281 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.061038 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:30.099651 21406 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.079977 21339 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:30.102598 21159 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:30.103477 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.077108 21409 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.105425 18192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42548 (request call id 359) took 2842 ms. Trace:
I20260709 13:19:30.075086 20998 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:30.072938 21165 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.107196 21165 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.079223 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.044143 21038 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:30.087335 21331 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:30.118777 21331 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:30.119199 21331 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.076007 17568 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:30.121088 17522 raft_consensus.cc:2393] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:30.109930 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:30.113596 17527 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:30.050164 21172 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:19:30.077565 21401 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:30.105855 21409 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.123934 21401 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.124392 21401 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.063350 21161 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:30.125222 21405 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.126251 21177 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.126735 21177 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:30.087208 21163 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:30.123129 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 47157us
I20260709 13:19:30.128710 17568 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:30.120190 21038 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.127350 21405 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:30.129980 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:30.133632 17568 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:30.110644 21359 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:30.131706 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.138159 17568 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:30.103477 21319 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:30.145020 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:30.122908 21159 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.151217 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:30.105886 18192 rpcz_store.cc:276] 0709 13:19:27.263053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.282272 (+ 19219us) service_pool.cc:224] Handling call
0709 13:19:27.312322 (+ 30050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.426161 (+113839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.105127 (+2678966us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b5400438354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:30.105327 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122041216}
I20260709 13:19:30.158528 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1594) took 1398 ms. Trace:
I20260709 13:19:30.158910 17603 rpcz_store.cc:276] 0709 13:19:28.760659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.760819 (+   160us) service_pool.cc:224] Handling call
0709 13:19:28.774331 (+ 13512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.922947 (+148616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.158284 (+1235337us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400328f54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:30.158469 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340112256}
I20260709 13:19:30.160641 20977 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.146742 21156 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:30.134344 21409 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:30.162118 21159 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:30.141592 21224 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:30.132285 21200 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:30.163980 21200 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:30.164142 21376 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.164911 21200 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.165318 21182 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.168884 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:30.170797 21177 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:30.136195 21388 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:30.172178 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:30.180790 21375 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:30.158304 21421 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:19:30.184675 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:30.193475 17523 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.195472 21375 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:30.195923 21375 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.195803 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:30.196519 21375 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.198788 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.213594 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:30.197585 21177 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:30.222805 21177 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.225502 21177 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.226642 20797 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:30.230566 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:30.231208 17524 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.233579 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:30.234103 21153 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.234560 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:30.235479 21271 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.235853 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:30.236459 18199 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:30.147991 20998 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:30.239490 17450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:19:30.242228 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:30.244789 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.244982 17450 raft_consensus.cc:606] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:30.245368 17525 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:30.245574 17450 raft_consensus.cc:614] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:30.242997 17419 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:30.246611 17419 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:30.149503 21405 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:30.248297 21330 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 2.456s	user 0.012s	sys 0.005s
I20260709 13:19:30.248230 21405 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.250459 21405 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:30.250656 21182 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:30.247189 21355 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:30.251057 21182 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:30.251266 21355 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.251497 21182 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.251650 21355 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.252126 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.253250 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.243701 21348 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:30.254940 21348 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.255656 20769 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:30.198112 21422 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:19:30.257126 21348 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.244000 21271 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.257874 21271 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.262333 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.263267 17526 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
W20260709 13:19:30.284116 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.289790 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 141283us
I20260709 13:19:30.257794 21373 raft_consensus.cc:3055] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:30.265359 21346 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.104s	user 0.018s	sys 0.025s
I20260709 13:19:30.296608 17420 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:30.297283 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:30.298563 17352 catalog_manager.cc:5697] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.302264 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:30.290187 21384 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.279930 21376 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.305939 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:30.203847 21165 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:30.208989 21281 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:30.299890 21346 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.156s	user 0.019s	sys 0.025s
I20260709 13:19:30.314404 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.322266 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:30.323607 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:30.295929 21373 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:30.332046 21165 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:30.321724 21384 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:30.334950 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.335256 17450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:19:30.335892 17450 raft_consensus.cc:606] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:30.301806 21271 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.340994 17524 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:30.339013 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.341960 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:30.306536 20977 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.342906 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:30.308637 21334 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:30.351646 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:30.352088 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.359592 17529 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:30.345531 17523 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:30.354455 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.310168 21422 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:30.334522 21216 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:30.363343 17521 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:30.337888 21177 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.339808 21153 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.364653 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:30.367735 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.381182 17601 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.381546 17595 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:30.384735 17527 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:30.361938 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:30.355163 21398 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.369226 21177 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.367446 21271 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:30.371534 21182 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.372339 21281 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:30.398083 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.382685 21200 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.366969 21163 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:30.356599 21334 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.393123 21421 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:30.364104 20998 raft_consensus.cc:2764] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:19:30.364674 21422 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:30.397435 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:30.445338 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:30.387154 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:30.343602 21401 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:30.391723 21299 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:30.356594 21331 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:30.445993 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:30.368578 17523 raft_consensus.cc:1217] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-12.7]   Dedup: 7.4->[8.5-12.7]
I20260709 13:19:30.368569 21428 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 13:19:30.452944 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 65895.5us
I20260709 13:19:30.451030 21422 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.436932 21334 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.399351 21271 raft_consensus.cc:697] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:30.470085 21216 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:30.460156 21157 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:19:30.460057 21331 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:30.473104 17601 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:30.460290 21409 consensus_queue.cc:1059] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:19:30.455663 17523 pending_rounds.cc:85] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 4
I20260709 13:19:30.477298 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.486369 17523 pending_rounds.cc:107] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 11.5
W20260709 13:19:30.458832 21430 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:30.395675 21398 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:30.443216 21421 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:30.483379 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:30.469004 21153 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:30.444573 21200 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.454218 21384 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.491398 18167 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:30.467211 21177 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.494175 17521 raft_consensus.cc:1240] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:30.518690 17521 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:30.520236 17521 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:30.459653 21182 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.486792 17523 raft_consensus.cc:2889] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:30.476550 21216 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.479895 21401 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:30.460345 21172 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:30.519388 21381 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:30.508494 21421 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.476321 21355 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.507175 21300 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:30.524839 21299 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.529194 21216 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:30.485507 21271 consensus_queue.cc:237] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:30.559638 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 99860.2us
W20260709 13:19:30.563215 20784 consensus_meta.cc:287] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.004s
I20260709 13:19:30.579783 21045 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.555789 21381 raft_consensus.cc:697] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:19:30.622308 21433 log.cc:927] Time spent T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:19:30.624488 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1716) took 1933 ms. Trace:
I20260709 13:19:30.624974 17454 rpcz_store.cc:276] 0709 13:19:28.690587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.717006 (+ 26419us) service_pool.cc:224] Handling call
0709 13:19:28.717260 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.718983 (+  1723us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:28.738451 (+ 19468us) log.cc:844] Serialized 14 byte log entry
0709 13:19:29.813277 (+1074826us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b18002e2c40. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:19:30.308409 (+495132us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b18002e2c40. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab570623a 00007f5ab5b70a2a
0709 13:19:30.449853 (+141444us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.474215 (+ 24362us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.474376 (+   161us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:30.474411 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.474493 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.624135 (+149642us) raft_consensus.cc:1685] finished
0709 13:19:30.624154 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.624296 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2643,"prepare.queue_time_us":19563,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":46,"raft.queue_time_us":8139,"raft.run_cpu_time_us":1124,"raft.run_wall_time_us":19196,"spinlock_wait_cycles":34498816,"thread_start_us":126298,"threads_started":1,"wal-append.queue_time_us":1779386}
I20260709 13:19:30.627058 21422 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.635974 21422 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.642555 21163 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:30.646872 21200 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:30.650305 21381 consensus_queue.cc:237] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:30.652034 17524 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:19:30.578998 20784 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.657418 20784 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:30.659395 21431 log.cc:927] Time spent T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.217s	user 0.002s	sys 0.002s
I20260709 13:19:30.659668 21355 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:30.661172 21398 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:30.665841 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:30.666783 17449 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.666631 21191 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:19:30.669715 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.671000 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:30.671308 17569 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:30.671819 17446 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:30.676334 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:30.643505 21432 log.cc:927] Time spent T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:19:30.644730 17525 raft_consensus.cc:1240] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:30.678714 17449 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:30.681640 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:30.690479 21369 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:30.686641 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:30.570114 21299 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.687772 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:30.692456 17448 raft_consensus.cc:2410] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:30.684478 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:30.681008 21339 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.694651 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:30.702674 17446 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.700050 17449 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:30.701167 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:30.706746 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:30.687244 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:19:30.725665 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 44089.2us
I20260709 13:19:30.728168 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:30.731566 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.734171 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.735021 17601 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:30.737187 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.738042 17594 raft_consensus.cc:2393] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:30.738909 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.743568 17595 raft_consensus.cc:1240] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:30.691139 21369 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.687507 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:30.751819 17445 raft_consensus.cc:2393] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 13: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:30.699776 20784 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:30.764591 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.767254 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.768325 17598 raft_consensus.cc:2368] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9.
I20260709 13:19:30.770226 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.772529 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.772926 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.775534 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:30.775907 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 205624us
I20260709 13:19:30.777000 17495 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:30.778249 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:30.782619 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.799373 17595 raft_consensus.cc:2410] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:30.776383 17594 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:30.754323 17446 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:30.820613 17600 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
W20260709 13:19:30.822652 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 45777.7us
I20260709 13:19:30.727571 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:30.823788 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:30.830827 18201 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 7.
I20260709 13:19:30.753410 18199 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.843544 21444 raft_consensus.cc:3055] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:30.843663 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.844135 21444 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:30.844890 17603 raft_consensus.cc:2393] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:30.845073 21444 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.846552 21428 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:30.847816 21422 raft_consensus.cc:3055] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:30.848284 21422 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:30.849363 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.838874 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:30.797828 21435 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:19:30.748242 21321 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:30.864255 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:30.864331 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:30.865137 17601 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:30.865650 17453 raft_consensus.cc:2393] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:30.863574 17446 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:30.869258 17445 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:30.808503 21182 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.720665 21339 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.885032 21409 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:30.887235 21409 raft_consensus.cc:697] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:30.879081 18199 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:30.879837 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:30.880465 21334 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:30.888533 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.907323 17603 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:30.849185 21422 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:30.893932 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.889837 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:30.903546 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:30.904629 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:30.910931 17445 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:30.913165 17595 raft_consensus.cc:1240] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:30.918696 17419 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:30.920617 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.923096 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:30.923921 17451 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.926348 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:30.906724 21444 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.952545 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.939705 18198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42538 (request call id 362) took 1037 ms. Trace:
I20260709 13:19:30.954378 17595 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:30.928638 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:30.891129 21182 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:30.927768 21185 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:30.974083 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:30.957755 21422 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.908515 21406 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.924072 21346 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:30.972618 21185 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:31.000556 21375 consensus_meta.cc:287] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.804s	user 0.014s	sys 0.000s
I20260709 13:19:31.004058 21185 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.973902 21409 consensus_queue.cc:237] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.013058 21299 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:31.017227 21447 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:31.014505 21375 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:31.063243 21426 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.765s	user 0.007s	sys 0.000s
W20260709 13:19:31.063161 21421 consensus_meta.cc:287] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.006s
I20260709 13:19:31.065807 21421 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.044338 21447 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:19:31.064769 21373 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.082062 21373 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.088811 21375 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.002942 21406 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:31.134718 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 214241us
I20260709 13:19:31.137472 17419 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:30.929519 17449 raft_consensus.cc:2368] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8.
I20260709 13:19:31.158185 17527 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:31.159169 17527 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:31.160470 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 234072us
I20260709 13:19:31.161778 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:31.161351 17527 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.162942 17522 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:31.164829 17527 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.167562 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 544) took 1350 ms. Trace:
W20260709 13:19:31.170243 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.171350 17568 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.039s	sys 0.086s
W20260709 13:19:31.171864 17568 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.039s	sys 0.086s
W20260709 13:19:31.172466 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 538533us
I20260709 13:19:31.164855 17352 catalog_manager.cc:5697] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.175762 17352 catalog_manager.cc:5697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.168239 17529 rpcz_store.cc:276] 0709 13:19:29.816810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.379011 (+562201us) service_pool.cc:224] Handling call
0709 13:19:30.379344 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.379687 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.379715 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.380214 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.581102 (+200888us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:30.581168 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.581238 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.166598 (+585360us) raft_consensus.cc:1685] finished
0709 13:19:31.166677 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.167178 (+   501us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":280,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":198831,"threads_started":1,"wal-append.queue_time_us":583484}
I20260709 13:19:31.185621 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:31.186734 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.229703 17525 raft_consensus.cc:3060] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.230309 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:31.230762 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.231709 17524 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:31.231896 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.185832 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.233052 17526 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
W20260709 13:19:31.191372 17599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.003s	sys 0.006s
I20260709 13:19:30.985385 17595 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
W20260709 13:19:31.233980 17599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.004s	sys 0.006s
I20260709 13:19:31.191922 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:31.238742 17597 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:31.240433 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:31.240784 17597 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:31.241617 17448 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:31.193352 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:31.193840 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:31.243126 17603 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:31.190632 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:31.194595 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:31.197495 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:31.199528 17568 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:31.200627 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:31.204231 17527 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:19:31.208043 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.224647 18195 raft_consensus.cc:2368] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13.
I20260709 13:19:30.955706 18198 rpcz_store.cc:276] 0709 13:19:29.902708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.902855 (+   147us) service_pool.cc:224] Handling call
0709 13:19:29.945414 (+ 42559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.984857 (+ 39443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.984892 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.211947 (+227055us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b2c0004d0d8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446f372 00007f5ab5ba1a01 00007f5ab5b6643a 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2
0709 13:19:30.212550 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.293013 (+ 80463us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:30.444724 (+151711us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.450143 (+  5419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.939187 (+489044us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b540040f454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:30.939279 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.939352 (+    73us) raft_consensus.cc:1685] finished
0709 13:19:30.939373 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.939615 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1898,"prepare.queue_time_us":61448,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":6823,"raft.queue_time_us":14279,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":20167,"spinlock_wait_cycles":104056576,"thread_start_us":166183,"threads_started":2,"wal-append.queue_time_us":122042}
I20260709 13:19:31.192602 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:31.244805 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 54857.8us
I20260709 13:19:31.253610 17602 raft_consensus.cc:2393] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:31.294430 17525 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:31.332490 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2259) took 1188 ms. Trace:
I20260709 13:19:31.334921 17527 rpcz_store.cc:276] 0709 13:19:30.143645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.509383 (+365738us) service_pool.cc:224] Handling call
0709 13:19:30.509826 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.157744 (+647918us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54003e2220. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5adddc0 00007f5ab5b681c0 00007f5ab5b69231 00007f5ab5b65d8f 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c
0709 13:19:31.254001 (+ 96257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.332424 (+ 78423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718050560}
I20260709 13:19:31.343086 17600 raft_consensus.cc:2393] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 8: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:31.042094 21339 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:31.360460 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 220023us
I20260709 13:19:31.369897 17596 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:31.395537 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:31.396973 17445 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:31.400298 21182 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.402937 17352 catalog_manager.cc:5697] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 6 to 7, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 7 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:31.408125 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 479910us
I20260709 13:19:31.410261 21246 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:31.411245 21246 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.415771 21259 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:31.416510 21259 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.422451 21299 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:31.427448 21355 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.428015 21157 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:19:31.428218 21355 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.429042 21157 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:31.430416 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 507843us
I20260709 13:19:31.437505 21441 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:31.438215 21371 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:31.438658 21381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.029s	sys 0.047s
I20260709 13:19:31.438512 20784 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.439157 21163 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.439518 21191 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.039s	sys 0.066s
I20260709 13:19:31.324666 21334 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:31.440135 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 240782us
I20260709 13:19:31.442631 21382 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.444296 21442 consensus_queue.cc:1059] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:31.446592 21421 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.429666 21157 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:31.449466 21259 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.434976 17352 catalog_manager.cc:5697] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 7 to 8, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 8 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:31.468257 21381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.030s	sys 0.048s
I20260709 13:19:31.455251 21406 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:31.456965 17347 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40498 (request call id 190) took 20277 ms (client timeout 15000 ms). Trace:
I20260709 13:19:31.393110 17569 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:31.435019 17451 consensus_meta.cc:287] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.007s
I20260709 13:19:31.526400 21246 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.526257 21441 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:31.537212 21355 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.464417 21299 raft_consensus.cc:697] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:31.530354 21191 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.039s	sys 0.066s
I20260709 13:19:31.531821 21157 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.530198 21371 raft_consensus.cc:697] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:31.579247 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.568586 17451 raft_consensus.cc:2468] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
W20260709 13:19:31.599850 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 412655us
I20260709 13:19:31.606500 17568 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:31.626266 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.630935 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 72104.4us
I20260709 13:19:31.578568 21371 consensus_queue.cc:237] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.647652 21182 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:31.648733 21182 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:31.580199 21382 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:31.604619 21355 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.575935 21163 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:31.661080 21446 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.005s	sys 0.006s
W20260709 13:19:31.661494 21452 log.cc:927] Time spent T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:19:31.661821 21438 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.006s	sys 0.002s
W20260709 13:19:31.663638 21439 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.000s	sys 0.012s
I20260709 13:19:31.664695 21355 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.632299 17352 catalog_manager.cc:5697] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 10 to 11, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 11 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.666340 17568 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:31.667205 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 333956us
I20260709 13:19:31.622220 21406 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:31.667822 21182 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:31.667878 21465 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:31.661839 21373 consensus_meta.cc:287] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.010s
I20260709 13:19:31.668438 21307 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:31.667963 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:31.670769 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.671922 21339 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:31.672195 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:31.672438 21185 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:31.674278 21447 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.012s	sys 0.000s
W20260709 13:19:31.674772 21409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.017s	sys 0.026s
I20260709 13:19:31.675500 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.679517 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1816) took 1991 ms. Trace:
W20260709 13:19:31.698436 21438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.007s	sys 0.002s
W20260709 13:19:31.689517 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 48965.3us
W20260709 13:19:31.682996 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.696141 21446 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.005s	sys 0.007s
I20260709 13:19:31.732393 21331 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:31.732995 21441 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:31.698271 21439 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.000s	sys 0.013s
I20260709 13:19:31.736505 21163 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:31.737435 21406 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:31.740398 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:31.725754 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 482) took 1348 ms. Trace:
I20260709 13:19:31.742334 21465 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:31.741631 17599 rpcz_store.cc:276] 0709 13:19:30.374172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.374298 (+   126us) service_pool.cc:224] Handling call
0709 13:19:30.374623 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.521555 (+146932us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:30.609460 (+ 87905us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.234794 (+625334us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:31.236113 (+  1319us) log.cc:844] Serialized 26 byte log entry
0709 13:19:31.236411 (+   298us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:31.236466 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.246282 (+  9816us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001e41d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:31.246347 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.683615 (+437268us) raft_consensus.cc:1685] finished
0709 13:19:31.687760 (+  4145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.722418 (+ 34658us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46103,"prepare.queue_time_us":108958,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":119710,"raft.run_cpu_time_us":645,"raft.run_wall_time_us":44605,"spinlock_wait_cycles":336818432,"thread_start_us":699782,"threads_started":2,"wal-append.queue_time_us":1049857}
I20260709 13:19:31.745162 21465 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:31.745854 17526 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:31.746838 21165 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:31.747149 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.747630 21165 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.748631 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.749450 17526 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
W20260709 13:19:31.750818 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 96550.3us
I20260709 13:19:31.751998 17568 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:31.730676 21409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.018s	sys 0.027s
W20260709 13:19:31.758838 21447 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.013s	sys 0.000s
I20260709 13:19:31.767831 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.726958 17523 rpcz_store.cc:276] 0709 13:19:29.687849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.365949 (+678100us) service_pool.cc:224] Handling call
0709 13:19:30.368321 (+  2372us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:19:31.180267 (+811946us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b180017aca0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab570e4bc 00007f5ab2a5c48b 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a76455 00007f5ab5b5e060 00007f5ab5b5ebfb 00007f5ab5b6964b
0709 13:19:31.180957 (+   690us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:31.181007 (+    50us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:31.201085 (+ 20078us) log.cc:844] Serialized 78 byte log entry
0709 13:19:31.575501 (+374416us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:31.575546 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.597124 (+ 21578us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.679009 (+ 81885us) raft_consensus.cc:1685] finished
0709 13:19:31.679029 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.679330 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1495,"raft.queue_time_us":284280,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":17952,"spinlock_wait_cycles":29749632,"thread_start_us":656705,"threads_started":2,"wal-append.queue_time_us":475533}
I20260709 13:19:31.740418 21406 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:31.774854 17524 raft_consensus.cc:2393] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:31.772866 21373 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:31.780323 21355 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.781260 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.782707 21185 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.783174 21382 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.733716 21299 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.771441 21163 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:31.769088 17352 catalog_manager.cc:5697] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 6 to 7, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 7 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:19:31.795284 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:31.795957 21479 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:31.796128 18195 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.796075 17352 catalog_manager.cc:5697] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.796886 21479 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.763355 21331 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:31.786366 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:31.808609 21438 raft_consensus.cc:3055] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:31.808871 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 68597.5us
W20260709 13:19:31.809249 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.811256 21477 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:31.812441 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:31.813593 21271 raft_consensus.cc:2764] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:31.813280 21477 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:31.814265 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2270) took 1581 ms. Trace:
I20260709 13:19:31.814965 17445 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:31.814785 17521 rpcz_store.cc:276] 0709 13:19:30.146875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.529862 (+382987us) service_pool.cc:224] Handling call
0709 13:19:30.531550 (+  1688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.734379 (+202829us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:31.156865 (+422486us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.619116 (+462251us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:31.661227 (+ 42111us) log.cc:844] Serialized 26 byte log entry
0709 13:19:31.661393 (+   166us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:31.661707 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.686039 (+ 24332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.690400 (+  4361us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.690470 (+    70us) raft_consensus.cc:1685] finished
0709 13:19:31.690498 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.728519 (+ 38021us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95330,"prepare.queue_time_us":807265,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":326602,"raft.run_cpu_time_us":745,"raft.run_wall_time_us":96754,"thread_start_us":989909,"threads_started":3,"wal-append.queue_time_us":505536}
I20260709 13:19:31.817294 17419 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:31.809207 21438 raft_consensus.cc:740] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:31.818882 21331 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.819836 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:31.806175 21165 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:31.821944 21422 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:31.823123 21355 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.823386 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:31.823791 21355 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.825233 17420 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:31.826355 21406 raft_consensus.cc:1064] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
W20260709 13:19:31.826900 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 59883.9us
I20260709 13:19:31.828068 17419 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:31.828502 21259 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:31.828984 21259 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.829378 21259 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.826288 21185 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:31.830235 21185 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:31.830480 21369 consensus_meta.cc:287] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.975s	user 0.012s	sys 0.008s
I20260709 13:19:31.830699 21185 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.830749 17451 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:31.830916 21369 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:31.833251 21369 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:31.833606 21466 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:31.834141 21466 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.834597 21466 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.835386 17454 raft_consensus.cc:1240] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:31.825294 21481 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.829440 17419 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:31.849144 21339 raft_consensus.cc:697] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:31.852074 17352 catalog_manager.cc:5697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.859835 21468 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:31.829535 21406 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:31.863569 21216 consensus_meta.cc:287] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.290s	user 0.010s	sys 0.009s
I20260709 13:19:31.864102 21216 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.864495 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.865275 17522 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:31.865309 17523 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:31.866721 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:31.869259 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.869959 17523 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:31.870986 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:31.867658 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.873737 21157 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.876772 17529 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:31.884951 18195 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:31.885337 17445 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 13.
I20260709 13:19:31.826700 21355 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.771165 21307 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.891695 17352 catalog_manager.cc:5697] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:31.537690 17347 rpcz_store.cc:269] 0709 13:19:11.179161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.179473 (+   312us) service_pool.cc:224] Handling call
0709 13:19:31.456681 (+20277208us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:24.761545 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:24.769707 (+  8162us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:24.769756 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:19:24.769797 (+    41us) tablet.cc:662] Decoding operations
0709 13:19:24.771046 (+  1249us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:24.771142 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:24.771177 (+    35us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:19:24.772289 (+  1112us) tablet.cc:701] Row locks acquired
0709 13:19:24.772342 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:19:24.772532 (+   190us) write_op.cc:270] Start()
0709 13:19:24.772676 (+   144us) write_op.cc:276] Timestamp: P: 1783603164772460 usec, L: 0
0709 13:19:24.772696 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:19:24.773374 (+   678us) log.cc:844] Serialized 5193 byte log entry
0709 13:19:25.413893 (+640519us) op_driver.cc:464] REPLICATION: finished
0709 13:19:25.646935 (+233042us) write_op.cc:301] APPLY: starting
0709 13:19:25.674884 (+ 27949us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:25.789083 (+114199us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:25.797898 (+  8815us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:25.973835 (+175937us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:26.205239 (+231404us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:19:26.217509 (+ 12270us) write_op.cc:312] APPLY: finished
0709 13:19:26.371819 (+154310us) log.cc:844] Serialized 95 byte log entry
0709 13:19:26.528662 (+156843us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:26.556900 (+ 28238us) write_op.cc:454] Released schema lock
0709 13:19:26.584581 (+ 27681us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:26.585240 (+   659us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:26.585292 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52667,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":165148,"apply.run_cpu_time_us":23622,"apply.run_wall_time_us":957198,"num_ops":13,"prepare.queue_time_us":193245,"prepare.run_cpu_time_us":37691,"prepare.run_wall_time_us":386825,"raft.queue_time_us":166628,"raft.run_cpu_time_us":32299,"raft.run_wall_time_us":231995,"replication_time_us":596735,"thread_start_us":404683,"threads_started":5,"wal-append.queue_time_us":488337,"wal-append.run_cpu_time_us":17367,"wal-append.run_wall_time_us":2116622}]]}
W20260709 13:19:31.893219 17494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.020s	sys 0.028s
W20260709 13:19:31.896075 17494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.020s	sys 0.028s
W20260709 13:19:31.896184 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 123172us
I20260709 13:19:31.912127 17419 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:31.912766 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 87742.1us
I20260709 13:19:31.894289 21165 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.917358 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.890728 21369 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:31.893297 21479 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.896522 21465 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:31.921674 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:31.916738 17419 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:31.921847 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:31.926664 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.929250 21486 log.cc:927] Time spent T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 13:19:31.932947 21481 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:31.933970 21157 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.934746 21369 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.936261 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:31.917306 21355 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:31.939133 21355 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:31.936299 21438 consensus_queue.cc:260] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.940439 21438 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.942193 21157 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.939740 21355 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.909128 21446 consensus_queue.cc:1059] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:19:31.942936 21157 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.939227 17524 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:19:31.943782 21446 raft_consensus.cc:3055] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:31.944006 17524 pending_rounds.cc:85] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 9
I20260709 13:19:31.944351 21446 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:31.944485 17524 pending_rounds.cc:107] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:19:31.945192 17524 raft_consensus.cc:2889] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:31.947357 21045 consensus_meta.cc:287] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.367s	user 0.006s	sys 0.014s
I20260709 13:19:31.949321 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:31.949563 21465 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:31.949616 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:31.954254 21347 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.921788 21462 consensus_queue.cc:1059] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:19:31.955422 21347 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.896442 21185 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:31.971400 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 54707.8us
I20260709 13:19:31.937522 21369 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.921705 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:31.972606 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:31.919571 20784 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:31.942472 21307 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:31.988039 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 84758.9us
W20260709 13:19:31.989001 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 237182us
W20260709 13:19:31.990782 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 76922.4us
I20260709 13:19:31.989734 17420 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:31.933768 21259 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.975276 21481 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:31.992200 17520 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:31.945587 21446 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.956501 21165 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.993335 21331 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:31.993414 21216 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:31.913434 21339 consensus_queue.cc:237] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:31.999176 21481 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.998955 21462 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:32.025288 17601 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:32.009948 18195 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:32.024986 21369 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.030354 17419 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:32.018551 21481 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.017735 21495 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:32.004108 21276 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 13:19:32.026785 21157 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:32.046923 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.028631 21462 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:32.050493 21347 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:32.051344 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.054342 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:32.054710 21490 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:19:32.054899 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:32.056540 21165 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:32.036229 21371 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:32.058385 21495 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:32.045545 17568 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:32.057232 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:32.067457 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.034118 21182 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.028730 21331 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.044260 21465 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:32.047730 21446 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.076086 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:32.076637 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:32.076831 17525 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.034850 21191 consensus_queue.cc:1059] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:19:32.078249 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:32.078547 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 44511us
I20260709 13:19:32.073046 21177 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:32.085829 21259 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.080246 21331 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:32.068216 21479 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.073102 21475 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.284s	user 0.004s	sys 0.000s
I20260709 13:19:32.071645 21157 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.094522 21157 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:32.097558 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.098243 17528 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:32.099761 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:32.101080 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:32.101243 21465 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:32.092193 17521 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:19:32.089527 21499 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:32.070432 21371 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:32.091737 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.086374 21177 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:32.105206 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 181431us
I20260709 13:19:32.111461 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:32.112982 17520 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.088586 21165 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:32.136256 21216 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:32.137444 21216 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:32.137861 21216 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:32.138980 21216 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:32.140511 21216 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.140827 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:32.142129 21479 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.144601 21479 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.145270 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.145735 21492 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:32.145973 17521 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:32.146458 21492 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:32.147061 21299 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:32.147617 21492 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.148090 21373 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:32.148622 21299 consensus_queue.cc:1059] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:32.149515 21165 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:32.149976 21321 raft_consensus.cc:3055] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:32.150481 21321 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:32.150624 21165 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.151547 21321 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.152657 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:32.153810 21469 consensus_queue.cc:1059] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:32.154266 21334 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:32.154358 17419 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:32.154486 21185 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.154776 21469 raft_consensus.cc:3055] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:32.155252 21469 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:32.118464 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:32.119880 21462 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:32.130388 21461 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:19:32.163478 17569 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:32.164896 21373 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:32.131915 21468 raft_consensus.cc:3055] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:32.133229 21495 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:32.105980 21182 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:32.167937 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 74498.2us
I20260709 13:19:32.170452 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:32.112933 21371 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.159042 17525 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
W20260709 13:19:32.121838 17528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 2219) took 3408 ms (client timeout 1966 ms). Trace:
I20260709 13:19:32.156291 21469 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.162232 17595 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:32.163420 21331 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:32.098590 21157 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.161262 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:32.153746 21497 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:19:32.112615 21347 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:32.177233 17528 rpcz_store.cc:269] 0709 13:19:28.713847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.714010 (+   163us) service_pool.cc:224] Handling call
0709 13:19:32.121591 (+3407581us) spinlock_profiling.cc:243] Waited 3.27 s on lock 0x7b54002f7e54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:32.121742 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7526730496}
I20260709 13:19:32.188710 17419 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:32.198746 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:32.196173 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:32.168781 21191 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:32.172936 21468 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:32.209586 17594 raft_consensus.cc:2393] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:32.168888 21479 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:32.196298 21331 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.221611 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:32.214459 17599 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:19:32.222144 17602 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:32.211865 21467 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:32.204097 21045 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:32.210682 21191 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.198933 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:32.225687 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.233057 17596 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:32.198678 21185 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:32.228811 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:32.239360 17595 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:32.219213 21406 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:32.235280 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 76595.8us
W20260709 13:19:32.235790 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 59026.9us
I20260709 13:19:32.224146 21331 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:32.237658 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 45941.6us
I20260709 13:19:32.235409 21191 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.247394 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:32.235435 21467 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.249665 21342 raft_consensus.cc:3055] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:32.251432 21467 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.253221 17568 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:32.286911 17520 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:32.256559 17569 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:32.257212 21339 consensus_queue.cc:1059] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:32.257349 21191 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.294049 21045 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.294600 21045 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:32.295784 21191 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.296442 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:32.296707 21045 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:32.297513 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 54215.4us
I20260709 13:19:32.298400 17420 leader_election.cc:400] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9.
I20260709 13:19:32.298658 17420 leader_election.cc:403] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:32.262787 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 1b89997d0ecd4f03a927078433a85a66: Illegal state: Replica 0480cf54c3cc424ab94b963ef2ff5bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:32.299777 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:32.301561 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:32.302906 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:32.304183 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:32.304370 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:32.304776 17602 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:32.305841 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:32.301751 21467 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:32.307669 21467 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9.
I20260709 13:19:32.308341 21467 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:32.263417 21185 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.269632 21481 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.311558 21321 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.312258 21185 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.312547 21481 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.262410 21468 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.263357 21406 raft_consensus.cc:697] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:32.263710 21331 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.265554 21182 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.266168 21177 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.233309 21334 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:32.268035 21355 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:32.337838 21355 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:32.231076 20784 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:32.242803 21479 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.236790 21469 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.282419 21466 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.282217 21342 raft_consensus.cc:740] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:32.254331 21163 consensus_queue.cc:1059] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:32.342712 21466 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.343067 21163 raft_consensus.cc:3055] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:32.343457 21163 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:32.344281 21163 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.344934 21200 raft_consensus.cc:3055] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:32.345387 21200 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:32.321956 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.346160 21369 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:32.346414 21200 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.332350 21334 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.348272 21331 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:32.332638 21299 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:32.332381 21495 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:32.349253 21299 raft_consensus.cc:697] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:32.349210 21334 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.350112 21045 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:32.350878 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 94410.6us
I20260709 13:19:32.347224 21461 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:32.351573 21461 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:32.352988 17569 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:32.353075 17520 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:32.353797 21461 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.354270 21495 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:32.354151 21339 consensus_queue.cc:1059] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:32.354708 21495 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.355113 21495 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.355242 21339 raft_consensus.cc:3055] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:32.355645 21339 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:32.356477 21339 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.358678 17569 leader_election.cc:400] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8.
I20260709 13:19:32.363772 17569 leader_election.cc:403] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:32.358911 21200 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:32.277638 17597 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:19:32.345409 21163 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.301590 17420 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:32.349188 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:32.340763 21479 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.350520 21299 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:32.364225 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.404138 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 150961us
W20260709 13:19:32.366791 21510 log.cc:927] Time spent T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 13:19:32.403903 21406 consensus_queue.cc:237] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.402997 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:32.402997 21371 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.407086 21495 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:32.431088 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 72536.8us
W20260709 13:19:32.431720 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 82619us
I20260709 13:19:32.443401 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:32.440101 21373 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.438650 21347 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:32.453557 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.454231 17569 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:32.442919 21339 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.457630 17594 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:32.444022 21479 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:32.464651 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:32.471870 17419 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:32.476953 17525 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:32.477952 17529 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:32.478633 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.479411 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.480168 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:32.497851 17524 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.481171 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.481288 18198 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:32.481869 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:32.498940 17523 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.478003 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.486155 21491 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:32.499996 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 198525us
I20260709 13:19:32.448410 21468 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.499619 17528 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
W20260709 13:19:32.502553 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.503360 17527 raft_consensus.cc:2393] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 11: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:32.505460 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.508759 17520 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:32.460074 21347 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:32.489336 21479 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.519232 21479 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.519150 21342 consensus_queue.cc:260] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:32.500422 21491 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.519161 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.523864 17525 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:32.505429 21334 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:32.525208 17419 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:32.530740 17454 raft_consensus.cc:1240] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:32.531284 17420 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:32.515085 21347 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:32.532135 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.534462 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 80950us
I20260709 13:19:32.513916 21331 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:32.541237 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:32.544706 17569 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:32.524561 21491 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.526190 21165 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:32.558772 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:32.560775 21355 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:32.561214 21177 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:32.547122 21331 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.570384 17419 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:32.514042 21259 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:32.573325 17525 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.522800 21369 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:19:32.534291 21334 raft_consensus.cc:697] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:32.607939 21466 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:32.630563 21466 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:32.610116 21528 log.cc:927] Time spent T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:19:32.630991 21466 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:32.610190 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.611280 21177 raft_consensus.cc:697] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:32.634584 21177 consensus_queue.cc:237] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.577466 21355 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:32.638949 21334 consensus_queue.cc:237] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.615105 21371 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.616330 21520 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:19:32.614902 21492 raft_consensus.cc:2804] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:32.643359 21492 raft_consensus.cc:697] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:32.644425 21492 consensus_queue.cc:237] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.614856 21495 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:32.646390 21438 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.646999 21438 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.648650 21165 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:32.648983 21438 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:32.649125 21165 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:32.651012 21342 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:32.611672 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 97494.7us
I20260709 13:19:32.656406 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:32.662900 17454 raft_consensus.cc:1240] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:32.623507 21373 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 7. Current term is 8.
I20260709 13:19:32.608983 21347 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:32.616511 21331 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:32.672086 21347 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:32.670310 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:32.673415 17520 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.677214 17522 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:32.680739 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 145859us
I20260709 13:19:32.638983 21355 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.572530 21461 consensus_queue.cc:1059] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:19:32.629410 21479 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.716207 21512 consensus_queue.cc:1059] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:32.717365 21512 raft_consensus.cc:3055] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:32.717716 21512 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:32.700131 17524 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:32.706856 17523 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:32.684171 21465 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:32.713507 17420 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:32.721639 17419 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:32.739554 17525 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:32.684893 21045 consensus_queue.cc:1059] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:19:32.748342 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 180805us
I20260709 13:19:32.743067 17419 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:32.723765 21465 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.761511 17419 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:32.764761 17454 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:32.717841 21165 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.748065 21259 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:32.807336 17520 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:32.811321 17419 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:32.819357 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 108846us
I20260709 13:19:32.770121 21469 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:32.821874 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.760798 21045 consensus_queue.cc:1243] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:32.822981 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:32.774729 21465 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.718830 21512 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:32.827054 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:32.797823 21371 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:32.834266 17603 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:32.822153 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:32.833390 17595 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:32.837387 17597 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:32.812359 21406 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:32.841766 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:32.842739 17451 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
W20260709 13:19:32.843884 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.818547 21259 raft_consensus.cc:697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:32.827400 21481 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:32.849256 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.850886 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:32.852414 17569 connection.cc:256] RPC call timeout handler was delayed by -1.0631303239999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 13:19:32.852603 17454 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:32.853974 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:32.854476 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.858512 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.859241 17525 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:32.860373 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.861802 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.864105 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.864109 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:32.865778 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:32.841766 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:19:32.869612 21522 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:19:32.871209 21165 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:32.872030 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:32.847875 17495 consensus_peers.cc:597] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1c40484b7a540a9b32947573409178a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.879599 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.880470 17520 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 11: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:32.884177 17595 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:32.837925 21339 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.878782 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 54825.7us
W20260709 13:19:32.907140 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 222363us
I20260709 13:19:32.848150 21469 raft_consensus.cc:697] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:32.907178 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:32.919453 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:32.922976 17524 raft_consensus.cc:2393] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:32.920992 17523 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:32.922935 17569 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:32.907758 17522 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:32.931001 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:32.931914 17525 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.885183 21406 raft_consensus.cc:697] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:32.922523 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:32.943472 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:32.939749 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:32.944252 17445 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:32.892189 21481 raft_consensus.cc:697] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:32.850862 21299 consensus_queue.cc:1059] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:19:32.923722 21512 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:32.930668 21506 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.933207 21492 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.938977 21537 consensus_queue.cc:1059] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:19:32.959816 21259 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.939188 21442 consensus_queue.cc:1059] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:19:32.961997 21276 raft_consensus.cc:3055] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:32.961747 21481 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.939098 21165 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:33.002204 21538 log.cc:927] Time spent T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:19:32.969622 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 46754.8us
I20260709 13:19:32.979192 17603 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:32.930775 21466 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.939193 21532 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:19:33.000666 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.001245 21469 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.930903 21339 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:32.973923 21479 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:33.014472 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:32.972219 21533 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.979995 21537 consensus_queue.cc:1243] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:33.027518 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:33.010258 21373 raft_consensus.cc:3055] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:33.006583 21276 raft_consensus.cc:740] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:32.980727 17525 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
W20260709 13:19:33.038352 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 90213.3us
I20260709 13:19:33.042955 17597 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:32.976389 21492 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.047385 21492 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:33.047923 21492 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:33.049026 17598 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:33.049535 17594 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:33.048424 21492 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:33.028303 20784 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:33.050469 21537 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:33.050570 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:33.066269 17599 raft_consensus.cc:2393] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 12: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:33.045873 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.051478 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:33.051270 21276 consensus_queue.cc:260] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:33.053947 17595 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.054577 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:32.976053 21506 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:33.056941 17454 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:33.077195 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:33.078300 17523 raft_consensus.cc:2410] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:19:33.056865 17568 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:33.071746 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:33.056988 21540 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:19:33.038100 21321 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:33.080780 17448 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:33.080886 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:33.039588 21373 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:33.091158 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 63775.5us
I20260709 13:19:33.017000 21532 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.065631 20784 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:33.106545 17568 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:33.113248 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:33.118702 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.086956 21519 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:33.086438 21299 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:33.055998 21533 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.066093 21537 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.123414 17448 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:33.125480 17524 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:33.112293 21468 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:33.151716 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 181088us
I20260709 13:19:33.120958 21442 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.124064 21331 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:33.155614 17595 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:33.157631 17450 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:33.128237 21299 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.107892 21200 consensus_queue.cc:1059] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:19:33.182281 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 73640.7us
I20260709 13:19:33.112654 21163 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:19:33.097685 21406 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:33.191607 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.159683 21276 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.194736 21523 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:33.159497 21165 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:33.150957 21495 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.126236 21321 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:33.186270 21299 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:33.196158 21491 consensus_meta.cc:287] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.000s
I20260709 13:19:33.217453 17569 leader_election.cc:400] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Vote denied by peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) with higher term. Message: Invalid argument: T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13.
I20260709 13:19:33.219381 17569 leader_election.cc:403] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:33.222991 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:33.224012 17448 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.206058 21045 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:33.166873 21442 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.238567 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:33.251432 21533 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:33.252686 21541 log.cc:927] Time spent T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:19:33.237921 21045 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.254896 21045 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:33.258594 21532 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:33.259070 21157 raft_consensus.cc:3055] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:33.259487 21157 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:33.260380 21532 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) with higher term. Message: Invalid argument: T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13.
I20260709 13:19:33.260829 21157 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:19:33.265710 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 219933us
I20260709 13:19:33.262388 21537 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:33.263381 21506 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:33.234050 21549 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.001s
I20260709 13:19:33.225332 21339 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:33.216251 21495 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.218245 21491 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.225100 21466 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:33.192229 21373 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:33.270913 21342 consensus_meta.cc:287] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.001s
I20260709 13:19:33.282277 17420 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.287902 21157 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.304917 17448 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:33.307601 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:33.308216 17594 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:33.284099 21321 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:33.284617 21492 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:33.305799 21045 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:33.298820 21468 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:33.321308 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:33.321635 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.352927 21165 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:33.373379 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 98578.3us
I20260709 13:19:33.318449 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:33.353463 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 288972us
I20260709 13:19:33.375362 17602 raft_consensus.cc:1217] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Deduplicated request from leader. Original: 7.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 13:19:33.376103 17602 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:19:33.377810 18167 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.379093 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:33.312194 21373 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.402132 21466 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:33.297466 20784 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:33.406561 21216 raft_consensus.cc:3055] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:33.407092 21216 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:33.408002 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.408331 21216 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.409183 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:33.410537 21334 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:33.411072 21334 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.411507 21334 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.409210 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:33.383414 21555 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:33.382793 21165 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:33.385051 21462 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.387172 21495 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:33.387413 21562 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:33.390508 21536 log.cc:927] Time spent T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.453s	user 0.000s	sys 0.004s
I20260709 13:19:33.394101 21546 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.397433 21491 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:33.399746 21442 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:33.373121 21045 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.305305 21465 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.409683 21216 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.353901 21468 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:33.452356 21468 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.423024 17596 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:33.428797 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.437353 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:33.455065 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:33.455636 17526 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:33.455703 21545 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.331s	user 0.001s	sys 0.001s
I20260709 13:19:33.455991 17594 raft_consensus.cc:2393] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:33.456670 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:33.457352 17526 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.457370 21371 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:33.459015 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:33.459674 17601 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.441885 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:33.462823 17527 raft_consensus.cc:2393] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:33.463945 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:33.464783 17528 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:33.440918 21045 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:33.443553 21465 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:33.449891 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:33.451047 17525 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:19:33.472014 17525 pending_rounds.cc:85] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 4
I20260709 13:19:33.472295 17525 pending_rounds.cc:107] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:33.472541 17525 raft_consensus.cc:2889] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:33.472813 17525 pending_rounds.cc:107] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:33.472970 17525 raft_consensus.cc:2889] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:33.451676 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:33.455114 17420 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.420575 21331 raft_consensus.cc:697] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:33.475060 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 264404us
I20260709 13:19:33.485859 17526 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:33.429839 21406 consensus_queue.cc:1059] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
W20260709 13:19:33.490511 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.500473 17569 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.507709 21331 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.485867 21045 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:33.509220 21045 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.511945 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:33.519155 21371 raft_consensus.cc:2764] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:33.521725 17450 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:33.525095 17525 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:19:33.525540 17525 pending_rounds.cc:85] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 6
I20260709 13:19:33.538889 17601 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
W20260709 13:19:33.546897 17352 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 100) took 15020 ms (client timeout 15000 ms). Trace:
W20260709 13:19:33.547143 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 92148.1us
I20260709 13:19:33.475028 21442 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.548184 17451 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:33.552359 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:33.553601 17524 raft_consensus.cc:2410] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:19:33.555001 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 69734.6us
I20260709 13:19:33.511905 21045 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:33.525815 17525 pending_rounds.cc:107] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 13:19:33.561196 17525 raft_consensus.cc:2917] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260709 13:19:33.561625 17525 raft_consensus.cc:2889] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:33.555682 17495 leader_election.cc:336] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.568s (SENT)
I20260709 13:19:33.559537 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.560508 17569 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.567157 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:33.568013 17448 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.571563 17569 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:33.572762 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.574760 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:35580 (request call id 8) took 1215 ms. Trace:
I20260709 13:19:33.575155 17526 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:33.544513 21563 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:33.547416 17352 rpcz_store.cc:269] 0709 13:19:18.526441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.528223 (+  1782us) service_pool.cc:224] Handling call
0709 13:19:33.546778 (+15018555us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:32.241844 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:32.259989 (+ 18145us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:32.260066 (+    77us) write_op.cc:435] Acquired schema lock
0709 13:19:32.260096 (+    30us) tablet.cc:662] Decoding operations
0709 13:19:32.261609 (+  1513us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:32.261734 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:32.261775 (+    41us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:19:32.303183 (+ 41408us) tablet.cc:701] Row locks acquired
0709 13:19:32.303239 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:19:32.303432 (+   193us) write_op.cc:270] Start()
0709 13:19:32.303596 (+   164us) write_op.cc:276] Timestamp: P: 1783603172303354 usec, L: 0
0709 13:19:32.303619 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:19:32.304354 (+   735us) log.cc:844] Serialized 4430 byte log entry
0709 13:19:32.555034 (+250680us) op_driver.cc:464] REPLICATION: finished
0709 13:19:32.768403 (+213369us) write_op.cc:301] APPLY: starting
0709 13:19:32.809721 (+ 41318us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:32.892147 (+ 82426us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:32.946800 (+ 54653us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:33.194813 (+248013us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:33.195247 (+   434us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:19:33.195298 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:33.211400 (+ 16102us) log.cc:844] Serialized 83 byte log entry
0709 13:19:33.220656 (+  9256us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:33.235822 (+ 15166us) write_op.cc:454] Released schema lock
0709 13:19:33.263916 (+ 28094us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:33.292075 (+ 28159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:33.296588 (+  4513us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3641664,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":158300,"apply.run_cpu_time_us":6794,"apply.run_wall_time_us":531686,"num_ops":11,"prepare.queue_time_us":125986,"prepare.run_cpu_time_us":29840,"prepare.run_wall_time_us":209360,"raft.queue_time_us":72959,"raft.run_cpu_time_us":25707,"raft.run_wall_time_us":134619,"replication_time_us":251196,"thread_start_us":441336,"threads_started":4,"wal-append.queue_time_us":155780}]]}
I20260709 13:19:33.575340 17525 rpcz_store.cc:276] 0709 13:19:32.346599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.351367 (+  4768us) service_pool.cc:224] Handling call
0709 13:19:32.360281 (+  8914us) log.cc:844] Serialized 506 byte log entry
0709 13:19:32.619036 (+258755us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b4c0019f4c0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab3e32a20 00007f5ab3e43a29 00007f5ab3e4413f 00007f5ab3e082ab 00007f5ab3e35f3c 00007f5ab3e363fe 00007f5ab40c350b 00007f5ab5ac2381 00007f5ab5ac026b 00007f5ab5ac6d53 00007f5ab5ac6cd9
0709 13:19:32.621651 (+  2615us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b540040b620. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5adf142 00007f5ab5abfeaa 00007f5ab5ac6d53 00007f5ab5ac6cd9 00007f5ab5ac6c69 00007f5ab5ac6c31 00007f5ab5ac5dfd 000000000038f354 000000000038f199 00007f5ab2a79475
0709 13:19:32.625455 (+  3804us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b1800388f00. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a472a6 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5ae6b26 00007f5ab5ae049a 00007f5ab5adf714
0709 13:19:32.652542 (+ 27087us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b540040b620. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5ae6b26 00007f5ab5ae049a 00007f5ab5adf714 00007f5ab5abfeaa 00007f5ab5ac6d53 00007f5ab5ac6cd9 00007f5ab5ac6c69 00007f5ab5ac6c31 00007f5ab5ac5dfd 000000000038f354
0709 13:19:32.667168 (+ 14626us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b2c00015ec8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446ea0a 00007f5ab446e693 00007f5ab446e631 00007f5ab5ba2b52 00007f5ab5ba2cf5 00007f5ab5adf691 00007f5ab5abfeaa 00007f5ab5ac6d53 00007f5ab5ac6cd9 00007f5ab5ac6c69
0709 13:19:33.562066 (+894898us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81935,"raft.queue_time_us":77149,"raft.run_cpu_time_us":13843,"raft.run_wall_time_us":688973,"spinlock_wait_cycles":218880768}
I20260709 13:19:33.579380 17569 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.593022 17448 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:33.595736 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.596158 17449 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:33.599013 17445 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:33.600749 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:33.602635 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 46964us
I20260709 13:19:33.570104 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:33.579959 21200 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:33.602137 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:33.583880 21163 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.609539 17450 raft_consensus.cc:2410] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:19:33.610484 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:33.560815 21442 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.614198 21442 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:33.603057 21321 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:33.608438 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:33.614611 21491 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:33.614869 21321 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:33.615131 21491 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:33.615432 21321 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.615737 21491 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.623217 17568 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:33.624655 21563 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:33.625177 21563 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.625610 21563 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.633275 21520 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:33.607051 21200 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:33.625560 21299 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.607703 21466 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:33.576889 21562 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:19:33.639000 21347 raft_consensus.cc:3055] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:33.694595 21347 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:33.695448 21347 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.646293 21371 raft_consensus.cc:3055] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:33.697104 21371 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:33.647653 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 88209us
I20260709 13:19:33.652809 17523 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:33.699590 17495 leader_election.cc:336] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.568s (SENT)
I20260709 13:19:33.699746 17525 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:33.700002 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:33.657502 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:33.673024 17522 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:19:33.660495 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet f1c40484b7a540a9b32947573409178a: Aborted: Op aborted by new leader
I20260709 13:19:33.686354 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:33.686945 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:33.688668 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:33.688040 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:33.704304 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46919.3us
I20260709 13:19:33.686635 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:33.690574 17449 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:33.689917 17445 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:33.649325 21355 consensus_meta.cc:287] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.951s	user 0.011s	sys 0.001s
W20260709 13:19:33.658422 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 62765.6us
I20260709 13:19:33.642940 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:33.672385 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:33.648871 21512 consensus_meta.cc:287] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.681s	user 0.007s	sys 0.004s
I20260709 13:19:33.696486 21347 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.718976 17525 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:33.647501 21299 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:33.768440 18195 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
W20260709 13:19:33.753371 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.685428 21563 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.772401 20784 consensus_queue.cc:1059] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:33.773957 21563 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:33.774151 21571 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:19:33.774662 21563 raft_consensus.cc:3055] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:33.757129 21519 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:33.775007 21563 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:33.757709 21532 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:33.757836 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.777415 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:33.777765 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.661185 21537 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.778348 21532 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:33.778623 21537 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.779199 21532 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:33.760708 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:33.780674 21537 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:33.780861 17523 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.655494 21334 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.773972 17522 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:33.640272 21462 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:33.685190 21163 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.769594 21512 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.770370 21564 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:19:33.791917 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.792681 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:33.771189 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 98884.8us
I20260709 13:19:33.771303 21573 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:19:33.638561 21200 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.782845 17525 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.637959 21468 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.667173 21533 raft_consensus.cc:3055] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:33.750731 17350 catalog_manager.cc:5697] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 3 to 4, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 4 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:33.788301 17569 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.707818 21466 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:19:33.709920 21495 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:19:33.708213 21442 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:33.687705 21321 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:33.814386 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 71988.3us
I20260709 13:19:33.685822 21491 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.710593 21520 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:33.820338 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:33.809998 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 206185us
I20260709 13:19:33.749529 21355 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:33.832192 17569 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.830006 17450 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.875065 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:33.879055 17523 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:33.789816 21373 consensus_queue.cc:1059] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:19:33.816907 21533 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:33.886713 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:33.888643 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 72863.3us
W20260709 13:19:33.889501 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 69097.1us
I20260709 13:19:33.890822 18195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42536 (request call id 268) took 1069 ms. Trace:
W20260709 13:19:33.891849 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 68e8e6dd889d4bcfabf84cedd079e2f2: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:33.901686 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:33.823918 21519 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:33.909502 17525 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:33.871584 21381 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.917243 21381 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:33.914683 17454 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:33.823467 20784 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:19:33.919239 17523 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:33.911137 17350 catalog_manager.cc:5697] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 2 to 5, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 5 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:33.921480 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:33.924938 17527 raft_consensus.cc:2368] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11.
I20260709 13:19:33.817018 21571 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:19:33.886432 21216 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:33.891505 21468 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:33.888271 21334 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:33.818423 21563 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:33.963100 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.961112 17350 catalog_manager.cc:5697] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 4 to 5, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 5 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:33.967684 21216 raft_consensus.cc:697] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:33.968338 17350 catalog_manager.cc:5697] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 1 to 4, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 4 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:33.968902 21216 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:33.969745 21163 consensus_queue.cc:1059] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:33.970407 21495 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.970773 21163 raft_consensus.cc:3055] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:33.971307 21163 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:33.971692 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 139609us
I20260709 13:19:33.972527 17569 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:33.977404 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.979843 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.949941 21177 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.958493 21537 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:33.896922 17568 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:33.817459 21371 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:33.900714 18195 rpcz_store.cc:276] 0709 13:19:32.821384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.830148 (+  8764us) service_pool.cc:224] Handling call
0709 13:19:33.885494 (+1055346us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54003b24d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:33.890730 (+  5236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020889984}
I20260709 13:19:33.993988 17569 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:33.994444 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.961284 21569 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.994922 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:33.971217 21520 raft_consensus.cc:697] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:34.000653 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 103819us
I20260709 13:19:34.001055 20784 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:34.001886 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:34.008435 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 134383us
I20260709 13:19:34.014839 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:33.978622 21442 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.977974 21165 raft_consensus.cc:3055] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:34.021644 17495 leader_election.cc:336] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.571s (SENT)
I20260709 13:19:33.986717 21373 consensus_queue.cc:1243] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:34.028075 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:33.985894 21339 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:34.032383 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:34.026973 17420 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:33.998688 21299 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.977149 21481 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:19:34.033651 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.040366 17597 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:33.986085 21519 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:33.995873 21537 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:34.006464 21564 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:33.994824 21532 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:19:34.018373 21157 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:34.022603 21371 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.028683 21165 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:34.037611 21469 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.063570 21520 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.064117 21469 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.064570 17350 catalog_manager.cc:5697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 5 to 7, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 7 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:34.066481 21469 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:34.066828 21381 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:34.019142 21572 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:19:34.072809 21580 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:19:34.003171 21177 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.074440 21532 consensus_queue.cc:1243] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:34.057451 21373 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:33.972527 21163 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.078783 21491 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:34.079149 21163 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.079413 21406 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:34.079869 21406 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.080255 21406 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.081147 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.082113 17445 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:34.076154 21177 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:34.086273 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 72066.4us
I20260709 13:19:34.086419 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:34.040823 21563 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.094561 17420 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:34.094856 17495 leader_election.cc:336] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.685s (SENT)
I20260709 13:19:34.059576 21537 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.115774 17420 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:34.117555 17450 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:34.125174 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:34.030455 21442 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:34.040757 17600 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:34.112020 21276 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:34.134706 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.146616 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.143642 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:34.118572 21177 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:34.130231 21469 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:34.122105 21157 raft_consensus.cc:697] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:34.180285 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:34.183825 18192 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:34.146128 21276 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:34.187635 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 229185us
I20260709 13:19:34.165160 21334 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:34.168103 21465 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:34.177441 21468 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:34.196007 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 194176us
I20260709 13:19:34.187314 21177 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.200189 17419 leader_election.cc:400] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11.
I20260709 13:19:34.247507 17419 leader_election.cc:403] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:34.244831 17569 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:34.240477 20784 raft_consensus.cc:697] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:34.193946 21276 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:34.255014 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 59003us
W20260709 13:19:34.265491 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.268069 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:34.268932 17529 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:34.270430 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:34.252785 21578 log.cc:927] Time spent T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.434s	user 0.006s	sys 0.004s
I20260709 13:19:34.249806 21334 raft_consensus.cc:697] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:34.277390 20784 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.273993 21331 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:34.268308 21564 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.295006 21331 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.251307 21571 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:19:34.279366 18199 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:34.267906 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:19:34.299477 21582 log.cc:927] Time spent T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:19:34.300343 21584 log.cc:927] Time spent T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:34.287566 21468 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11.
I20260709 13:19:34.302228 21157 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.302992 21165 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.303388 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:34.349205 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.349710 17529 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:34.336269 21563 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.311600 21321 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:34.314124 21590 log.cc:927] Time spent T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:34.319783 21465 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.323453 21373 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.261598 21177 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:34.325166 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet f16762b5a82d4310ad01b31fd99d5921: Illegal state: Replica ddfe9cca0741489b994f8b0178c54fe7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:34.321765 18198 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 6.
W20260709 13:19:34.332669 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.371654 17450 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:34.330582 17568 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:34.346704 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.311137 21200 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.345160 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:34.337852 21532 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.256659 21519 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.340106 21569 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.367120 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.395519 21200 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:34.396097 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:34.338426 21406 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.396253 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.545295 17446 raft_consensus.cc:2393] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 12: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:34.510908 21596 log.cc:927] Time spent T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 13:19:34.421409 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.512321 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.441016 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.511875 17601 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:34.449574 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.450445 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.549768 17452 raft_consensus.cc:2368] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11.
I20260709 13:19:34.550835 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.466881 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:34.454537 21334 consensus_queue.cc:237] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:34.554440 21406 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:34.441876 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.442297 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:34.515988 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.441447 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.556011 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:34.449368 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.561632 17600 raft_consensus.cc:2393] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:34.457666 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2140) took 1180 ms. Trace:
I20260709 13:19:34.440994 17450 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:34.564311 17453 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:34.566133 17448 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:34.566036 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.458156 21592 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.562500 17454 rpcz_store.cc:276] 0709 13:19:33.276975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.277144 (+   169us) service_pool.cc:224] Handling call
0709 13:19:33.280075 (+  2931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.922335 (+642260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.457404 (+535069us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b5400193554. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:34.457577 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1458808192}
W20260709 13:19:34.419888 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 272468us
I20260709 13:19:34.572259 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.573292 17521 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:34.361436 21491 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.580528 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.581900 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.580019 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:34.582865 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.583058 17601 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.583595 17445 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:34.584067 17450 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:34.590148 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.591584 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:34.440408 21321 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:34.477002 21468 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:34.457868 21331 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:34.443811 21595 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:34.601123 17454 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:19:34.476655 21466 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.596462 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.444480 21442 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:34.620420 17446 raft_consensus.cc:2376] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9. Re-sending same reply.
I20260709 13:19:34.608758 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.543188 21177 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:34.581327 21163 consensus_meta.cc:287] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.007s
I20260709 13:19:34.612536 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.602736 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.615407 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:34.593313 21299 consensus_meta.cc:287] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 13:19:34.616811 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.363315 21563 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.372370 21465 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.633388 17449 raft_consensus.cc:2368] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10.
I20260709 13:19:34.596172 21200 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.469215 21537 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.397226 21373 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.632839 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.674278 17454 raft_consensus.cc:2393] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:34.600054 21491 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.637264 17448 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.628679 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:34.644404 17598 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:34.568464 21532 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.581858 21592 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.690837 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.697075 17450 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:34.663600 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.619441 21321 raft_consensus.cc:697] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:34.676421 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.678354 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.679343 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.701035 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.701557 17453 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:34.701682 17449 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:34.640501 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:34.649464 21299 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:34.697719 17599 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:34.706265 17603 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
W20260709 13:19:34.698163 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 300208us
I20260709 13:19:34.697810 17601 raft_consensus.cc:2410] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:34.699725 17454 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:34.669329 21371 consensus_meta.cc:287] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.002s
I20260709 13:19:34.694555 17600 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
W20260709 13:19:34.680068 21583 log.cc:927] Time spent T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.583s	user 0.006s	sys 0.000s
I20260709 13:19:34.619583 21468 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.703929 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.705137 17527 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:34.708303 21599 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:34.708740 21157 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:34.709359 21592 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:34.709771 18195 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:34.712224 17445 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:34.629302 21466 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.707515 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:34.731734 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.739562 21442 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:34.739496 21533 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.740166 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.740658 21533 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:34.625442 21595 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:34.721944 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:34.742704 21355 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:34.742918 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:34.743232 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1874) took 1071 ms. Trace:
I20260709 13:19:34.743366 21595 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:34.743973 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:34.744625 17521 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:34.745440 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:34.743748 17526 rpcz_store.cc:276] 0709 13:19:33.671664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.680619 (+  8955us) service_pool.cc:224] Handling call
0709 13:19:33.680924 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.681275 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:33.681301 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.681795 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.984728 (+302933us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:33.984790 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.984891 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:34.679301 (+694410us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:34.742940 (+ 63639us) raft_consensus.cc:1685] finished
0709 13:19:34.742964 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.743167 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6002,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":3728128,"thread_start_us":302527,"threads_started":1,"wal-append.queue_time_us":414473}
I20260709 13:19:34.747735 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:34.748487 17526 raft_consensus.cc:2393] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:34.749442 17526 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:34.720640 17528 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:34.725093 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.751863 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:34.752354 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.752985 21563 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:34.729316 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:34.754667 21607 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:34.755028 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:34.756182 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:34.757247 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.758651 17419 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:34.740073 21442 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.760488 17419 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:34.747757 21537 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:34.763669 21537 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.763875 21466 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:34.764190 21537 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.766207 21537 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:34.767269 21532 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:34.768414 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:34.768999 17603 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.769408 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:34.674401 21200 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.772524 17446 raft_consensus.cc:2410] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:34.723611 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:34.779277 17448 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:34.732445 17453 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: [8.5-12.8]
I20260709 13:19:34.774430 18198 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:34.780164 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.760583 21442 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:34.752455 17450 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:34.785091 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.775672 17597 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:34.771270 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:34.786044 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.780747 17448 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.787241 17603 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:34.783614 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.783576 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:34.805437 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.797955 17448 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:34.773485 17594 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:34.813509 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.814268 17454 raft_consensus.cc:2393] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 12: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:34.814356 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:34.815002 17521 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:34.815155 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.815863 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:34.816385 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 44355.5us
I20260709 13:19:34.811980 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:34.821135 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.821722 17450 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:34.823647 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:34.824265 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.826920 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:34.830783 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.830823 17447 raft_consensus.cc:2393] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 6: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:34.831581 17601 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:34.832734 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:34.833431 17601 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:34.826879 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.845355 17450 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:34.839320 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.846246 17601 raft_consensus.cc:1240] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:34.839812 17599 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:34.783215 21537 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:34.849762 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.850404 17450 raft_consensus.cc:2376] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9. Re-sending same reply.
I20260709 13:19:34.842850 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:34.825762 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.847922 17601 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:34.845114 17454 raft_consensus.cc:2376] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11. Re-sending same reply.
I20260709 13:19:34.854840 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.855659 17448 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:34.857692 17594 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:34.859241 17598 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:34.861123 17568 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:34.828397 21466 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:34.888216 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.888770 18198 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:34.869611 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:34.710630 21321 consensus_queue.cc:237] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.835011 21438 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:34.874584 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.737066 21157 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.888972 17454 raft_consensus.cc:2376] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12. Re-sending same reply.
I20260709 13:19:34.728825 21599 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:34.825418 21565 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:19:34.834473 21569 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:19:34.919730 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:34.967236 17450 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
W20260709 13:19:34.936344 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 75280us
W20260709 13:19:34.942482 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.935411 18192 consensus_meta.cc:287] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.000s
I20260709 13:19:34.968339 18192 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:34.969184 17601 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:34.928665 17597 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:34.853324 21537 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.969970 21537 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:34.947443 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.971812 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.973735 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.975437 17603 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:34.977934 17452 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
W20260709 13:19:34.938421 21611 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:19:34.887524 21466 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.855301 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:34.988865 17599 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:34.983273 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.891999 21595 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.997941 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:35.000102 17452 raft_consensus.cc:2376] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11. Re-sending same reply.
I20260709 13:19:35.004185 17594 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:35.005903 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:34.927855 21532 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:34.936563 21592 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:34.936057 21593 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.003700 17568 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:34.983415 21371 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:35.025342 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 43660us
I20260709 13:19:34.995678 21466 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.025610 17452 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:34.887035 21481 consensus_queue.cc:1059] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:19:35.035851 17448 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:34.994890 21299 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.038869 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:35.044035 17448 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:35.044443 17452 raft_consensus.cc:1240] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:35.039729 17594 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:35.025329 21592 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.057834 17599 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:35.002408 21492 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:19:35.051771 18195 raft_consensus.cc:2393] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:35.091185 17446 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:35.094900 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:35.025597 21595 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:35.051054 21465 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:35.058341 21532 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:35.077521 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:35.061509 21592 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:35.101284 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.082482 21468 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:35.114332 17452 raft_consensus.cc:2393] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 8: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:35.064221 21491 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:35.057878 21299 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:35.030865 21520 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:19:35.110323 17446 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:19:35.107570 21347 consensus_meta.cc:287] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.318s	user 0.007s	sys 0.007s
W20260709 13:19:35.115383 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.127926 21200 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:35.124763 20784 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:19:35.129618 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:35.137265 17452 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:35.138543 17448 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:35.103447 21532 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:35.140687 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 137081us
I20260709 13:19:35.090289 21565 consensus_queue.cc:1059] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:19:35.146680 17446 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:19:35.171285 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.179555 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:35.180706 17527 raft_consensus.cc:2410] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:35.142236 21216 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.135917 21546 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:35.198693 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 160176us
I20260709 13:19:35.147395 21532 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:35.200814 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 227581us
W20260709 13:19:35.212945 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.033757 21593 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:35.200150 21481 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.221151 21481 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:35.222162 21617 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
W20260709 13:19:35.223517 21276 consensus_meta.cc:287] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.948s	user 0.011s	sys 0.000s
I20260709 13:19:35.223194 21481 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:35.172015 21438 raft_consensus.cc:697] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:35.252277 21613 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:19:35.244798 21157 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:35.226835 21216 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:35.630811 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.635558 21564 consensus_meta.cc:287] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.298s	user 0.011s	sys 0.002s
I20260709 13:19:35.253852 21157 consensus_queue.cc:1059] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.382s
I20260709 13:19:35.636385 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:35.284111 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:35.286329 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.498915 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.637701 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.638746 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:35.255226 21565 consensus_queue.cc:1059] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.384s
I20260709 13:19:35.254874 21465 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.385s
W20260709 13:19:35.557899 21533 consensus_meta.cc:287] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.817s	user 0.010s	sys 0.003s
W20260709 13:19:35.317335 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 174795us
I20260709 13:19:35.641335 17596 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:35.245585 21276 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:35.642364 20784 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.643178 21506 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.643563 21276 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:35.643113 20784 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:35.285683 21347 raft_consensus.cc:3055] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:35.643829 21506 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:35.644423 21347 raft_consensus.cc:740] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:35.645285 21347 consensus_queue.cc:260] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:35.645936 21506 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:35.637475 17453 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:35.254241 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:35.653525 17419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.002s	sys 0.011s
W20260709 13:19:35.674606 17419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.005s	sys 0.011s
I20260709 13:19:35.674515 17527 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
W20260709 13:19:35.641260 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 493964us
I20260709 13:19:35.387514 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:35.677443 17445 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
W20260709 13:19:35.679724 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.662497 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:35.688416 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.456843 21620 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
W20260709 13:19:35.623715 21618 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.488s	user 0.001s	sys 0.000s
I20260709 13:19:35.691344 17452 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:35.636014 21564 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:35.646942 21593 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:35.701713 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.457801 21614 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
I20260709 13:19:35.224439 21546 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:35.240679 21625 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:35.669013 17495 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.752s (SENT) [suppressed 22 similar messages]
I20260709 13:19:35.708786 21481 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:19:35.705104 17420 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:35.631745 21442 consensus_meta.cc:287] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.812s	user 0.010s	sys 0.000s
I20260709 13:19:35.719460 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:35.646550 21347 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:35.694787 21465 raft_consensus.cc:3055] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:35.617781 21438 consensus_queue.cc:237] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:35.702984 21468 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.726655 21625 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:35.697759 21623 raft_consensus.cc:3055] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:35.719362 21334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.016s	sys 0.053s
W20260709 13:19:35.737895 17525 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.001s	sys 0.026s
W20260709 13:19:35.720909 21537 consensus_meta.cc:287] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.750s	user 0.006s	sys 0.005s
W20260709 13:19:35.794051 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.254504 21622 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.477s
I20260709 13:19:35.816517 17445 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:35.715255 21628 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:35.740139 17420 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:35.736286 21165 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:35.851014 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 110979us
W20260709 13:19:35.829469 21631 log.cc:927] Time spent T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:19:35.856833 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2335) took 1138 ms. Trace:
I20260709 13:19:35.828629 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 409) took 1010 ms. Trace:
W20260709 13:19:35.865888 21532 consensus_meta.cc:287] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.000s
I20260709 13:19:35.790452 21593 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:35.856647 21468 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:35.844175 21623 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:35.870824 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1891) took 1301 ms. Trace:
I20260709 13:19:35.905303 17523 rpcz_store.cc:276] 0709 13:19:34.569715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.570690 (+   975us) service_pool.cc:224] Handling call
0709 13:19:34.571072 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.588460 (+ 17388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.588499 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.615599 (+ 27100us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.839057 (+223458us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:34.839099 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.839177 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.870528 (+1031351us) raft_consensus.cc:1685] finished
0709 13:19:35.870553 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.870744 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2894,"raft.queue_time_us":17487,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":12333,"thread_start_us":164796,"threads_started":1,"wal-append.queue_time_us":406875}
I20260709 13:19:35.871577 17528 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:35.830617 21406 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:35.890295 17420 connection.cc:256] RPC call timeout handler was delayed by -1.5828864110001177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2941s for a response
I20260709 13:19:35.815287 21465 raft_consensus.cc:740] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:35.880155 21625 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:35.818228 21632 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.933892 21632 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:35.935227 21546 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:35.935766 21355 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:35.936933 21632 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:35.852141 21334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.016s	sys 0.053s
I20260709 13:19:35.936699 21465 consensus_queue.cc:260] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:35.939020 21627 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:19:35.939138 21465 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.856135 21537 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:35.899346 17454 rpcz_store.cc:276] 0709 13:19:34.818393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.639959 (+821566us) service_pool.cc:224] Handling call
0709 13:19:35.640397 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.640581 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:35.679750 (+ 39169us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.828131 (+148381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:35.828205 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:35.828267 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.828358 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.828545 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31778,"prepare.queue_time_us":39842,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":36771,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":147781,"threads_started":2,"wal-append.queue_time_us":192097}
I20260709 13:19:35.942193 21537 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:35.944149 21592 consensus_meta.cc:287] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.837s	user 0.008s	sys 0.002s
I20260709 13:19:35.944732 21592 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:35.881981 21628 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:35.946928 21625 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:35.947722 21625 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:19:35.947819 21623 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:35.949587 21623 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:35.891356 17529 rpcz_store.cc:276] 0709 13:19:34.718112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.722510 (+  4398us) service_pool.cc:224] Handling call
0709 13:19:34.779501 (+ 56991us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.782326 (+  2825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.782355 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.782785 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.988620 (+205835us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:34.988663 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.988732 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.856612 (+867880us) raft_consensus.cc:1685] finished
0709 13:19:35.856635 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.856772 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29040,"raft.queue_time_us":3317,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":12173,"thread_start_us":205528,"threads_started":1,"wal-append.queue_time_us":314580}
I20260709 13:19:35.967087 17526 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:35.920799 21532 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:35.984284 21625 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:35.985595 21532 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:35.986227 21519 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:36.019599 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.818746 21442 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.025228 21355 raft_consensus.cc:697] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:35.928511 21593 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:36.028944 21355 consensus_queue.cc:237] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.030611 21593 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:36.025480 21519 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.033341 21519 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:36.033241 21406 raft_consensus.cc:697] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:36.035501 21468 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.034889 21406 consensus_queue.cc:237] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:36.054471 17521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.013s	sys 0.017s
W20260709 13:19:36.054996 17521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.013s	sys 0.017s
I20260709 13:19:35.969126 21537 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:36.062522 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 393705us
W20260709 13:19:36.064251 17448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.019s	sys 0.017s
W20260709 13:19:36.064715 17448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.019s	sys 0.017s
I20260709 13:19:36.067070 21537 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.072388 21537 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:36.077466 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.077507 21622 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:36.078688 21622 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:36.080431 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.081216 21537 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:36.081894 21537 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.084604 21537 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.087289 21537 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:36.088060 21537 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.091183 21537 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.091730 21622 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.092284 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.093977 21622 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.097035 17598 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:36.099052 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:36.069808 21532 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.106104 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:36.113348 17420 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.113018 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.119254 17452 raft_consensus.cc:2393] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:36.121421 17420 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.123380 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.107157 21481 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.124575 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:36.124560 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:36.127934 17452 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:36.127231 17420 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.135149 21371 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.136031 21371 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.138368 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1895) took 1302 ms. Trace:
I20260709 13:19:36.139290 21599 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.113838 21334 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:36.140714 21334 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.141673 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.142386 17446 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:36.143164 21334 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.143366 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.135340 21592 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:36.144706 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.145429 21654 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:36.145524 17446 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:36.146744 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.138752 17521 rpcz_store.cc:276] 0709 13:19:34.836228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.836384 (+   156us) service_pool.cc:224] Handling call
0709 13:19:34.836684 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.963271 (+126587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.963303 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.974088 (+ 10785us) log.cc:844] Serialized 26 byte log entry
0709 13:19:35.288591 (+314503us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b18003b2600. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab57060d1 00007f5ab5b21a0f
0709 13:19:36.055490 (+766899us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:36.055552 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.055656 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.138058 (+ 82402us) raft_consensus.cc:1685] finished
0709 13:19:36.138078 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.138301 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52995,"raft.queue_time_us":182496,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5977,"spinlock_wait_cycles":5687168,"thread_start_us":766630,"threads_started":1,"wal-append.queue_time_us":1127154}
W20260709 13:19:36.147418 21639 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.275s	user 0.011s	sys 0.000s
I20260709 13:19:36.147388 17446 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
W20260709 13:19:36.151006 21466 consensus_meta.cc:287] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 1.096s	user 0.010s	sys 0.002s
I20260709 13:19:36.125413 21468 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:19:36.151795 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.151620 21466 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.152347 17446 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:36.122591 21648 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:36.153211 21595 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.135145 21442 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.156728 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.145608 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.159180 17453 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:36.162575 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2161) took 1386 ms. Trace:
I20260709 13:19:36.153203 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.167400 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.169504 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:36.165028 17448 rpcz_store.cc:276] 0709 13:19:34.776350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.147565 (+371215us) service_pool.cc:224] Handling call
0709 13:19:35.147877 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:35.148238 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.148280 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:35.154847 (+  6567us) log.cc:844] Serialized 26 byte log entry
0709 13:19:36.065327 (+910480us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:36.065383 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.065479 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.162299 (+ 96820us) raft_consensus.cc:1685] finished
0709 13:19:36.162325 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.162485 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":19288,"thread_start_us":815824,"threads_started":1,"wal-append.queue_time_us":917489}
I20260709 13:19:36.170498 17446 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 11: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:36.171660 17601 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:36.172859 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.175689 17420 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:36.175954 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 51454.2us
I20260709 13:19:36.176923 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.112545 21532 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.129770 21177 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:36.181136 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.179670 21628 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:36.178010 21636 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:36.129770 21481 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.235656 21481 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.169085 21466 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.174952 21599 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.223714 21157 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.179602 21648 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:36.242173 17602 raft_consensus.cc:2410] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:36.180472 21595 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:19:36.243840 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.243155 21595 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.192844 21468 raft_consensus.cc:2764] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:19:36.224828 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 48013.5us
I20260709 13:19:36.253428 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:36.224223 21442 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.254676 21442 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.255710 21537 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.256067 21532 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:36.255762 21616 log.cc:927] Time spent T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.140s	user 0.000s	sys 0.017s
I20260709 13:19:36.164295 21438 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:36.257184 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
W20260709 13:19:36.257587 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 76581.8us
I20260709 13:19:36.269621 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.260211 21468 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:36.260409 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.257660 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2352) took 1110 ms. Trace:
I20260709 13:19:36.272331 17420 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.271150 17527 rpcz_store.cc:276] 0709 13:19:35.147193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.689263 (+542070us) service_pool.cc:224] Handling call
0709 13:19:35.716636 (+ 27373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.716871 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:36.064133 (+347262us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.257276 (+193143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:36.257335 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:36.257385 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.257454 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.257584 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":156438,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":98,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":411532,"threads_started":2,"wal-append.queue_time_us":153796}
I20260709 13:19:36.275787 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.276738 17453 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
I20260709 13:19:36.286494 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:36.288676 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.295755 21648 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:36.295883 21371 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.286513 21177 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.296943 21177 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.301384 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.285883 21636 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.304184 21371 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.304524 21438 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:36.305356 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 504) took 1584 ms. Trace:
I20260709 13:19:36.305516 21177 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.294198 21537 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:36.308786 17596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1645) took 1955 ms (client timeout 2186 ms). Trace:
I20260709 13:19:36.309468 21573 raft_consensus.cc:3055] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:36.297765 21347 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:36.312255 17597 rpcz_store.cc:276] 0709 13:19:34.721255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.970443 (+249188us) service_pool.cc:224] Handling call
0709 13:19:34.970783 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.040476 (+ 69693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.040525 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:35.040731 (+   206us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:35.040804 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.305111 (+1264307us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b54003eb554. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:36.305163 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.305292 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159664000}
I20260709 13:19:36.299849 21648 raft_consensus.cc:697] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:36.294330 21595 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:36.316502 17596 rpcz_store.cc:269] 0709 13:19:34.353600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.353831 (+   231us) service_pool.cc:224] Handling call
0709 13:19:36.308547 (+1954716us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001e46d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:36.308690 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2510533376}
I20260709 13:19:36.324357 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:36.329248 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 159601us
W20260709 13:19:36.342739 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 70515.1us
I20260709 13:19:36.343317 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.321396 21573 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:36.334875 21599 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:36.346464 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.333804 21438 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:36.339900 21334 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:36.352200 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:36.351343 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.340309 21347 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:36.345932 21595 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:36.314661 21636 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.349660 21565 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:36.352514 21442 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.353008 21468 raft_consensus.cc:697] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:36.360447 21442 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:36.361002 21468 consensus_queue.cc:237] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.355818 21595 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:36.365003 21595 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:36.347643 21466 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:19:36.356438 21371 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:19:36.354512 21406 raft_consensus.cc:2764] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:36.374804 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.355129 21465 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:36.375483 17453 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:36.358531 21512 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:36.388614 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.377671 21663 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 13:19:36.381186 21658 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:19:36.381136 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.356164 21347 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.381173 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.395723 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.397238 17454 raft_consensus.cc:2393] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 12: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:36.366977 21648 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.403762 21438 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.406777 21299 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.348461 21355 consensus_queue.cc:1059] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:19:36.389194 21512 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.410625 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.414314 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1767) took 1646 ms. Trace:
I20260709 13:19:36.418113 21512 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.418519 20784 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:36.419250 17595 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
W20260709 13:19:36.421571 17595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1650) took 1910 ms (client timeout 2101 ms). Trace:
I20260709 13:19:36.421825 17603 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:36.423702 18192 raft_consensus.cc:1240] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:36.430902 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 49083us
I20260709 13:19:36.424453 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1668) took 1702 ms. Trace:
I20260709 13:19:36.414759 17450 rpcz_store.cc:276] 0709 13:19:34.768075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.410321 (+1642246us) service_pool.cc:224] Handling call
0709 13:19:36.414239 (+  3918us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:36.421988 17595 rpcz_store.cc:269] 0709 13:19:34.511110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.512013 (+   903us) service_pool.cc:224] Handling call
0709 13:19:36.421383 (+1909370us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54003eba54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:36.421511 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4304942464}
I20260709 13:19:36.432346 17603 rpcz_store.cc:276] 0709 13:19:34.722487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.977635 (+255148us) service_pool.cc:224] Handling call
0709 13:19:36.421512 (+1443877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.422238 (+   726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.424204 (+  1966us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54003eba50. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:36.424372 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3214189952}
W20260709 13:19:36.434691 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 76534us
I20260709 13:19:36.436689 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:36.423034 21615 log.cc:927] Time spent T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.313s	user 0.000s	sys 0.019s
I20260709 13:19:36.441349 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.444165 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:36.438050 21465 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.448814 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.443648 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:36.453666 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1738) took 1990 ms. Trace:
I20260709 13:19:36.454118 17451 rpcz_store.cc:276] 0709 13:19:34.463260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.586758 (+123498us) service_pool.cc:224] Handling call
0709 13:19:34.594941 (+  8183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.609837 (+ 14896us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:34.609872 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.620162 (+ 10290us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.995560 (+375398us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:34.995596 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.995654 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.422428 (+1426774us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:36.453339 (+ 30911us) raft_consensus.cc:1685] finished
0709 13:19:36.453368 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.453599 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5004,"raft.queue_time_us":5121,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":7264,"spinlock_wait_cycles":4085504,"thread_start_us":327223,"threads_started":1,"wal-append.queue_time_us":395402}
I20260709 13:19:36.456202 21537 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:36.456933 21537 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.458405 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.458787 21157 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:36.441598 21565 consensus_queue.cc:1059] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:19:36.459139 17527 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:36.459293 21465 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:36.462203 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.457414 21537 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.451357 21438 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.464031 21622 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:36.467244 21565 raft_consensus.cc:3055] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:36.471907 21565 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:36.472730 21565 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.466459 21465 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.467857 21157 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:36.475564 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:36.475983 21565 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.467689 21466 consensus_queue.cc:1059] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:19:36.482883 21157 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:36.502094 18200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4"
dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:35632
I20260709 13:19:36.502635 21157 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.503088 18200 raft_consensus.cc:606] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.503244 21666 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:36.503641 21657 log.cc:927] Time spent T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.132s	user 0.003s	sys 0.000s
I20260709 13:19:36.505162 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2333) took 1787 ms. Trace:
I20260709 13:19:36.505560 17524 rpcz_store.cc:276] 0709 13:19:34.717419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.721344 (+  3925us) service_pool.cc:224] Handling call
0709 13:19:34.731096 (+  9752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.994606 (+263510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.994636 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:34.994680 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:34.994722 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.504887 (+1510165us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54001dea54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:36.504947 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.505104 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605509504}
I20260709 13:19:36.510186 21595 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.512108 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2344) took 1699 ms. Trace:
I20260709 13:19:36.512641 21595 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.518566 21465 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.519515 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2342) took 1791 ms. Trace:
I20260709 13:19:36.519865 17528 rpcz_store.cc:276] 0709 13:19:34.728504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.750639 (+ 22135us) service_pool.cc:224] Handling call
0709 13:19:35.871354 (+1120715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.919805 (+ 48451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.519332 (+599527us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400413a50. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:36.519456 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2576693504}
I20260709 13:19:36.512486 17526 rpcz_store.cc:276] 0709 13:19:34.812591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.826227 (+ 13636us) service_pool.cc:224] Handling call
0709 13:19:34.826493 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.967781 (+1141288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.511886 (+544105us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400020dd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:36.512049 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589473536}
I20260709 13:19:36.520783 21157 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.526816 17524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bea493621f1e42c2b8689859233cc798"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:19:36.527575 21157 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:36.531774 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.523552 21334 raft_consensus.cc:3055] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:36.533171 21334 raft_consensus.cc:740] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:36.534170 21519 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:36.534260 21334 consensus_queue.cc:260] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.534803 21519 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.535316 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.536604 21537 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.536834 21519 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.537492 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:36.539218 17602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1644) took 2190 ms (client timeout 1648 ms). Trace:
W20260709 13:19:36.554039 17602 rpcz_store.cc:269] 0709 13:19:34.348691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.348887 (+   196us) service_pool.cc:224] Handling call
0709 13:19:36.538970 (+2190083us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b5400075dd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:36.539121 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4350915968}
I20260709 13:19:36.539980 17450 raft_consensus.cc:3055] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:36.540650 21373 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:36.541410 17599 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:19:36.555157 17450 raft_consensus.cc:740] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:36.555617 17599 pending_rounds.cc:85] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 7
I20260709 13:19:36.556046 17599 pending_rounds.cc:107] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:19:36.556332 17599 raft_consensus.cc:2889] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:36.483363 21512 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.542733 17451 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:36.536845 17447 raft_consensus.cc:2368] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11.
I20260709 13:19:36.543612 17445 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:36.546416 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.547149 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:36.558619 17453 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.548281 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:36.561401 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:36.565831 20784 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:36.566303 20784 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.556198 17450 consensus_queue.cc:260] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.568621 17450 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:36.569432 17447 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55882 (request call id 1766) took 1801 ms (client timeout 2085 ms). Trace:
I20260709 13:19:36.555155 21624 raft_consensus.cc:3055] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:36.570044 17447 rpcz_store.cc:269] 0709 13:19:34.767793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.534876 (+1767083us) service_pool.cc:224] Handling call
0709 13:19:36.569359 (+ 34483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:36.573020 20784 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:36.574314 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.575879 17524 raft_consensus.cc:606] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.535646 21334 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.578652 18192 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:36.567822 21468 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:19:36.580865 17569 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.575760 21572 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:36.582506 21572 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:36.584007 21561 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:36.583595 21572 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.584673 21561 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.586411 18195 raft_consensus.cc:2393] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:36.586261 21573 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.588522 21573 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.589519 21648 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:36.568193 21564 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:36.565614 21299 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.575719 21466 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:36.590006 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.594239 17445 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:36.595083 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:36.595631 17445 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.598338 21648 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:36.591879 21299 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.598878 21648 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.600828 21299 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:36.591574 21564 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.592314 21466 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.603119 21564 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.603510 21466 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.604245 21373 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.605466 21216 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:36.606274 21649 log.cc:927] Time spent T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.734s	user 0.006s	sys 0.005s
I20260709 13:19:36.597805 21512 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.585006 21572 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.571004 21624 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:36.610826 21624 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.612047 21624 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.614431 21479 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:36.615186 21479 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.618626 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1667) took 1915 ms. Trace:
I20260709 13:19:36.619943 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.621078 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.624500 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.625145 17451 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:36.627750 17454 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:36.600847 21648 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.630347 21331 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:36.630919 21331 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.633031 21564 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:36.642625 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.643766 17522 raft_consensus.cc:2410] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:19:36.643678 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.644718 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:36.645961 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:36.646498 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.647125 17520 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:36.647898 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.652570 17525 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:36.653733 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.655155 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.654826 21355 raft_consensus.cc:2955] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 2 to 8, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:36.644790 17523 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:36.658615 21347 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:36.659297 21661 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.659250 21347 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.659965 21661 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.663457 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1672) took 1853 ms. Trace:
I20260709 13:19:36.663865 17599 rpcz_store.cc:276] 0709 13:19:34.810250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.059669 (+249419us) service_pool.cc:224] Handling call
0709 13:19:36.541056 (+1481387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.556918 (+ 15862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.663249 (+106331us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400075dd0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:36.663383 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3326539008}
I20260709 13:19:36.592442 21636 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.671272 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:36.671455 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:36.671852 18199 raft_consensus.cc:2955] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 2 to 8, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:36.673548 21347 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.619182 17601 rpcz_store.cc:276] 0709 13:19:34.702808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.969961 (+267153us) service_pool.cc:224] Handling call
0709 13:19:34.970246 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.175442 (+1205196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.618176 (+442734us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400315454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:36.618541 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2762530048}
W20260709 13:19:36.675189 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.676591 21479 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.677817 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:36.642706 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 61960.1us
I20260709 13:19:36.680943 17520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:19:36.587275 21561 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:36.683826 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.684448 17526 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:36.690596 17526 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:19:36.692561 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.698377 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:36.699667 17451 raft_consensus.cc:2410] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:36.700984 20784 consensus_queue.cc:1059] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:36.702133 20784 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:36.702999 20784 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.704216 17569 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.695216 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.716305 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.713564 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1743) took 2248 ms. Trace:
I20260709 13:19:36.723539 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.703123 21200 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:19:36.753062 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 48911.5us
I20260709 13:19:36.754072 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.755177 20784 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:36.756106 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.714221 21532 raft_consensus.cc:3055] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:36.714326 21654 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:36.765378 20784 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.758776 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.760257 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.716997 17449 rpcz_store.cc:276] 0709 13:19:34.464714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.707908 (+243194us) service_pool.cc:224] Handling call
0709 13:19:34.708297 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.708700 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:34.992430 (+283730us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.206685 (+214255us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.206916 (+   231us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:36.399145 (+1192229us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18002c6320. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a79522 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:19:36.495900 (+ 96755us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b2c000014c8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446f372 00007f5ab5ba1a01 00007f5ab5b6643a 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2
0709 13:19:36.496488 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:19:36.496677 (+   189us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:36.553579 (+ 56902us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b18002c6320. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:19:36.712360 (+158781us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.713260 (+   900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.713339 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.713382 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:36.713395 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.713508 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":388539,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":2161,"raft.queue_time_us":13723,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":19716,"spinlock_wait_cycles":40231808,"thread_start_us":673400,"threads_started":3,"wal-append.queue_time_us":701293}
I20260709 13:19:36.692484 21519 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 13:19:36.770918 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.780799 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.756503 21299 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.756980 21563 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:36.726430 21373 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:19:36.760949 21339 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:36.759718 21564 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.764765 21661 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:36.766010 21532 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:36.782704 21627 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:19:36.819581 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.777318 21406 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:36.789381 17568 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:36.820277 17445 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
W20260709 13:19:36.820595 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.828152 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.834079 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.834734 17525 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:36.835546 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.836547 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.837704 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.776129 21654 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.840233 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.844930 17525 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 6.
I20260709 13:19:36.850070 18166 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:36.827675 21561 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:36.859938 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.803987 21299 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.828328 21331 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.853448 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:36.865859 17447 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:36.861929 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.860289 21561 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.870417 21561 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.813529 21339 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.872995 21339 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.842506 21599 raft_consensus.cc:697] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:36.842823 21626 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:36.815344 21564 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:36.883380 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:36.885483 17453 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
W20260709 13:19:36.864051 21674 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:19:36.886482 17525 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.832948 21406 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.863423 20784 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:36.889103 21599 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.919353 21569 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:36.920523 21564 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:36.864279 21532 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.922597 21532 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.924114 21299 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:36.928050 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.932896 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.882959 21438 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:36.935357 17522 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.935724 17525 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:36.937443 21406 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.938897 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:36.939250 21677 log.cc:927] Time spent T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260709 13:19:36.939519 17525 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.942279 17522 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:36.943181 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.944413 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.945452 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:36.890374 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 428222us
I20260709 13:19:36.890892 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.947352 17527 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:36.947961 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.948275 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:36.948750 21654 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.861903 21512 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:36.949425 21438 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.949739 21512 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.950174 21512 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:36.950956 21624 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:36.894430 17526 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:36.954968 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:36.956573 17526 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:36.956991 21565 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.899210 21561 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.959730 21561 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:36.960460 21565 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.960961 21565 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:36.962327 17526 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:36.963124 21565 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:36.949497 17527 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:36.910566 17419 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:36.971683 17526 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:36.971781 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 61332us
I20260709 13:19:36.958876 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.976799 17419 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.983224 17447 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 13.
I20260709 13:19:36.983508 17419 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.984556 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:36.985163 17495 leader_election.cc:400] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11.
I20260709 13:19:36.985496 17495 leader_election.cc:403] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:36.986384 17523 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:36.986749 17520 raft_consensus.cc:606] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:36.993542 17520 raft_consensus.cc:614] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:36.990063 17419 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:36.996502 17525 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:37.003667 20784 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.004706 20784 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:37.014640 17419 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:37.031100 17526 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:37.040343 20784 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:37.042222 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 48087.9us
I20260709 13:19:36.982451 21624 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:36.976270 21334 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:36.982482 21654 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:37.086887 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:36.986496 21406 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:37.082270 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:37.042708 21466 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:37.013827 21676 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11.
W20260709 13:19:37.140210 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet f83c31b52fc7479896f1f02ab870dc3b: Illegal state: Replica ddfe9cca0741489b994f8b0178c54fe7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:37.087802 17602 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
W20260709 13:19:37.089043 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 330297us
I20260709 13:19:37.133422 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:37.013512 21648 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:37.123371 17601 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:37.144042 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:37.134769 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 302070us
I20260709 13:19:37.075238 21664 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:37.146570 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:37.159839 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:37.160697 17594 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:37.161098 17495 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:37.149092 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:37.162940 17601 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:37.153610 17569 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:37.167002 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:37.167824 17603 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:37.170634 20784 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:37.171264 20784 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.155503 17568 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:37.087438 21334 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:37.038880 21512 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:37.177158 21311 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:37.178220 21216 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:37.177418 17348 catalog_manager.cc:5697] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 6 to 8, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 8 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:37.140480 21654 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:37.146113 21678 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:37.166441 21642 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:19:37.218755 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:37.219542 17603 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
W20260709 13:19:37.192893 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:37.221066 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.196192 17599 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:37.145452 17602 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.202425 20784 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:37.202824 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 47649.4us
I20260709 13:19:37.208140 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:37.211798 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.206159 21334 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.175124 21347 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:37.217725 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:37.230427 17595 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:37.206301 21532 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:37.203573 21664 raft_consensus.cc:697] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:37.233790 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:37.211798 17350 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40498 (request call id 189) took 47260 ms (client timeout 15000 ms). Trace:
I20260709 13:19:37.190485 21624 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:19:37.258566 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:37.259179 17451 raft_consensus.cc:2376] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11. Re-sending same reply.
I20260709 13:19:37.233019 17348 catalog_manager.cc:5697] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:37.260056 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:37.261210 17446 raft_consensus.cc:2410] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:37.248202 17568 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:37.251535 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:37.217752 21311 raft_consensus.cc:697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:37.251830 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:37.256598 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:37.263836 17453 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.256804 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:37.257908 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:37.265733 17448 raft_consensus.cc:2410] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:37.267349 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:37.268045 17450 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:37.237775 21532 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.271418 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:37.273679 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:37.273831 17450 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:37.272584 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:37.275429 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:37.246335 21438 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:37.277050 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:37.250605 18199 raft_consensus.cc:1240] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:37.278513 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:37.279605 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:37.280222 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 254359us
I20260709 13:19:37.291132 17595 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:37.275337 17568 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:37.301991 17568 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:37.310678 17419 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:37.316937 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:37.236513 21572 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:19:37.321882 17453 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:37.324358 20784 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:37.324986 17520 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:19:37.324569 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 163544us
I20260709 13:19:37.322613 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:37.330108 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:37.330402 17528 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:37.319031 17568 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:37.332762 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:37.265628 17350 rpcz_store.cc:269] 0709 13:18:49.929910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.931998 (+  2088us) service_pool.cc:224] Handling call
0709 13:19:37.190537 (+47258539us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:34.660405 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:34.708378 (+ 47973us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:34.708419 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:19:34.708432 (+    13us) tablet.cc:662] Decoding operations
0709 13:19:34.709104 (+   672us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:34.709173 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:34.709201 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:19:34.709753 (+   552us) tablet.cc:701] Row locks acquired
0709 13:19:34.709769 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:19:34.709911 (+   142us) write_op.cc:270] Start()
0709 13:19:34.710049 (+   138us) write_op.cc:276] Timestamp: P: 1783603174709862 usec, L: 0
0709 13:19:34.710067 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:19:34.757520 (+ 47453us) log.cc:844] Serialized 2094 byte log entry
0709 13:19:35.881503 (+1123983us) op_driver.cc:464] REPLICATION: finished
0709 13:19:36.198631 (+317128us) write_op.cc:301] APPLY: starting
0709 13:19:36.223645 (+ 25014us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:36.223868 (+   223us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:36.224073 (+   205us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:36.233833 (+  9760us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:36.234073 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:19:36.234118 (+    45us) write_op.cc:312] APPLY: finished
0709 13:19:36.234364 (+   246us) log.cc:844] Serialized 47 byte log entry
0709 13:19:36.235421 (+  1057us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:36.235541 (+   120us) write_op.cc:454] Released schema lock
0709 13:19:36.235598 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:36.242415 (+  6817us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:36.242448 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27387,"reported_tablets":53,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":294030,"apply.run_cpu_time_us":4366,"apply.run_wall_time_us":43775,"num_ops":5,"prepare.queue_time_us":337706,"prepare.run_cpu_time_us":19016,"prepare.run_wall_time_us":196942,"raft.queue_time_us":620626,"raft.run_cpu_time_us":16047,"raft.run_wall_time_us":272908,"replication_time_us":1171194,"thread_start_us":937484,"threads_started":4,"wal-append.queue_time_us":273559,"wal-append.run_cpu_time_us":28300,"wal-append.run_wall_time_us":2201508}]]}
I20260709 13:19:37.323714 17529 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:37.326342 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:37.325992 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:37.321786 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:37.379992 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:37.364112 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 354807us
I20260709 13:19:37.382110 21438 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:37.278296 21532 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.314592 21331 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:37.397109 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:37.396821 17348 catalog_manager.cc:5697] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 6 to 7, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 7 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:37.325271 21573 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:37.278707 21299 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:19:37.315451 21339 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:19:37.382767 21465 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:37.325655 21406 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:19:37.335275 21663 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:19:37.394325 21664 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:37.278458 21626 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:37.336432 21561 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:37.412410 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 93433.1us
I20260709 13:19:37.413005 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:37.599463 17448 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:37.423197 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:37.423439 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:37.423807 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:37.603933 17446 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:37.425235 17445 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:37.419632 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:37.606285 17568 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:37.477345 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:37.454718 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 257738us
I20260709 13:19:37.498003 17602 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:37.607980 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:37.415367 17522 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
W20260709 13:19:37.606398 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 186902us
I20260709 13:19:37.609835 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:37.426250 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:37.610422 17529 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.611027 17450 raft_consensus.cc:2410] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 13 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:37.457283 21465 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:37.613489 21465 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:37.610220 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:37.419224 17348 catalog_manager.cc:5697] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 1 to 4, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 4 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:37.401469 20784 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:37.616432 17568 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:37.619765 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:37.620361 17602 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.622622 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:37.627908 17448 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:19:37.482466 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:37.634159 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.416586 21438 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.426138 21572 consensus_queue.cc:1243] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:37.638793 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:37.647648 17595 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
I20260709 13:19:37.640163 17527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:19:37.648767 17527 raft_consensus.cc:606] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:37.648859 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:37.445225 21686 log.cc:927] Time spent T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:37.443483 21512 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:37.643576 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:37.649322 17527 raft_consensus.cc:614] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:37.586845 21654 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:37.672919 21624 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:37.673455 21624 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:37.673854 21624 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.674391 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:37.647079 21700 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:37.675951 21700 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:37.676318 21700 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.417634 21331 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:37.417073 21687 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:37.678097 21331 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.678212 21687 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:37.678871 21687 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:37.618633 21599 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:37.654066 17602 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
W20260709 13:19:37.664247 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 280286us
I20260709 13:19:37.664812 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:37.665133 21573 raft_consensus.cc:697] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:37.684954 17419 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:37.661053 17348 catalog_manager.cc:5697] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 5 to 6, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 6 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:37.439808 21532 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:37.630290 21561 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:37.681062 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:37.614866 21334 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:37.681720 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:37.715121 17522 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:37.549855 21626 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:37.682888 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:37.630692 21564 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.684260 17603 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:37.656234 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:37.638360 21563 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:37.685947 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:37.668306 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:37.722679 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 54453.1us
W20260709 13:19:37.722848 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 66720us
I20260709 13:19:37.723518 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:37.724081 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:37.717543 17524 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:37.688408 18167 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:37.638195 21339 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:19:37.738224 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:37.683486 21599 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:37.742373 21165 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:37.742967 21599 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.718259 21648 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:37.725170 21626 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.712173 21561 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:37.774434 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 71631.4us
I20260709 13:19:37.730703 21216 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:37.776357 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.730568 21693 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:37.739348 21506 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:37.782007 17419 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:37.450215 21311 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:37.716476 21468 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:19:37.744815 21678 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:37.799264 21216 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:37.803215 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:37.775302 21648 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:37.782060 21561 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.780841 21465 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.752624 21382 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:37.802248 21680 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:37.747745 21299 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:19:37.869485 17603 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 13.
I20260709 13:19:37.858541 17348 catalog_manager.cc:5697] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 2 to 6, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 6 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:37.804096 17520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:19:37.982398 17520 raft_consensus.cc:606] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:37.982908 17520 raft_consensus.cc:614] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:37.984203 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:37.887164 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 84062.4us
I20260709 13:19:37.880084 21678 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:37.849012 21693 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:37.887545 21216 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.905699 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:37.909559 21648 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.803344 21654 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:19:37.945686 21562 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:37.880993 21698 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:37.888070 21636 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.947482 17529 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:37.848124 21573 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.064270 21564 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:38.065299 21562 raft_consensus.cc:697] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:37.977890 21465 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.066284 21562 consensus_queue.cc:237] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:38.068341 21465 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:37.959028 21347 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.960608 21624 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:37.969298 17420 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.003s	sys 0.014s
I20260709 13:19:37.990821 17520 raft_consensus.cc:2955] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 2 to 8, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:37.996029 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:19:38.004868 17521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.008s	sys 0.012s
I20260709 13:19:37.962389 21339 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:38.053138 21299 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:38.094440 21299 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:38.095613 21299 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:38.097252 21299 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.055172 21331 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:38.058727 17527 raft_consensus.cc:1240] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:37.967769 21687 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:38.027261 21373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.007s	sys 0.013s
I20260709 13:19:38.003823 21678 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:38.058333 21636 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:38.088847 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:38.100768 17521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.008s	sys 0.012s
I20260709 13:19:38.026142 21664 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:38.102285 17420 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.004s	sys 0.014s
W20260709 13:19:38.112990 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 673060us
I20260709 13:19:38.113250 17524 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:38.081394 21532 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:38.070744 21709 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:19:38.109983 17601 raft_consensus.cc:1240] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:38.106277 21373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.008s	sys 0.013s
I20260709 13:19:38.097747 21599 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.032612 21698 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:38.101877 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:38.079700 21334 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:38.130519 17451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.016s	sys 0.016s
W20260709 13:19:38.132402 17451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.016s	sys 0.016s
W20260709 13:19:38.137499 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:38.139422 21355 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.012s	sys 0.024s
I20260709 13:19:38.098472 21347 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.160477 17521 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:38.159986 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 435660us
I20260709 13:19:38.110992 21663 consensus_queue.cc:1059] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:19:38.149708 21355 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.013s	sys 0.025s
I20260709 13:19:38.139528 21406 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:38.140385 21698 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:38.170523 17568 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:38.148175 21334 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:38.194919 21564 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.195489 21564 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:38.196345 21721 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:38.197672 21564 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:38.198855 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:38.199970 17525 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.177102 21406 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.193819 21339 consensus_queue.cc:1059] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:19:38.204741 21406 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:38.194821 21701 consensus_queue.cc:1059] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:38.205423 21663 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:38.205778 21697 consensus_queue.cc:1059] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:38.206135 21701 raft_consensus.cc:3055] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:38.206072 21663 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.206668 21701 raft_consensus.cc:740] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:38.207851 21701 consensus_queue.cc:260] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:38.208489 21663 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:38.209092 21701 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.191354 21373 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:38.209676 21373 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.206494 21216 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:38.210094 21373 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:38.211637 21216 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:38.213681 21636 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:38.214745 21331 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:38.117233 21664 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.216197 21624 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:38.217650 17525 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:38.217860 21347 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:38.174492 21479 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.228837 17525 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:38.159597 21700 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:38.256114 17495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.010s	sys 0.023s
W20260709 13:19:38.256495 17495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.010s	sys 0.023s
W20260709 13:19:38.256825 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 533366us
W20260709 13:19:38.251700 21706 log.cc:927] Time spent T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 13:19:38.218794 21438 consensus_meta.cc:287] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.002s
I20260709 13:19:38.269333 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:38.193589 21519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.017s	sys 0.026s
W20260709 13:19:38.288347 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.216935 21664 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:38.280293 17420 leader_election.cc:336] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.648s (SENT)
I20260709 13:19:38.206756 21697 consensus_queue.cc:1059] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:19:38.289660 17525 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:38.192947 21468 consensus_queue.cc:1059] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:19:38.293426 18166 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:38.194471 21561 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.194578 21334 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.296152 21546 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:38.317798 21339 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.318399 21339 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.318145 21546 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:38.319363 21334 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:38.320483 21339 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:38.321246 21546 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:38.322091 21276 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:38.323566 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:38.253916 17569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.003s	sys 0.016s
W20260709 13:19:38.325201 17569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.004s	sys 0.016s
I20260709 13:19:38.219033 21626 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:38.282994 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:38.330790 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:38.279588 17526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.001s	sys 0.029s
I20260709 13:19:38.289983 21636 raft_consensus.cc:3055] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:38.291232 21519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.018s	sys 0.027s
W20260709 13:19:38.329463 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 46562.3us
I20260709 13:19:38.254894 21479 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:38.325904 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 601829us
I20260709 13:19:38.330971 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:38.252833 21623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.016s	sys 0.003s
I20260709 13:19:38.341005 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:38.375846 17601 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:38.377283 17603 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:38.368842 17568 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:38.383208 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:38.385880 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:38.290952 21347 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:38.408140 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 76704.7us
I20260709 13:19:38.411279 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.288983 21438 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:38.424014 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.446323 17601 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
W20260709 13:19:38.280154 21682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.010s	sys 0.009s
I20260709 13:19:38.448874 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.456226 17594 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:38.450544 17452 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:38.339444 21276 raft_consensus.cc:697] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:38.334280 21636 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:38.332952 17526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.002s	sys 0.029s
I20260709 13:19:38.451299 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:38.451424 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:38.452454 17528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.000s	sys 0.019s
I20260709 13:19:38.453704 17598 raft_consensus.cc:1240] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:38.454519 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:38.371292 21563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.016s	sys 0.011s
I20260709 13:19:38.341176 21465 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:38.494832 18165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.004s	sys 0.016s
I20260709 13:19:38.489238 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:38.488804 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:38.496196 18165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.004s	sys 0.016s
I20260709 13:19:38.496377 17596 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.497910 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:38.498220 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:38.500245 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:38.412984 21331 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:38.506636 17526 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:38.509405 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:38.494832 17450 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:38.506259 17448 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:38.510936 18166 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:38.498149 21682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.011s	sys 0.012s
I20260709 13:19:38.510601 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:38.504803 21563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.020s	sys 0.017s
I20260709 13:19:38.414227 21512 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:38.454327 21687 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:38.533349 17447 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:38.508571 21599 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:38.554334 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 43554.2us
I20260709 13:19:38.489373 21661 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:19:38.562307 21729 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.639743 21200 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.643008 21200 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.636670 17596 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:38.497843 21465 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:38.647315 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:38.566743 21715 log.cc:927] Time spent T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:19:38.379081 21623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.017s	sys 0.003s
I20260709 13:19:38.408483 21693 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:38.708668 17520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.029s	sys 0.049s
W20260709 13:19:38.709203 17520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.029s	sys 0.049s
W20260709 13:19:38.653884 17528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.001s	sys 0.021s
I20260709 13:19:38.473626 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:38.411134 21347 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:19:38.685935 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.409852 21216 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:38.655678 21573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.024s	sys 0.061s
I20260709 13:19:38.532608 21373 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.549548 21727 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:38.534976 21648 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:38.719493 17419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.006s	sys 0.013s
I20260709 13:19:38.551169 21563 raft_consensus.cc:697] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:38.726984 21573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.025s	sys 0.061s
I20260709 13:19:38.640866 21165 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:38.641026 21331 raft_consensus.cc:697] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:38.736055 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:38.665189 21465 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.752799 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:38.761103 17419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.006s	sys 0.013s
W20260709 13:19:38.719444 17418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.018s
I20260709 13:19:38.548482 21714 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.182s
W20260709 13:19:38.667960 21569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.024s	sys 0.067s
I20260709 13:19:38.717859 21347 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.801400 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1804) took 1419 ms. Trace:
W20260709 13:19:38.801662 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 597195us
I20260709 13:19:38.804245 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:38.570201 21512 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:38.714358 21724 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.566618 21276 consensus_queue.cc:237] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:38.752405 21700 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:38.733906 21636 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.816221 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1811) took 1389 ms. Trace:
W20260709 13:19:38.800163 21569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.024s	sys 0.067s
W20260709 13:19:38.818617 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 432792us
I20260709 13:19:38.802079 17453 rpcz_store.cc:276] 0709 13:19:37.381854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.382255 (+   401us) service_pool.cc:224] Handling call
0709 13:19:37.382636 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.642420 (+259784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.642453 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:37.643238 (+   785us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.100912 (+457674us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:38.548335 (+447423us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.548671 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.548769 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.801113 (+252344us) raft_consensus.cc:1685] finished
0709 13:19:38.801144 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.801321 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":247965,"prepare.queue_time_us":217194,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":279809,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":175,"thread_start_us":856480,"threads_started":2,"wal-append.queue_time_us":638233}
I20260709 13:19:38.819525 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:38.778775 21725 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:19:38.779500 21722 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 13:19:38.801267 17418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.000s	sys 0.019s
I20260709 13:19:38.759366 21216 raft_consensus.cc:697] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:38.822543 17451 rpcz_store.cc:276] 0709 13:19:37.426674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.426824 (+   150us) service_pool.cc:224] Handling call
0709 13:19:37.427201 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:38.141394 (+714193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.141424 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:38.145657 (+  4233us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.653652 (+507995us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:38.653701 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.653776 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.816013 (+162237us) raft_consensus.cc:1685] finished
0709 13:19:38.816032 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.816162 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189926,"raft.queue_time_us":234854,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":22784,"thread_start_us":989786,"threads_started":2,"wal-append.queue_time_us":646646}
I20260709 13:19:38.827651 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:38.829272 17524 raft_consensus.cc:2393] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:38.828426 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:38.835748 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.779752 21466 raft_consensus.cc:3055] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:38.778313 21200 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:38.836611 21720 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.839421 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:38.842415 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 335980us
I20260709 13:19:38.813235 21648 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:38.842648 17520 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:38.845723 21466 raft_consensus.cc:740] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:38.848289 17520 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:38.848944 21200 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.848744 21466 consensus_queue.cc:260] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:38.849433 21200 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.840858 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:38.843688 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.845784 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:38.850427 17526 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:38.850961 17524 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:38.820942 21626 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:38.850241 21519 raft_consensus.cc:3055] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:38.830174 21701 consensus_meta.cc:287] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.002s
I20260709 13:19:38.829368 21599 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:38.853843 17598 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:38.768307 21727 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:38.855468 17596 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:38.838402 21636 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.856540 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:38.865872 17601 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:38.857622 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:38.857846 17594 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:38.858713 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:38.867187 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.867564 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.867862 17594 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
W20260709 13:19:38.846356 21678 consensus_meta.cc:287] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.724s	user 0.005s	sys 0.006s
I20260709 13:19:38.863493 17495 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:38.857092 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:38.845490 21700 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:38.869829 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.871930 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.872668 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.874925 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.875324 17495 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:38.876082 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:38.858170 21339 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:38.877305 21729 raft_consensus.cc:3055] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:38.877823 21729 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:38.878942 21729 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:38.879575 21717 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:19:38.881219 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2387) took 1188 ms. Trace:
I20260709 13:19:38.882316 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.882117 21700 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.884424 21700 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:38.885044 21216 consensus_queue.cc:237] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.886157 21466 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:38.852392 21563 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.887260 21479 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:38.887668 21727 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:38.888615 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.889431 17599 raft_consensus.cc:2410] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:38.890168 21200 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:38.853366 21654 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.890820 21654 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.891500 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:38.892094 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2386) took 1201 ms. Trace:
I20260709 13:19:38.892863 21654 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:38.858777 21519 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:38.894382 21519 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.895599 21519 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:38.892499 17523 rpcz_store.cc:276] 0709 13:19:37.690950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.691798 (+   848us) service_pool.cc:224] Handling call
0709 13:19:37.692158 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.692406 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.692437 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:37.716871 (+ 24434us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.170347 (+453476us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:38.170382 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.170447 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.891862 (+721415us) raft_consensus.cc:1685] finished
0709 13:19:38.891903 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.892034 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":420943,"threads_started":1,"wal-append.queue_time_us":714970}
I20260709 13:19:38.899011 21699 raft_consensus.cc:993] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: : Instructing follower abf46e430b7e4ad4919ca2a717f37e0e to start an election
I20260709 13:19:38.899858 21699 raft_consensus.cc:1081] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Signalling peer abf46e430b7e4ad4919ca2a717f37e0e to start an election
I20260709 13:19:38.903681 17447 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:19:38.891121 21698 consensus_meta.cc:287] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.001s
I20260709 13:19:38.906782 21698 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.909116 21698 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:38.909324 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:38.890209 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.910202 21718 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:38.911051 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.911756 17599 raft_consensus.cc:2393] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:38.912524 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.913079 17599 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:38.913713 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:38.914925 21373 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:38.918962 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.822151 21724 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.919737 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:38.920046 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.920894 17596 raft_consensus.cc:2393] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:38.921968 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.881595 17528 rpcz_store.cc:276] 0709 13:19:37.693136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.713405 (+ 20269us) service_pool.cc:224] Handling call
0709 13:19:37.713745 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.714177 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.714218 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:37.720397 (+  6179us) log.cc:844] Serialized 26 byte log entry
0709 13:19:37.947954 (+227557us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b480021c258. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abaa8faa1 00007f5abaa86b37 00007f5abaa869ca 00007f5abab7e26f 00007f5abab7df37 00007f5abab9255c 00007f5abab92508 00007f5abab92488 00007f5abab92443 00007f5abab916ec 00007f5ab9abba96
0709 13:19:38.710169 (+762215us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:38.710211 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.710277 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.880926 (+170649us) raft_consensus.cc:1685] finished
0709 13:19:38.880946 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.881164 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":703,"raft.run_cpu_time_us":3162,"raft.run_wall_time_us":229258,"spinlock_wait_cycles":5380352,"thread_start_us":989463,"threads_started":1,"wal-append.queue_time_us":940840}
I20260709 13:19:38.913870 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.924693 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:38.928123 17601 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:38.935688 17568 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:38.929560 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:38.929872 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.930850 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:38.931397 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 56219.4us
I20260709 13:19:38.932169 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:38.934315 17452 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:19:38.937937 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:38.942935 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:38.945564 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:38.946427 17450 raft_consensus.cc:2410] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:19:38.948173 17598 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:38.950758 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:38.949105 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:38.955134 17598 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:38.956939 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:38.959867 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:38.960644 17449 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:38.930065 21299 consensus_meta.cc:287] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.832s	user 0.009s	sys 0.004s
I20260709 13:19:38.973335 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:38.871506 21711 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.975140 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:38.962754 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.964890 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.969398 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.978206 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.970857 17597 raft_consensus.cc:2393] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:38.979394 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:38.970781 18167 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:38.980500 17445 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:38.953562 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:38.983098 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:38.985881 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:39.047911 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 89407.4us
I20260709 13:19:39.049182 17595 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:38.948300 21648 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.949795 21438 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:38.867981 21599 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.057674 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:39.058892 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 123265us
I20260709 13:19:38.949553 21626 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:39.195555 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:39.197082 20784 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:39.197384 17568 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:39.063651 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 96533.3us
I20260709 13:19:38.962132 21700 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:39.071784 21479 raft_consensus.cc:3055] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:39.180199 21216 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:39.084394 17449 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:39.117146 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:39.210758 17449 pending_rounds.cc:85] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 6
I20260709 13:19:39.211140 17449 pending_rounds.cc:107] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:19:39.210912 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:39.211468 17449 raft_consensus.cc:2889] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:39.117146 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:38.956306 21699 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 13:19:38.868894 21331 consensus_queue.cc:237] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:38.920506 21678 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.053745 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:39.056399 21757 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:39.136629 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:39.232479 17446 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:39.233321 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:39.060230 21713 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:39.146658 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:39.058782 21693 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:19:39.152278 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:39.071476 21465 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:38.851927 21720 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.201180 21700 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:39.214707 21299 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:39.176621 17598 raft_consensus.cc:2376] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12. Re-sending same reply.
I20260709 13:19:39.178359 17445 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:39.214289 21216 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:39.180855 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:39.181591 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 228235us
I20260709 13:19:39.223567 21561 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:39.184036 21695 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:39.185565 21731 log.cc:927] Time spent T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:19:39.185310 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:39.188663 17569 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:39.193771 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:39.196782 17454 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:39.213667 21468 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:19:39.163278 21623 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.160542 21355 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.181314 21347 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.218950 17419 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:39.230857 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:39.236014 17600 raft_consensus.cc:1240] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:39.236806 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:39.241097 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:19:39.242110 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.243551 17594 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:39.197325 21624 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:39.176589 17595 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:39.209290 21479 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:39.208465 21572 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:39.254696 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:39.179512 17601 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:39.255908 17527 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:39.182796 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:39.192407 21648 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.261746 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:39.262777 17602 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:38.963481 21339 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:39.266742 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.266714 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:39.260432 21216 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:39.270632 21763 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:39.271904 21729 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:39.255475 21700 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:39.273816 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:39.209899 21626 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:39.277019 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 88472.2us
I20260709 13:19:39.257795 21299 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.182096 21711 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.244731 21744 consensus_queue.cc:1059] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:19:39.244879 21636 consensus_queue.cc:1059] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:19:39.267266 21757 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:19:39.693545 17445 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:39.694880 17445 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:39.582857 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 363925us
I20260709 13:19:39.526391 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1930) took 1668 ms. Trace:
I20260709 13:19:39.747565 17522 rpcz_store.cc:276] 0709 13:19:37.857610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.857716 (+   106us) service_pool.cc:224] Handling call
0709 13:19:37.857970 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.880132 (+ 22162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.880164 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:37.886502 (+  6338us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.457421 (+570919us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:38.538845 (+ 81424us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.847579 (+308734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.847632 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.505852 (+658220us) raft_consensus.cc:1685] finished
0709 13:19:39.526093 (+ 20241us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.526305 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":91471,"prepare.run_cpu_time_us":5638,"prepare.run_wall_time_us":27706,"raft.queue_time_us":275231,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":10892,"thread_start_us":791386,"threads_started":2,"wal-append.queue_time_us":948763}
I20260709 13:19:39.756127 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:39.753593 21718 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:39.769872 21718 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.772948 21718 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:39.773523 21718 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:39.779630 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:39.780076 17601 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:39.783731 17454 raft_consensus.cc:1240] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:19:39.783944 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.781730 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:39.796415 17601 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:39.797390 17452 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:19:39.797830 17452 pending_rounds.cc:85] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 6
I20260709 13:19:39.798123 17452 pending_rounds.cc:107] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:19:39.797830 17601 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:19:39.742533 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:39.743351 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.369886 17595 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:39.746542 21713 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:39.798573 17452 raft_consensus.cc:2889] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:39.805625 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:39.261198 21755 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:39.694672 21572 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:39.821116 17453 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:39.648209 21760 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.347s	user 0.006s	sys 0.004s
I20260709 13:19:39.648660 21751 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.653241 21654 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:39.382597 21512 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:39.323912 21726 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:39.483415 21599 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:39.368474 21724 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:39.608425 21438 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:39.740103 17419 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:39.738855 21299 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:39.806351 17452 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:39.825287 21636 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.835721 21373 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.827522 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:39.476665 21766 log.cc:927] Time spent T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 13:19:39.404932 21749 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:39.837478 17448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.010s	sys 0.005s
I20260709 13:19:39.805889 21713 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:39.800571 17601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:52572
I20260709 13:19:39.800906 21718 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.286487 21355 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:39.841024 17524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.008s	sys 0.008s
W20260709 13:19:39.921103 17524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.008s	sys 0.008s
W20260709 13:19:39.841317 17420 leader_election.cc:336] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.527s (SENT)
I20260709 13:19:39.921747 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:39.922777 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 81496.4us
I20260709 13:19:39.314131 21624 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.822279 21697 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:39.852814 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 112802us
W20260709 13:19:39.827713 21770 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:19:39.892779 21720 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:39.838996 21654 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:39.883430 17448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.011s	sys 0.006s
W20260709 13:19:39.881603 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 54141.7us
I20260709 13:19:39.945436 17446 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:39.883313 21373 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.286741 21623 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.858942 17341 maintenance_manager.cc:419] P c6b0d42b8daf43a291946b809079b0d7: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033343
I20260709 13:19:39.853240 21599 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:39.958570 17520 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:39.959977 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:39.859555 21465 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:39.895730 21762 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.371s	user 0.000s	sys 0.003s
W20260709 13:19:39.895874 21768 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.002s
I20260709 13:19:39.964087 21623 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:39.897055 21773 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:19:39.897938 21771 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:19:39.983974 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1687) took 1125 ms. Trace:
W20260709 13:19:39.898707 21767 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.649s	user 0.002s	sys 0.006s
I20260709 13:19:39.887657 21749 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:39.902664 21777 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:19:39.903424 21769 log.cc:927] Time spent T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
W20260709 13:19:39.908272 21519 consensus_meta.cc:287] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.012s	user 0.009s	sys 0.002s
I20260709 13:19:39.909192 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1939) took 1809 ms. Trace:
I20260709 13:19:39.846179 21750 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:19:39.843753 17453 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:39.862406 21744 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:39.872215 21636 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.844535 21751 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:39.945976 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.035457 17526 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:39.947394 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:39.886492 17601 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:39.952152 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:39.955822 21624 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:39.957494 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:39.944912 21697 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.931699 21698 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:39.868695 21438 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.014963 21757 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.984530 17596 rpcz_store.cc:276] 0709 13:19:38.858793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.202507 (+343714us) service_pool.cc:224] Handling call
0709 13:19:39.203782 (+  1275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.204183 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.204226 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.209997 (+  5771us) log.cc:844] Serialized 564 byte log entry
0709 13:19:39.284011 (+ 74014us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.284062 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.284151 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.983668 (+699517us) raft_consensus.cc:1685] finished
0709 13:19:39.983697 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.983888 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":30974,"threads_started":1,"wal-append.queue_time_us":262402}
I20260709 13:19:39.989132 21748 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.992194 21788 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:39.992306 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2197) took 1057 ms. Trace:
I20260709 13:19:40.114447 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1695) took 1253 ms. Trace:
W20260709 13:19:39.997450 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 735584us
I20260709 13:19:39.867506 21339 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:39.948515 21654 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:40.124389 17598 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:40.013422 17527 rpcz_store.cc:276] 0709 13:19:38.099587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.146646 (+ 47059us) service_pool.cc:224] Handling call
0709 13:19:38.171742 (+ 25096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.739199 (+1567457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.908829 (+169630us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000fee54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:39.909104 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492727552}
I20260709 13:19:40.031572 17599 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
W20260709 13:19:40.035619 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 89719.1us
I20260709 13:19:39.947656 17522 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:40.126169 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.036362 17601 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.125803 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2198) took 1189 ms. Trace:
I20260709 13:19:40.037014 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:40.043145 17418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.001s	sys 0.012s
W20260709 13:19:40.128459 17418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.001s	sys 0.012s
W20260709 13:19:40.036908 18201 consensus_meta.cc:287] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.750s	user 0.010s	sys 0.001s
I20260709 13:19:40.129917 18201 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:40.119089 17594 rpcz_store.cc:276] 0709 13:19:38.860886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.302929 (+442043us) service_pool.cc:224] Handling call
0709 13:19:39.303356 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.347159 (+ 43803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.347194 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.347681 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.857853 (+510172us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:40.017221 (+159368us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.042491 (+ 25270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.042586 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.114220 (+ 71634us) raft_consensus.cc:1685] finished
0709 13:19:40.114241 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.114387 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98924,"prepare.queue_time_us":84806,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":68525,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":171897,"thread_start_us":289375,"threads_started":2,"wal-append.queue_time_us":523644}
I20260709 13:19:40.036907 17528 raft_consensus.cc:2410] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:19:40.104853 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 170493us
I20260709 13:19:40.131492 17420 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.131608 17569 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.132576 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.036211 21648 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:40.043195 21563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.006s	sys 0.007s
I20260709 13:19:40.027004 21744 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:40.104908 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.120146 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:40.137940 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:40.138973 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:40.118852 17448 rpcz_store.cc:276] 0709 13:19:38.934961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.935487 (+   526us) service_pool.cc:224] Handling call
0709 13:19:38.935815 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.061839 (+126024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.061897 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.117493 (+ 55596us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.895930 (+778437us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b48003303d8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abaa8faa1 00007f5abaa86b37 00007f5abaa869ca 00007f5abab7e26f 00007f5abab7df37 00007f5abab9255c 00007f5abab92508 00007f5abab92488 00007f5abab92443 00007f5abab916ec 00007f5ab9abba96
0709 13:19:39.945441 (+ 49511us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:39.945481 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.945541 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.991986 (+ 46445us) raft_consensus.cc:1685] finished
0709 13:19:39.992015 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.992244 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125557,"raft.queue_time_us":126265,"raft.run_cpu_time_us":3283,"raft.run_wall_time_us":832308,"spinlock_wait_cycles":47737728,"thread_start_us":793969,"threads_started":1,"wal-append.queue_time_us":846852}
I20260709 13:19:39.984843 21299 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.133139 17420 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.140111 17523 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:40.126906 17447 rpcz_store.cc:276] 0709 13:19:38.936410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.936962 (+   552us) service_pool.cc:224] Handling call
0709 13:19:38.966520 (+ 29558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.056086 (+ 89566us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:39.071350 (+ 15264us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.149588 (+ 78238us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.152244 (+  2656us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.152369 (+   125us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.160740 (+  8371us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.160969 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.161069 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.763568 (+602499us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b48003303d8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abaa8faa1 00007f5abaa86b37 00007f5abaa869ca 00007f5abab7e26f 00007f5abab7df37 00007f5abab9255c 00007f5abab92508 00007f5abab92488 00007f5abab92443 00007f5abab916ec 00007f5ab9abba96
0709 13:19:39.772107 (+  8539us) spinlock_profiling.cc:243] Waited 8.88 ms on lock 0x7b1800432220. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a79522 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:19:39.773219 (+  1112us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b48003303d8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abaa8faa1 00007f5abaa86b37 00007f5abaa869ca 00007f5abab7e26f 00007f5abab7df37 00007f5abab9255c 00007f5abab92508 00007f5abab92488 00007f5abab92443 00007f5abab916ec 00007f5ab9abba96
0709 13:19:40.125625 (+352406us) raft_consensus.cc:1685] finished
0709 13:19:40.125645 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.125751 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":236516,"prepare.queue_time_us":23845,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":128124,"raft.run_cpu_time_us":4814,"raft.run_wall_time_us":1214021,"spinlock_wait_cycles":68924032,"thread_start_us":48472,"threads_started":1,"wal-append.queue_time_us":198412}
I20260709 13:19:40.049018 21626 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:40.042178 21726 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.141782 21299 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:40.141952 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.142714 17523 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 11: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:19:40.143544 21774 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:19:40.144627 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.145079 21687 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:40.145367 17520 raft_consensus.cc:2393] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:40.145624 21687 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:40.146567 21687 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:40.119519 21771 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:40.152151 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:40.153820 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:40.152899 17569 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.159188 17601 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.161793 17601 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:40.166252 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:40.105751 21783 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:40.105825 21794 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.167353 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:40.035764 21784 consensus_queue.cc:1059] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 13:19:40.107196 21711 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:40.135862 21563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.006s	sys 0.007s
I20260709 13:19:40.183100 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.193980 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1693) took 1333 ms. Trace:
I20260709 13:19:40.135149 21331 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.148619 21693 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:40.198307 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 45527us
I20260709 13:19:40.199061 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1694) took 1338 ms. Trace:
I20260709 13:19:40.151835 21744 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:40.202661 17569 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.186367 21465 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:40.124563 21748 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.187297 21599 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:40.181785 21519 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:40.235437 21519 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.235558 21789 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.235946 21519 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.236068 21751 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:40.236433 21791 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.237040 21751 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:40.237651 21699 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:40.238185 21563 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.186715 21624 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:19:40.163890 21648 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.237663 21751 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.240787 21751 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.194600 17603 rpcz_store.cc:276] 0709 13:19:38.860446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.248700 (+388254us) service_pool.cc:224] Handling call
0709 13:19:39.265913 (+ 17213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.346180 (+ 80267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.346235 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.346757 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.042940 (+696183us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:40.136221 (+ 93281us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.193561 (+ 57340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.193667 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.193725 (+    58us) raft_consensus.cc:1685] finished
0709 13:19:40.193743 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.193906 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136776,"prepare.queue_time_us":88605,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":143085,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":25239,"thread_start_us":391869,"threads_started":1,"wal-append.queue_time_us":555803}
W20260709 13:19:40.242756 21780 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:19:40.243911 21792 log.cc:927] Time spent T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:19:40.248164 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 2209) took 1131 ms. Trace:
I20260709 13:19:40.248631 17453 rpcz_store.cc:276] 0709 13:19:39.116695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.116857 (+   162us) service_pool.cc:224] Handling call
0709 13:19:40.247952 (+1131095us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54002003d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:40.248072 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376991616}
I20260709 13:19:40.131019 21788 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.251367 21755 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.251595 21788 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:40.251856 21755 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.252185 21599 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.254334 21599 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:40.195981 21724 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:40.196206 21561 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.133625 21757 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:40.255795 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.253382 21751 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.257550 21757 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.194878 21466 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.192330 21697 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.237147 21791 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.255297 21712 raft_consensus.cc:3055] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:40.258694 21751 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.214875 17597 rpcz_store.cc:276] 0709 13:19:38.860653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.248724 (+388071us) service_pool.cc:224] Handling call
0709 13:19:39.265668 (+ 16944us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.276899 (+ 11231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.276956 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.324554 (+ 47598us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.855603 (+531049us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:39.885030 (+ 29427us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.885405 (+   375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.885532 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.198754 (+313222us) raft_consensus.cc:1685] finished
0709 13:19:40.198785 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.198977 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10810,"prepare.queue_time_us":78895,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":61832,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":40095,"spinlock_wait_cycles":1797504,"thread_start_us":205184,"threads_started":1,"wal-append.queue_time_us":496540}
I20260709 13:19:40.191193 21720 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:40.191757 21623 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:40.191946 21698 consensus_queue.cc:1059] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:19:40.219112 21299 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:40.235445 21787 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:19:40.275522 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.277035 17568 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:40.280879 17529 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:40.274732 21331 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.191519 21783 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.261345 21465 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:40.270489 21784 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.289253 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.275556 21712 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:40.299181 21797 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:19:40.299537 21795 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
I20260709 13:19:40.300021 21479 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.292315 21331 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.195608 21794 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.308151 21519 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.273746 21165 consensus_queue.cc:1059] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:19:40.316421 17527 raft_consensus.cc:1240] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:40.317314 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2407) took 1098 ms. Trace:
I20260709 13:19:40.317176 21713 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.285516 21623 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.319514 21373 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:40.271531 21466 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.320631 21465 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.255335 21724 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.293211 21299 raft_consensus.cc:697] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:40.273043 21718 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.326004 17569 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:40.377157 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 51253.3us
I20260709 13:19:40.377671 17569 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.298136 21790 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.283521 21720 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:40.323199 21748 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:40.333120 21561 consensus_queue.cc:1059] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:40.305856 21783 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.335038 21438 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:40.336750 18167 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:40.339254 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.287909 21714 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:40.347229 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 179958us
I20260709 13:19:40.311442 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2402) took 1108 ms. Trace:
I20260709 13:19:40.394322 17521 rpcz_store.cc:276] 0709 13:19:39.203550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.203708 (+   158us) service_pool.cc:224] Handling call
0709 13:19:39.203971 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.251850 (+ 47879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.251879 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.251917 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.251944 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.311191 (+1059247us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b540037ffd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:40.311231 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.311381 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109665024}
I20260709 13:19:40.396421 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.324011 21626 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:40.354723 17525 rpcz_store.cc:276] 0709 13:19:39.218495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.219481 (+   986us) service_pool.cc:224] Handling call
0709 13:19:39.219842 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.943855 (+724013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.943903 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.943957 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:39.944003 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.317104 (+373101us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54001dea54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:40.317148 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.317261 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664513792}
W20260709 13:19:40.355924 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.238210 21699 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:40.387671 21729 consensus_meta.cc:287] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.004s
I20260709 13:19:40.345706 21355 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.339898 21750 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.352242 21311 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:40.347250 21695 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:40.366554 21623 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.397925 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:40.416692 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 49748.4us
I20260709 13:19:40.421252 17521 raft_consensus.cc:2410] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:40.421998 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.276139 21791 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.382997 21373 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.382725 21720 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:40.415215 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:40.373976 21276 consensus_queue.cc:1059] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:19:40.410466 21802 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:40.386598 21165 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:40.424163 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:40.435240 17521 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.424281 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:40.385946 21718 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:40.438681 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 102046us
I20260709 13:19:40.445891 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:40.447474 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 50471us
W20260709 13:19:40.372071 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 189096us
I20260709 13:19:40.420591 21311 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.376302 21712 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:40.423919 21695 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.535722 17596 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:40.500015 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.560163 17420 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.448637 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:40.560835 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:40.523877 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 76516.6us
I20260709 13:19:40.467154 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:40.528170 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 95884.8us
I20260709 13:19:40.507416 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.421065 18195 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:40.560741 17594 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:40.568759 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:40.580471 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46205.7us
I20260709 13:19:40.566464 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.581099 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:40.582396 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.584218 21626 raft_consensus.cc:697] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:40.584022 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:40.446578 21802 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.585544 21626 consensus_queue.cc:237] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.586627 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:40.587031 21802 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:40.570737 17569 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.581871 17595 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.589159 21808 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:40.589941 21808 raft_consensus.cc:697] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:40.579357 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.591410 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.591010 21808 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.578610 21822 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:19:40.596138 21751 consensus_queue.cc:1059] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:40.597167 21599 raft_consensus.cc:3055] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:40.597579 21599 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:40.474236 21216 consensus_meta.cc:287] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.003s
I20260709 13:19:40.461508 21729 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:40.442893 21165 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.600234 17420 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.576746 17526 raft_consensus.cc:2393] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:40.603559 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:40.605945 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.605324 21802 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.524677 21713 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:40.445297 21806 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.624058 21809 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.624939 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.625031 21623 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.608937 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:40.626153 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.627034 17594 raft_consensus.cc:2410] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:19:40.628716 21700 consensus_meta.cc:287] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.825s	user 0.009s	sys 0.003s
I20260709 13:19:40.629163 21816 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.629106 21720 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.611853 17420 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.607355 21729 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:40.630721 21729 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.631114 17420 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.632236 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.633306 21784 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.543497 21789 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:40.612124 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.634300 21789 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.634794 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:40.449977 21791 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.635612 17597 raft_consensus.cc:2393] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:40.636262 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.636611 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.568114 21382 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.529052 21466 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.637290 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.568626 21468 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.598533 21599 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.618064 21695 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.610546 21726 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.580704 21794 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:40.652470 17528 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:40.610574 21724 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:40.602610 21783 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:19:40.622956 21663 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.633340 21807 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.638195 17523 raft_consensus.cc:2410] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:19:40.605849 21561 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.609223 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:40.634317 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.641237 17521 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:40.579509 21811 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:40.452210 21699 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.466648 21654 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.430356 21299 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.455826 21718 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.653718 17525 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:40.659880 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.661087 17568 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:40.663466 17521 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:40.663970 17595 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
W20260709 13:19:40.664494 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 99608us
I20260709 13:19:40.675977 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.676575 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.676921 17595 raft_consensus.cc:2393] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:40.677994 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:40.677793 17420 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.679040 17595 raft_consensus.cc:2376] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11. Re-sending same reply.
I20260709 13:19:40.663749 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:40.610795 21165 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:40.647251 21784 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:40.680164 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.681337 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:40.682400 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.682991 17595 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:40.683837 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:40.684491 17595 raft_consensus.cc:2376] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13. Re-sending same reply.
I20260709 13:19:40.685488 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.686689 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.687212 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:40.688158 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:40.606866 21216 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.692782 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.693563 17595 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:40.693620 17420 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:40.662942 21599 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.694540 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.670233 21355 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.629192 21700 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.650888 21569 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:19:40.672690 21466 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:40.672994 21438 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:19:40.652277 21382 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.739696 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.654981 21755 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.745544 17527 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:40.695662 21757 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:40.670084 21802 consensus_queue.cc:1059] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:19:40.695271 21648 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.690860 21788 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.822098 21778 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.826503 21791 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:40.827132 21791 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:40.827935 21382 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.830224 21720 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:40.831213 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.672660 21811 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.672871 21794 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:19:40.700089 21784 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:40.753496 21808 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:40.736974 21711 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.754889 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.747421 21814 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:19:40.756429 17520 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:40.749241 21744 consensus_meta.cc:287] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.002s
I20260709 13:19:40.884655 21723 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.738255 17598 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:40.914496 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:40.915297 18201 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
W20260709 13:19:40.835647 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 140762us
I20260709 13:19:40.738463 21695 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:19:40.743151 21561 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:19:40.756726 21757 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:40.929215 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52562 (request call id 11) took 1735 ms. Trace:
I20260709 13:19:40.745548 21355 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.855762 21311 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.750597 21466 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.885231 21678 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.899341 17523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:19:40.943024 17523 raft_consensus.cc:606] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:40.943462 17523 raft_consensus.cc:614] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:40.919250 21697 raft_consensus.cc:3055] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:40.884069 21821 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:40.919531 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1949) took 2065 ms. Trace:
I20260709 13:19:40.946374 17524 rpcz_store.cc:276] 0709 13:19:38.854324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.854455 (+   131us) service_pool.cc:224] Handling call
0709 13:19:38.854746 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.190375 (+335629us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:39.190732 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.932833 (+742101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.932898 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.932958 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.891297 (+958339us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400090954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:40.919398 (+ 28101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.919490 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6687,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":27582,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":16950,"spinlock_wait_cycles":771329408,"thread_start_us":730519,"threads_started":1,"wal-append.queue_time_us":822547}
I20260709 13:19:40.948680 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.949170 17524 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:40.918447 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:41.602046 21794 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.603344 21794 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:41.607049 21794 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:41.608160 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.916970 17446 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 2215) took 1706 ms (client timeout 2066 ms). Trace:
I20260709 13:19:41.361541 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:41.620585 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:41.620951 17447 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:41.621430 17452 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.362913 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:41.362259 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:40.833815 17521 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:41.119902 17522 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:40.971807 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:41.733410 17523 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 7.
I20260709 13:19:41.077868 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:40.972847 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:41.359413 17453 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:41.740137 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:41.089685 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:41.744444 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1725) took 1183 ms. Trace:
I20260709 13:19:41.744894 17594 rpcz_store.cc:276] 0709 13:19:40.561065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.089275 (+528210us) service_pool.cc:224] Handling call
0709 13:19:41.744193 (+654918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.909030 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.991720 17601 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:41.804955 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52572 (request call id 538) took 1053 ms. Trace:
I20260709 13:19:41.805413 17596 rpcz_store.cc:276] 0709 13:19:40.751739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.888829 (+137090us) service_pool.cc:224] Handling call
0709 13:19:41.804746 (+915917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.932747 17602 rpcz_store.cc:276] 0709 13:19:39.187079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.780809 (+593730us) service_pool.cc:224] Handling call
0709 13:19:40.894059 (+1113250us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54003eba54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6c735 00007f5abab2cd29 00007f5ab40ab1d4 00007f5ab40ab162 00007f5ab40ab091 00007f5ab40ab00c 00007f5ab40aa2c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:40.921967 (+ 27908us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784382720}
I20260709 13:19:40.969914 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:40.962093 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:41.824162 18194 raft_consensus.cc:2393] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:41.825364 18194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4"
dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:35632
I20260709 13:19:40.923491 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:40.963800 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:40.977845 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:41.834805 18193 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
I20260709 13:19:40.922925 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:19:40.931741 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 113512us
I20260709 13:19:40.984939 21165 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.960547 21347 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:41.856416 17597 raft_consensus.cc:2368] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 13. Current term is 14.
I20260709 13:19:41.858582 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1729) took 1296 ms. Trace:
I20260709 13:19:41.859011 17597 rpcz_store.cc:276] 0709 13:19:40.569571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.636351 (+ 66780us) service_pool.cc:224] Handling call
0709 13:19:41.858320 (+1221969us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000762d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:41.858496 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2802802944}
I20260709 13:19:41.860673 17597 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:41.067651 21355 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.976702 21466 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.966156 21636 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:41.103889 21519 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:41.132656 21572 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:41.872481 21572 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:40.963282 21700 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:41.097556 21718 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:40.910501 21723 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.971870 21729 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:41.880981 21729 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:41.881469 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.925752 21744 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:41.882468 18199 raft_consensus.cc:2410] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:19:40.862742 21775 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.031s	user 0.000s	sys 0.010s
I20260709 13:19:41.388584 21299 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:41.382689 21817 raft_consensus.cc:3055] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:41.889705 18198 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:41.893507 21723 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:40.970728 21825 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:19:40.866369 21808 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:41.899106 21808 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:41.900226 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1697) took 3038 ms. Trace:
I20260709 13:19:40.977643 21784 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.966642 21811 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:40.967151 21824 log.cc:927] Time spent T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:19:40.987401 21663 raft_consensus.cc:3055] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:41.909119 21663 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:40.896478 21331 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:41.338003 21791 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.970079 21755 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:40.957767 21654 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:41.048552 21699 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:41.917972 21699 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:41.257452 21752 raft_consensus.cc:3055] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:41.922145 21752 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:41.923318 21752 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:41.924711 21752 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:40.938256 21833 log.cc:927] Time spent T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:19:40.923568 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:41.929214 18201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42548 (request call id 394) took 1006 ms. Trace:
I20260709 13:19:41.929638 18201 rpcz_store.cc:276] 0709 13:19:40.922862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.923366 (+   504us) service_pool.cc:224] Handling call
0709 13:19:41.929019 (+1005653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:41.359263 21779 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:41.931593 21779 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:40.947949 21623 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:40.945986 21697 raft_consensus.cc:740] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:41.114970 21749 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:40.973001 21831 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:19:40.956018 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:41.397867 21373 consensus_queue.cc:1059] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:41.940987 21373 raft_consensus.cc:3055] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:41.941413 21373 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:41.464154 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:41.474161 17448 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:41.491221 21561 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:41.489230 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:41.947046 17595 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 13.
I20260709 13:19:41.946857 21561 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:41.941947 17340 maintenance_manager.cc:643] P c6b0d42b8daf43a291946b809079b0d7: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 1.895s	user 0.180s	sys 0.080s Metrics: {"bytes_written":29919,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":47259,"dirs.run_cpu_time_us":528,"dirs.run_wall_time_us":1245,"drs_written":1,"lbm_read_time_us":480,"lbm_reads_lt_1ms":4,"lbm_write_time_us":35135,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":46688,"threads_started":1,"update_count":6}
I20260709 13:19:41.948518 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:41.492766 17569 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.68:36313 timed out after 1.564s (SENT) [suppressed 21 similar messages]
W20260709 13:19:41.508175 18195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42548 (request call id 385) took 2561 ms (client timeout 1564 ms). Trace:
I20260709 13:19:41.527573 21698 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:41.543248 21687 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.549229 21789 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:41.619539 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:41.953749 21687 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:41.953675 21561 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:41.630131 21809 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:41.957304 21809 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:41.951443 21698 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:41.602097 21807 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:41.963236 21698 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:41.964600 21698 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.633452 17524 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:41.632558 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:41.965508 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2430) took 1132 ms. Trace:
W20260709 13:19:41.633137 17446 rpcz_store.cc:269] 0709 13:19:39.210320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.233099 (+ 22779us) service_pool.cc:224] Handling call
0709 13:19:40.897372 (+1664273us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54000dc0d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:40.916914 (+ 19542us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636247296}
W20260709 13:19:41.639580 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 720850us
I20260709 13:19:41.639948 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1918) took 1144 ms. Trace:
I20260709 13:19:41.640250 21790 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:41.642669 17599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49566 (request call id 1711) took 2739 ms (client timeout 1620 ms). Trace:
I20260709 13:19:41.649909 21479 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:41.652675 17447 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
W20260709 13:19:41.655900 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.646888 21216 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:41.657827 17452 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:41.661998 21794 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:41.680337 17529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 1956) took 1732 ms (client timeout 1966 ms). Trace:
I20260709 13:19:41.951965 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:41.957621 21687 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:41.968614 17529 rpcz_store.cc:269] 0709 13:19:39.947747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.950317 (+  2570us) service_pool.cc:224] Handling call
0709 13:19:41.680004 (+1729687us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b540013a1d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:41.680159 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494694784}
I20260709 13:19:41.705356 21712 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.723132 21842 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:41.725659 21465 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.721797 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2413) took 1711 ms. Trace:
I20260709 13:19:41.965881 17524 rpcz_store.cc:276] 0709 13:19:40.832877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.949646 (+116769us) service_pool.cc:224] Handling call
0709 13:19:40.949839 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.633109 (+683270us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b54003e0ba0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5adddc0 00007f5ab5b681c0 00007f5ab5b69231 00007f5ab5b65d8f 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c
0709 13:19:41.965170 (+332061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.965443 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5768448}
I20260709 13:19:41.733399 21788 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:41.978183 17452 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:41.977990 21788 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:41.979719 17452 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:41.979642 21842 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:41.751264 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:41.783154 17453 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:19:41.783298 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:41.792621 21754 consensus_queue.cc:1059] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:41.806703 17601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1917) took 1311 ms. Trace:
I20260709 13:19:41.679296 17419 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:41.819801 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:40.954510 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:41.996157 21561 raft_consensus.cc:3055] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:41.996668 17523 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 11: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:41.833495 18167 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:41.989971 21373 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:41.997777 17601 rpcz_store.cc:276] 0709 13:19:40.495055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.500938 (+  5883us) service_pool.cc:224] Handling call
0709 13:19:40.506925 (+  5987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.805221 (+1298296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.806281 (+  1060us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54000771d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:41.806543 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114327296}
W20260709 13:19:41.998338 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 165165us
I20260709 13:19:41.836056 17526 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:19:41.999468 17526 pending_rounds.cc:85] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 6
I20260709 13:19:41.996691 21561 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:41.842340 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.000463 17522 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
I20260709 13:19:42.000792 21561 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:41.861292 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1728) took 1299 ms. Trace:
I20260709 13:19:41.854805 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:42.002192 17597 rpcz_store.cc:276] 0709 13:19:40.561810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.859879 (+1298069us) service_pool.cc:224] Handling call
0709 13:19:41.860252 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.861010 (+   758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.861213 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.002681 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1929) took 1439 ms. Trace:
W20260709 13:19:42.002851 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.003095 17602 rpcz_store.cc:276] 0709 13:19:40.563630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.817969 (+1254339us) service_pool.cc:224] Handling call
0709 13:19:42.002601 (+184632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.003364 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:41.962229 21572 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.004194 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:42.004943 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:41.864126 21165 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:41.867908 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:42.002193 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.006464 17521 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.004459 21572 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.008566 21561 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.009632 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:42.010460 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:42.004194 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:41.878115 17596 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:42.011827 17524 raft_consensus.cc:2368] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11.
I20260709 13:19:40.930886 21757 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.884511 21744 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:41.885221 17450 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:41.890404 21817 raft_consensus.cc:740] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:40.930121 21820 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:41.891294 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2214) took 2695 ms. Trace:
I20260709 13:19:41.889508 21299 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:42.074014 21820 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:40.955547 21821 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:42.079356 21757 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.080108 21821 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.080962 17528 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:41.900641 17600 rpcz_store.cc:276] 0709 13:19:38.861359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.315303 (+453944us) service_pool.cc:224] Handling call
0709 13:19:39.381927 (+ 66624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.382350 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.382381 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:40.220908 (+838527us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b2c00007508. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab445fa11 00007f5ab446f372 00007f5ab5ba1a01 00007f5ab5b6643a 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2
0709 13:19:40.234194 (+ 13286us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.584818 (+350624us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:40.584856 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.585877 (+  1021us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.899683 (+1313806us) raft_consensus.cc:1685] finished
0709 13:19:41.899716 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.900034 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14193,"raft.queue_time_us":375,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":78196,"spinlock_wait_cycles":333951744,"thread_start_us":325701,"threads_started":1,"wal-append.queue_time_us":405788}
I20260709 13:19:41.912213 21663 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.082697 21663 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.083118 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 1968) took 1156 ms. Trace:
I20260709 13:19:42.083560 17528 rpcz_store.cc:276] 0709 13:19:40.926660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.091853 (+165193us) service_pool.cc:224] Handling call
0709 13:19:41.092209 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.081421 (+989212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.082766 (+  1345us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b5400413a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:42.083041 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273087872}
I20260709 13:19:42.067137 21817 consensus_queue.cc:260] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:42.084853 21817 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.921432 21699 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:40.967903 21750 raft_consensus.cc:3055] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:42.087529 21750 raft_consensus.cc:740] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:42.088781 21750 consensus_queue.cc:260] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:41.933859 21339 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.090329 21339 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.073774 17449 rpcz_store.cc:276] 0709 13:19:39.195422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.210261 (+ 14839us) service_pool.cc:224] Handling call
0709 13:19:39.210577 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.212121 (+  1544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.212158 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.212580 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.286179 (+ 73599us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:39.286224 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.286286 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.673272 (+1386986us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:41.890801 (+1217529us) raft_consensus.cc:1685] finished
0709 13:19:41.890841 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.891113 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110618496,"thread_start_us":72112,"threads_started":1,"wal-append.queue_time_us":170320}
I20260709 13:19:41.937536 21697 consensus_queue.cc:260] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.093969 21697 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.938740 21779 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:41.942395 17445 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.950124 17595 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:41.950649 18195 rpcz_store.cc:269] 0709 13:19:38.946498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.949231 (+  2733us) service_pool.cc:224] Handling call
0709 13:19:41.507593 (+2558362us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400438354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:41.507878 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2723773696}
I20260709 13:19:41.963451 21809 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:41.964215 21807 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:41.656598 21778 consensus_queue.cc:1059] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:42.101790 21807 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:42.102576 21778 raft_consensus.cc:3055] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:42.102988 21778 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:42.104004 21778 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.105432 21778 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:41.967187 17599 rpcz_store.cc:269] 0709 13:19:38.903331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.913653 (+ 10322us) service_pool.cc:224] Handling call
0709 13:19:41.642242 (+2728589us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400063954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:41.642463 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543699712}
I20260709 13:19:41.966806 17598 rpcz_store.cc:276] 0709 13:19:40.495628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.496006 (+   378us) service_pool.cc:224] Handling call
0709 13:19:40.496303 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.910713 (+414410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.639362 (+728649us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54000780d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:41.639716 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555986304}
I20260709 13:19:41.980448 21788 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:41.994760 17594 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:42.114337 21820 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:42.115124 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:42.115767 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:42.116427 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:41.981066 21465 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.119812 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:42.120152 21465 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:42.120566 17600 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:41.995908 21842 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:41.975404 17520 rpcz_store.cc:276] 0709 13:19:40.010713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.307485 (+296772us) service_pool.cc:224] Handling call
0709 13:19:40.307834 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.863947 (+556113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.721108 (+857161us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54003412d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:41.721547 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023930624}
W20260709 13:19:42.122069 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 48903.5us
I20260709 13:19:41.864142 21832 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:41.869174 17352 catalog_manager.cc:5697] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.013911 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.122855 17527 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.123594 17523 raft_consensus.cc:2393] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:42.124846 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.123872 17352 catalog_manager.cc:5697] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 7 to 8, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 8 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:19:42.012959 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.014431 21572 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:42.014523 18166 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:42.015332 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:42.130712 17524 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:42.001613 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.130895 21572 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:42.131673 17522 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:42.131831 21752 raft_consensus.cc:3055] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:42.132325 21752 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:42.132440 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 118167us
I20260709 13:19:42.132874 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.133108 17568 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:41.997042 18196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42536 (request call id 286) took 1053 ms. Trace:
I20260709 13:19:41.998929 21373 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.134178 18196 rpcz_store.cc:276] 0709 13:19:40.943225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.943380 (+   155us) service_pool.cc:224] Handling call
0709 13:19:41.996842 (+1053462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.134909 21832 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:42.135376 21832 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.135882 21832 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.021804 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1727) took 1457 ms. Trace:
I20260709 13:19:42.138201 17596 rpcz_store.cc:276] 0709 13:19:40.561536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.830386 (+1268850us) service_pool.cc:224] Handling call
0709 13:19:41.830797 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.011635 (+180838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.018740 (+  7105us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b54003ec454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:42.018973 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107708800}
I20260709 13:19:42.131697 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.140599 17524 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:42.012877 17341 maintenance_manager.cc:419] P c6b0d42b8daf43a291946b809079b0d7: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8751 bytes on disk
I20260709 13:19:42.144331 17340 maintenance_manager.cc:643] P c6b0d42b8daf43a291946b809079b0d7: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":473,"lbm_reads_lt_1ms":4}
I20260709 13:19:41.999890 17526 pending_rounds.cc:107] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:19:42.145866 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.146386 17526 raft_consensus.cc:2889] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:42.147042 17522 raft_consensus.cc:2410] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:42.148334 17526 raft_consensus.cc:1240] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:42.149457 17475 debug-util.cc:398] Leaking SignalData structure 0x7b08000bad20 after lost signal to thread 16332
I20260709 13:19:42.022313 17452 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:19:42.150556 17475 debug-util.cc:398] Leaking SignalData structure 0x7b080025f900 after lost signal to thread 17386
W20260709 13:19:42.030813 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 538213us
W20260709 13:19:42.030854 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 351892us
I20260709 13:19:42.033615 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:42.037912 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:42.036214 21165 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:42.152134 21165 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.041850 21811 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.165762 21811 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.166214 21811 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.166831 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:42.043450 18167 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:42.056053 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:42.168831 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 125500us
I20260709 13:19:42.170193 21729 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:42.171856 21339 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:42.070252 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.076825 17603 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:42.077684 21754 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.179973 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52572 (request call id 536) took 1431 ms. Trace:
I20260709 13:19:42.179818 21754 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.180505 17603 rpcz_store.cc:276] 0709 13:19:40.748946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.969587 (+220641us) service_pool.cc:224] Handling call
0709 13:19:42.179768 (+1210181us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b5400328a54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:42.179912 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592434560}
I20260709 13:19:41.970999 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.133378 21752 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.122191 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:41.999554 21382 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:42.117691 21299 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:42.125636 17523 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:42.114787 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:42.089941 21750 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.129841 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:42.150722 21749 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:42.150954 17475 debug-util.cc:398] Leaking SignalData structure 0x7b08001b9ce0 after lost signal to thread 17400
I20260709 13:19:42.163650 21723 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:42.155125 21479 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.165292 17601 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:42.153393 17419 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:42.209254 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 55955.7us
I20260709 13:19:42.109054 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.137173 17352 catalog_manager.cc:5697] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.184412 17527 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:42.005637 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:42.192915 17521 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:19:42.188460 17595 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:42.199813 17520 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:42.172873 21165 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:42.188001 21754 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:42.221401 17602 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.198410 17445 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:42.219085 17598 raft_consensus.cc:2393] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 12: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:19:42.220674 17475 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5a20 after lost signal to thread 17478
W20260709 13:19:42.225503 17475 debug-util.cc:398] Leaking SignalData structure 0x7b080036a740 after lost signal to thread 17553
W20260709 13:19:42.225848 17475 debug-util.cc:398] Leaking SignalData structure 0x7b080018e100 after lost signal to thread 17554
I20260709 13:19:42.225975 21757 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:42.220324 17599 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
W20260709 13:19:42.227272 17475 debug-util.cc:398] Leaking SignalData structure 0x7b08000aefc0 after lost signal to thread 17627
W20260709 13:19:42.227778 17475 debug-util.cc:398] Leaking SignalData structure 0x7b08003561e0 after lost signal to thread 17628
I20260709 13:19:42.228724 17599 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:19:42.229346 17475 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef140 after lost signal to thread 18225
W20260709 13:19:42.229764 17475 debug-util.cc:398] Leaking SignalData structure 0x7b08002c21c0 after lost signal to thread 18226
I20260709 13:19:42.231083 17419 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:42.231972 17601 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:42.232450 17419 leader_election.cc:400] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11.
I20260709 13:19:42.232825 17419 leader_election.cc:403] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:42.234129 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:42.205899 21846 log.cc:927] Time spent T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.164s	user 0.000s	sys 0.002s
W20260709 13:19:42.237478 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 68792.1us
I20260709 13:19:42.240082 17603 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:19:42.221463 21842 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:42.222548 21779 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:42.237320 21572 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:42.249518 17420 connection.cc:256] RPC call timeout handler was delayed by -1.2847038300001259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
W20260709 13:19:42.268963 17475 debug-util.cc:398] Leaking SignalData structure 0x7b080015d6e0 after lost signal to thread 21801
I20260709 13:19:42.250401 21790 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.219457 21479 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.254559 21744 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:42.248095 21832 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:42.287160 21832 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:42.288038 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.288715 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:42.289579 17528 raft_consensus.cc:2368] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13.
I20260709 13:19:42.291595 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.256042 21779 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:42.292992 21779 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.293780 21784 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.265878 21842 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:42.295006 21842 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:42.295723 17597 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
W20260709 13:19:42.282761 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 81228.4us
W20260709 13:19:42.278942 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 149242us
I20260709 13:19:42.237759 21749 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.270401 21752 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.333525 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:42.306336 17568 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:42.337925 17568 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:42.340934 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.342341 21636 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.342972 18167 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:42.345955 21744 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:42.348879 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 79347.9us
I20260709 13:19:42.349691 21822 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:42.353238 21572 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.354624 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.355984 17419 leader_election.cc:400] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13.
I20260709 13:19:42.366837 17419 leader_election.cc:403] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:42.327423 21382 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.356815 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:42.255575 21794 consensus_queue.cc:1059] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
W20260709 13:19:42.376500 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.303128 21790 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.391898 21816 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:42.392642 21816 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:42.393747 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:42.395229 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:42.396188 21465 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:42.396939 21465 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:42.398169 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.363240 21822 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:42.399462 21755 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:42.399971 21755 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.400450 21755 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.400104 21744 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.399462 21822 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.403858 21790 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:42.383167 21849 log.cc:927] Time spent T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:19:42.411633 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 444) took 1046 ms. Trace:
I20260709 13:19:42.412045 17454 rpcz_store.cc:276] 0709 13:19:41.364665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.956325 (+591660us) service_pool.cc:224] Handling call
0709 13:19:41.956673 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:41.959470 (+  2797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:41.959500 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:41.996966 (+ 37466us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.046681 (+ 49715us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:42.046745 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.046847 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:42.411368 (+364521us) raft_consensus.cc:1685] finished
0709 13:19:42.411391 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.411534 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2513,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":226,"thread_start_us":49064,"threads_started":1,"wal-append.queue_time_us":200042}
I20260709 13:19:42.387900 17528 raft_consensus.cc:2410] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:42.388228 17569 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:42.390426 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 537) took 1640 ms. Trace:
I20260709 13:19:42.373584 21276 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:42.414505 21276 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:19:42.415005 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 58283.4us
W20260709 13:19:42.415472 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 59681.1us
I20260709 13:19:42.373759 21382 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:42.415805 21663 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:42.415900 17420 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:42.416636 21663 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.417902 21382 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:42.414217 17600 rpcz_store.cc:276] 0709 13:19:40.749607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.121281 (+1371674us) service_pool.cc:224] Handling call
0709 13:19:42.121717 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.131061 (+  9344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.131096 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.197836 (+ 66740us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.326327 (+128491us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:42.326370 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.326439 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:42.390176 (+ 63737us) raft_consensus.cc:1685] finished
0709 13:19:42.390197 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.390338 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8500,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":156,"thread_start_us":77830,"threads_started":1,"wal-append.queue_time_us":165009}
W20260709 13:19:42.418857 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.398818 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:42.415830 21276 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:42.421191 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.421965 17529 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:42.422343 21757 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:42.423048 21757 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:42.422432 21778 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:42.423233 18166 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:42.424124 21729 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:42.424358 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.424171 21757 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.343014 21636 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:42.420397 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.427711 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:42.427917 21636 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:42.430744 21663 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13.
I20260709 13:19:42.431857 21479 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:42.393903 21816 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.424680 21729 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.369442 21572 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.462234 17602 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:42.439249 17352 catalog_manager.cc:5697] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.445045 21779 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:42.466435 17529 raft_consensus.cc:3055] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:42.467787 17454 raft_consensus.cc:1240] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:42.464890 18167 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:42.442468 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.443136 21749 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:42.448843 17521 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:42.457989 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:42.476706 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.466794 17529 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:42.463600 21755 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:42.515944 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 51162.4us
W20260709 13:19:42.518741 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.527329 17451 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:42.527915 17522 raft_consensus.cc:2410] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:42.462508 21465 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:42.462425 21729 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.522851 17523 raft_consensus.cc:3055] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:42.534076 17523 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:42.521451 21794 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.539278 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:42.530148 21754 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:42.526732 21832 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:42.553917 17447 raft_consensus.cc:1240] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:42.533767 21465 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:19:42.564862 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.565392 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:42.556771 17529 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.565979 17600 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.566704 17568 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:42.577302 17602 raft_consensus.cc:1240] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:42.573114 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:42.580662 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:42.590273 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 202122us
W20260709 13:19:42.592533 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.598914 21784 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11.
I20260709 13:19:42.599728 21809 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:42.600157 21809 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:42.600536 21809 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.602355 17529 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.574278 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:42.606560 17352 catalog_manager.cc:5697] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:42.615063 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 48472.8us
I20260709 13:19:42.622049 21636 raft_consensus.cc:3055] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:42.622565 21636 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:42.623507 21636 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.624835 21636 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.564683 21465 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.632325 18192 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:42.633172 18194 raft_consensus.cc:606] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:42.633526 21561 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.634246 21561 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:42.635219 17527 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:42.633630 18194 raft_consensus.cc:614] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:42.632584 17529 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:19:42.636749 17529 pending_rounds.cc:85] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 6
I20260709 13:19:42.637022 17529 pending_rounds.cc:107] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:19:42.637279 17529 raft_consensus.cc:2889] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:42.637941 21373 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:42.638538 21373 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:42.639616 21373 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.642198 21165 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:42.644245 21687 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:42.650885 17352 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.661976 21331 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:19:42.662590 18192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42548 (request call id 393) took 1740 ms (client timeout 1777 ms). Trace:
W20260709 13:19:42.663004 18192 rpcz_store.cc:269] 0709 13:19:40.922545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.922683 (+   138us) service_pool.cc:224] Handling call
0709 13:19:42.662383 (+1739700us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54005627d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:42.662532 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441309056}
I20260709 13:19:42.662305 17528 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:42.613834 17523 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.606122 21779 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:42.667004 21697 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:42.667600 21822 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:42.557557 21794 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:42.674530 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:42.653546 17352 catalog_manager.cc:5697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 9 to 10, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 10 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:19:42.679510 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 50726.2us
I20260709 13:19:42.684109 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:42.689090 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.695386 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:42.687762 21811 consensus_meta.cc:287] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.009s
I20260709 13:19:42.724291 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:42.742803 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:42.747288 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:42.749665 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:42.753544 17528 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.751659 17522 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:42.752400 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:42.715399 21750 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:42.695361 21749 consensus_queue.cc:1059] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:19:42.768241 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 237964us
W20260709 13:19:42.768589 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 109695us
W20260709 13:19:42.769728 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.770650 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:42.771351 17447 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
W20260709 13:19:42.773877 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.734488 21723 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:19:42.772379 17568 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:42.723114 21811 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.771713 21822 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:42.750866 21572 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:42.787616 17450 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:42.793982 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:42.787446 21852 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.435s	user 0.000s	sys 0.005s
I20260709 13:19:42.787020 21331 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.803813 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:42.805186 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:42.805548 17522 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.806056 21276 consensus_queue.cc:1059] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:19:42.816598 17348 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40508 (request call id 187) took 37218 ms (client timeout 15000 ms). Trace:
I20260709 13:19:42.820514 17522 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:42.786710 21788 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:42.823889 17419 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:42.800166 21561 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:42.800319 21755 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:42.831815 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:42.833148 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:42.828840 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:42.843277 17594 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:19:42.812283 21331 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.796823 21821 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:19:42.850351 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:42.851118 17453 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:42.851918 17447 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:42.852406 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:42.826076 21697 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.869175 21873 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:42.831296 21788 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:42.880635 17597 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:42.837517 21784 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:42.889472 17450 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:19:42.890115 21794 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:42.837738 21276 consensus_queue.cc:1243] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:42.890158 17598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:19:42.852029 21331 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.910629 17598 raft_consensus.cc:606] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:42.911264 17454 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:42.914990 17598 raft_consensus.cc:614] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:42.922413 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 76890.5us
I20260709 13:19:42.924401 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:42.925333 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.878957 21811 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:42.933580 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:42.911875 21755 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:42.878062 21757 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:19:42.935714 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:42.936523 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:42.936861 21862 log.cc:927] Time spent T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:19:42.938270 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 105445us
I20260709 13:19:42.891480 21788 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:42.949996 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.920583 21784 raft_consensus.cc:697] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:42.920194 21794 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.953509 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:42.942317 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:42.961318 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 129634us
I20260709 13:19:42.962368 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:42.963322 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:42.970342 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:42.971030 17448 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:42.967409 21873 raft_consensus.cc:697] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:42.971920 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:42.972540 17448 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:42.973338 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:42.978256 17454 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.920878 21697 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.972803 21873 consensus_queue.cc:237] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:42.958505 21755 raft_consensus.cc:697] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:42.990195 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:42.977552 21794 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.004809 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:43.007889 21784 consensus_queue.cc:237] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:43.010507 21864 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:19:43.012411 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.943686 21809 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.040758 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:43.043294 17450 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:43.010548 21865 log.cc:927] Time spent T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.199s	user 0.001s	sys 0.001s
I20260709 13:19:43.016144 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:43.021744 17600 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 13.
I20260709 13:19:43.011296 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:43.026872 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:43.047490 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.047686 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:42.976413 21811 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:42.817140 17348 rpcz_store.cc:269] 0709 13:19:05.542154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.543595 (+  1441us) service_pool.cc:224] Handling call
0709 13:19:42.757251 (+37213656us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:38.776090 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:38.814260 (+ 38170us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:38.814320 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:19:38.814340 (+    20us) tablet.cc:662] Decoding operations
0709 13:19:38.815320 (+   980us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:38.815413 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:38.815444 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:19:38.827301 (+ 11857us) tablet.cc:701] Row locks acquired
0709 13:19:38.830788 (+  3487us) write_op.cc:260] PREPARE: finished
0709 13:19:38.847033 (+ 16245us) write_op.cc:270] Start()
0709 13:19:38.858469 (+ 11436us) write_op.cc:276] Timestamp: P: 1783603178842369 usec, L: 0
0709 13:19:38.861303 (+  2834us) op_driver.cc:348] REPLICATION: starting
0709 13:19:39.121269 (+259966us) log.cc:844] Serialized 2482 byte log entry
0709 13:19:40.292202 (+1170933us) op_driver.cc:464] REPLICATION: finished
0709 13:19:40.506757 (+214555us) write_op.cc:301] APPLY: starting
0709 13:19:40.509719 (+  2962us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:40.632607 (+122888us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:40.632737 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:40.633402 (+   665us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:40.633656 (+   254us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:19:40.633702 (+    46us) write_op.cc:312] APPLY: finished
0709 13:19:40.633986 (+   284us) log.cc:844] Serialized 53 byte log entry
0709 13:19:40.634177 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:40.634282 (+   105us) write_op.cc:454] Released schema lock
0709 13:19:40.634341 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:40.634758 (+   417us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:40.634794 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1837290,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":191078,"apply.run_cpu_time_us":3750,"apply.run_wall_time_us":132244,"num_ops":6,"prepare.queue_time_us":684510,"prepare.run_cpu_time_us":65181,"prepare.run_wall_time_us":524666,"raft.queue_time_us":301975,"raft.run_cpu_time_us":18244,"raft.run_wall_time_us":146420,"replication_time_us":1421425,"thread_start_us":788263,"threads_started":4,"wal-append.queue_time_us":655336,"wal-append.run_cpu_time_us":63368,"wal-append.run_wall_time_us":2970987}]]}
W20260709 13:19:43.054515 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 63709.9us
W20260709 13:19:43.034322 21752 consensus_meta.cc:287] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.698s	user 0.012s	sys 0.000s
W20260709 13:19:43.058707 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 192480us
I20260709 13:19:43.059201 17520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
W20260709 13:19:43.046098 21729 consensus_meta.cc:287] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.004s
I20260709 13:19:43.062310 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:43.065361 17450 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:43.046897 21636 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:43.072947 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 61773.7us
I20260709 13:19:43.074496 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:43.016039 17454 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:42.989061 21870 consensus_queue.cc:1059] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:19:43.080920 17451 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:43.088192 17452 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:43.088706 17447 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:43.034737 21757 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:43.052565 21465 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.097705 17448 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:43.100620 17445 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:19:43.094760 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 90015.9us
W20260709 13:19:43.108412 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.060813 21811 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:43.112748 21859 log.cc:927] Time spent T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.316s	user 0.002s	sys 0.000s
W20260709 13:19:43.120859 21866 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.321s	user 0.002s	sys 0.000s
I20260709 13:19:43.123503 21723 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:43.121742 17446 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:43.128432 21779 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:43.128881 21779 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:43.129721 21779 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.130764 21779 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:43.130152 21331 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:43.131702 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 542) took 1736 ms. Trace:
I20260709 13:19:43.133397 21757 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:43.134126 21755 consensus_queue.cc:237] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.133849 17596 rpcz_store.cc:276] 0709 13:19:41.395729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.140910 (+745181us) service_pool.cc:224] Handling call
0709 13:19:42.141368 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:42.173381 (+ 32013us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:42.526799 (+353418us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.698484 (+171685us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:42.748661 (+ 50177us) log.cc:844] Serialized 52 byte log entry
0709 13:19:42.748831 (+   170us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:42.766531 (+ 17700us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.770466 (+  3935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.770545 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:42.931195 (+160650us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b180034d080. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a79557 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:19:43.131440 (+200245us) raft_consensus.cc:1685] finished
0709 13:19:43.131466 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.131616 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18725,"prepare.queue_time_us":204389,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":26159,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":2721,"spinlock_wait_cycles":4080768,"thread_start_us":483898,"threads_started":2,"wal-append.queue_time_us":248663}
W20260709 13:19:43.137358 21863 log.cc:927] Time spent T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.326s	user 0.002s	sys 0.000s
I20260709 13:19:43.137686 21331 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:43.140504 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1949) took 1208 ms. Trace:
I20260709 13:19:43.141026 17594 rpcz_store.cc:276] 0709 13:19:41.931663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.116193 (+184530us) service_pool.cc:224] Handling call
0709 13:19:43.140252 (+1024059us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b540027b0d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:43.140396 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":918103808}
I20260709 13:19:43.147588 21572 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:43.072650 21729 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:43.105806 21875 consensus_queue.cc:1059] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 13:19:43.158093 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 44033.5us
W20260709 13:19:43.154482 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.164951 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:43.168895 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.172710 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 108719us
I20260709 13:19:43.224792 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:43.217473 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 57196us
I20260709 13:19:43.231379 21165 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:43.245812 17596 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:43.140575 21809 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:43.266391 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.278936 17528 consensus_meta.cc:287] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 13:19:43.279588 17528 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
W20260709 13:19:43.283077 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 58401us
W20260709 13:19:43.253778 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 179393us
I20260709 13:19:43.290513 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:43.292260 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:43.233047 21880 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:43.218189 21754 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:43.321751 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:43.322106 21886 log.cc:927] Time spent T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:43.331641 17602 raft_consensus.cc:2393] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:43.293103 17600 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:43.326849 17495 connection.cc:256] RPC call timeout handler was delayed by -1.3537171259999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 13:19:43.331893 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:43.332402 17495 connection.cc:256] RPC call timeout handler was delayed by -1.3024171259999093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 13:19:43.332955 17495 connection.cc:256] RPC call timeout handler was delayed by -1.2961171259998991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
I20260709 13:19:43.219017 21636 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:43.339502 17529 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:43.276353 21790 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:43.287109 21822 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:43.344594 17569 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:43.291361 21749 consensus_queue.cc:1243] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:43.355127 17528 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:19:43.357677 17599 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:43.356422 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:43.339819 21744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.012s	sys 0.023s
I20260709 13:19:43.360055 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:43.370965 17526 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:43.371959 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 82234.5us
W20260709 13:19:43.344508 21817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.015s	sys 0.028s
I20260709 13:19:43.375223 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:43.375568 17525 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:19:43.362368 21887 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
W20260709 13:19:43.379736 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 56740.5us
I20260709 13:19:43.386328 17597 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.345088 21809 raft_consensus.cc:3055] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:43.339169 21880 raft_consensus.cc:697] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:43.377866 21757 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:43.390727 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.370941 21744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.013s	sys 0.023s
I20260709 13:19:43.398449 18197 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:43.400233 17597 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:43.391988 21757 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.366101 21373 raft_consensus.cc:2764] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:19:43.379259 21817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.016s	sys 0.028s
W20260709 13:19:43.394145 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.392606 21809 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:43.366840 21636 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.362538 21790 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:43.494305 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.496896 17600 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:43.420526 21697 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:43.520604 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.523015 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.534080 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 170490us
I20260709 13:19:43.394124 21754 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:43.537560 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 244886us
W20260709 13:19:43.545240 17495 connection.cc:256] RPC call timeout handler was delayed by -1.1926171259999592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 13:19:43.545822 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.524470 21811 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:43.552014 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.559616 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.560096 17495 connection.cc:256] RPC call timeout handler was delayed by -1.103704493000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
W20260709 13:19:43.560588 17495 connection.cc:256] RPC call timeout handler was delayed by -1.0495171259999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 13:19:43.561187 17495 connection.cc:256] RPC call timeout handler was delayed by -1.0378171259999363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
W20260709 13:19:43.561610 17495 connection.cc:256] RPC call timeout handler was delayed by -1.0369171259999348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 13:19:43.563794 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:43.564245 21754 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:43.565321 21794 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:43.566257 21636 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:43.566931 21749 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:43.567440 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:43.551620 21880 consensus_queue.cc:237] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.568621 21749 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:43.569154 21749 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:43.569617 21749 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.571509 17449 raft_consensus.cc:1240] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:43.572398 21897 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:43.573004 21897 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:43.578486 21861 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.780s	user 0.009s	sys 0.000s
W20260709 13:19:43.611824 17420 leader_election.cc:336] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.957s (SENT)
W20260709 13:19:43.613161 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.618422 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:43.556344 21902 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:43.605448 21382 consensus_queue.cc:1059] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:19:43.621482 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1941) took 1740 ms. Trace:
I20260709 13:19:43.581565 21811 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:43.552924 21729 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:43.556653 21900 consensus_queue.cc:1059] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:19:43.636718 21754 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:43.637094 21744 raft_consensus.cc:3055] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:43.632787 17595 rpcz_store.cc:276] 0709 13:19:41.892030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.215026 (+322996us) service_pool.cc:224] Handling call
0709 13:19:42.221639 (+  6613us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:42.266720 (+ 45081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.266768 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:42.300414 (+ 33646us) log.cc:844] Serialized 52 byte log entry
0709 13:19:42.736944 (+436530us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:42.766317 (+ 29373us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.766527 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.766605 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.577692 (+811087us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:43.618768 (+ 41076us) raft_consensus.cc:1685] finished
0709 13:19:43.621257 (+  2489us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.621419 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":609,"prepare.queue_time_us":32671,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":17474,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":4806,"spinlock_wait_cycles":4831104,"thread_start_us":389935,"threads_started":1,"wal-append.queue_time_us":465190}
I20260709 13:19:43.636281 21755 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:43.644215 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 76876.9us
I20260709 13:19:43.646492 21755 raft_consensus.cc:697] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:43.635152 21902 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.643482 21811 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:43.648861 21755 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.649923 21811 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:43.648857 21885 log.cc:927] Time spent T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 13:19:43.653952 21902 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:43.654743 21868 log.cc:927] Time spent T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.838s	user 0.009s	sys 0.004s
I20260709 13:19:43.655414 21699 raft_consensus.cc:3055] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:43.655941 21699 raft_consensus.cc:740] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:43.637672 21744 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:43.662155 21373 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.662832 21373 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.662889 21744 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.663867 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2455) took 1203 ms. Trace:
I20260709 13:19:43.664222 17524 rpcz_store.cc:276] 0709 13:19:42.460345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.466099 (+  5754us) service_pool.cc:224] Handling call
0709 13:19:42.466366 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.466715 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.466741 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.479936 (+ 13195us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.770841 (+290905us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:42.770879 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.770946 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.654085 (+883139us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:43.663602 (+  9517us) raft_consensus.cc:1685] finished
0709 13:19:43.663621 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.663810 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":430,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":44934,"spinlock_wait_cycles":20368256,"thread_start_us":219345,"threads_started":1,"wal-append.queue_time_us":274634}
I20260709 13:19:43.665198 21373 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:43.666630 21788 consensus_meta.cc:287] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.698s	user 0.011s	sys 0.000s
I20260709 13:19:43.666567 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:43.667127 21788 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.668292 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:43.669407 17568 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:43.670621 21373 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:43.670770 17523 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:43.671209 21373 raft_consensus.cc:697] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:43.671746 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:43.672390 17599 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:43.672204 21373 consensus_queue.cc:237] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.667559 17527 raft_consensus.cc:2410] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:19:43.678385 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 125133us
I20260709 13:19:43.679505 17569 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:43.680913 17569 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:43.681700 21331 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:43.682142 21331 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:43.638057 21809 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.682513 21331 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.682717 17495 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:43.637274 21754 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:43.683279 17523 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:43.683836 17520 raft_consensus.cc:606] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:43.684197 17520 raft_consensus.cc:614] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:43.684998 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2456) took 1201 ms. Trace:
I20260709 13:19:43.685096 21754 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:43.638190 21382 consensus_queue.cc:1243] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:43.637358 21790 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:43.685775 17523 rpcz_store.cc:276] 0709 13:19:42.483410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.483534 (+   124us) service_pool.cc:224] Handling call
0709 13:19:42.522705 (+ 39171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.670325 (+1147620us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b540040c020. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5adba1d 00007f5ab5ac21a4 00007f5ab5b44447 00007f5ab5b5cfe7 00007f5ab5b5e7de 00007f5ab5b68b49 00007f5ab5b69416 00007f5ab5b65d8f 00007f5ab5b6583e 00007f5abab2a419
0709 13:19:43.683731 (+ 13406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.684940 (+  1209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561245952}
I20260709 13:19:43.694432 17599 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
W20260709 13:19:43.698277 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.697739 21723 raft_consensus.cc:2764] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 13:19:43.796325 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 113667us
W20260709 13:19:43.808784 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.693081 21891 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:43.748780 21870 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:43.817595 17569 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:43.820495 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 208707us
I20260709 13:19:43.765278 21754 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:19:43.822678 21755 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.808274 21790 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:43.833706 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 323164us
I20260709 13:19:43.833958 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:43.834388 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.827255 21754 consensus_queue.cc:1243] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:43.835641 21909 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.839699 21891 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:43.852226 17523 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:43.853109 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:43.828102 21870 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.863513 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:43.860656 21902 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:43.865512 21779 consensus_meta.cc:287] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.734s	user 0.006s	sys 0.006s
I20260709 13:19:43.865458 21902 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.868033 21870 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:43.869087 21902 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:43.870069 21894 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.324s	user 0.002s	sys 0.001s
I20260709 13:19:43.870126 21909 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.871330 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:43.839321 21790 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.841388 21373 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:43.872709 21909 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:43.874297 21749 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.876638 21749 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:43.833077 21755 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:43.878472 21897 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:43.880308 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:43.880600 21903 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 13:19:43.880944 17524 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:43.881372 18167 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:43.882324 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 191063us
I20260709 13:19:43.883337 21729 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:43.883953 21729 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:43.884351 21744 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.884904 21729 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:43.885576 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:43.886230 17522 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.888893 21893 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:43.883281 17569 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:43.891047 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:43.841109 21788 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:43.893260 17524 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
W20260709 13:19:43.898128 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.898725 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.900388 17522 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
W20260709 13:19:43.902275 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.902506 18167 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:43.862660 21891 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:43.899567 21817 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:43.909991 17524 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:43.911758 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:43.910562 17522 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:43.912406 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:43.912807 17453 raft_consensus.cc:2410] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:19:43.902166 21750 raft_consensus.cc:2764] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:19:43.915529 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:43.906915 21909 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:19:43.918416 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:43.918934 21902 raft_consensus.cc:3055] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:43.919209 17446 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:43.902853 21897 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:43.913079 17525 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:43.925855 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:43.929563 21879 raft_consensus.cc:2804] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:43.910786 21817 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:43.929783 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:43.930531 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:43.931257 17448 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:43.930799 21817 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:43.932224 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 49081.8us
I20260709 13:19:43.932539 21817 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:43.934579 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 68e8e6dd889d4bcfabf84cedd079e2f2: Illegal state: Replica abf46e430b7e4ad4919ca2a717f37e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:43.936780 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:43.937347 17452 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:43.938200 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:43.941354 17451 raft_consensus.cc:1240] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:43.949615 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:43.958407 17453 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:43.908988 21907 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.989198 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:43.994328 17522 raft_consensus.cc:2393] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:44.001055 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:43.966188 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.924091 21902 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:43.910166 21891 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.003021 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:44.003813 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 64681.5us
I20260709 13:19:44.002725 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:44.002691 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:43.924265 21790 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:44.023422 17450 raft_consensus.cc:1240] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:19:43.925956 21897 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:19:44.037117 17420 leader_election.cc:336] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.581s (SENT)
I20260709 13:19:44.041571 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:43.911201 21842 consensus_queue.cc:1059] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:19:43.969290 21879 raft_consensus.cc:697] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:44.053030 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:44.054884 18196 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:44.053972 17528 raft_consensus.cc:3060] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.059000 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:43.967229 21909 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:19:44.065881 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:44.044548 21897 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:44.070475 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 50198us
I20260709 13:19:44.073112 17446 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:43.935559 21331 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:44.074070 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.053913 21790 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:44.078859 17528 raft_consensus.cc:2468] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
I20260709 13:19:44.083885 17523 raft_consensus.cc:1240] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:44.064476 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:44.092705 17568 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:44.093694 17568 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:44.095033 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 44636.9us
I20260709 13:19:44.097543 17522 pending_rounds.cc:85] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 6
I20260709 13:19:44.098148 17522 pending_rounds.cc:107] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:19:44.098393 17522 raft_consensus.cc:2889] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:44.023088 21907 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.108839 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:44.082858 21842 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:44.117059 21918 log.cc:927] Time spent T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:19:44.130980 21331 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:44.111950 21821 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:44.112293 21754 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:44.127066 21373 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.134519 21842 raft_consensus.cc:697] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:44.139849 21750 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:44.140951 21895 log.cc:927] Time spent T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.584s	user 0.001s	sys 0.002s
I20260709 13:19:44.148536 21373 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.175797 21809 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:44.176668 21373 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:44.177531 21373 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.178440 21821 raft_consensus.cc:697] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:44.134366 21749 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.136011 21879 consensus_queue.cc:237] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:44.150171 21842 consensus_queue.cc:237] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.158496 21750 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:44.161372 21465 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:44.135792 21331 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:44.180821 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 83712.1us
I20260709 13:19:44.179385 21821 consensus_queue.cc:237] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:44.183557 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:44.196645 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:44.198288 21788 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:44.202831 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:44.204669 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:44.201077 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:44.182209 21373 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.208276 21788 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:44.215579 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.225621 21788 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.233736 18195 raft_consensus.cc:2410] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:19:44.236408 17594 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:44.240231 21921 log.cc:927] Time spent T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:19:44.215628 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:44.200424 21687 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.257093 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60446 (request call id 21) took 1271 ms. Trace:
I20260709 13:19:44.257465 17520 rpcz_store.cc:276] 0709 13:19:42.989291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.989692 (+   401us) service_pool.cc:224] Handling call
0709 13:19:44.256883 (+1267191us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54003c00d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b60853 00007f5abab2e60a 00007f5ab40b47d4 00007f5ab40b4762 00007f5ab40b4691 00007f5ab40b460c 00007f5ab40b38c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:44.257011 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433943296}
I20260709 13:19:44.257490 21687 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.260088 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:44.261457 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:44.261660 21687 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:44.262169 18197 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:44.221217 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:44.185693 21900 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:19:44.256677 21929 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:44.194417 21331 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.263185 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:44.266294 21902 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.220886 21754 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:44.281343 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:44.281975 18201 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:44.281831 21754 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:44.273423 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.262360 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:44.285502 21331 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:44.290630 17520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:19:44.291260 17520 raft_consensus.cc:606] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:44.293524 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:44.295878 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:44.296826 17448 raft_consensus.cc:2410] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:19:44.297205 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:44.200242 21925 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 13:19:44.300551 21926 log.cc:927] Time spent T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:19:44.303122 21750 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:44.301903 21902 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:44.309008 21906 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.483s	user 0.000s	sys 0.002s
I20260709 13:19:44.310968 21687 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:44.311538 21687 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:44.312004 21687 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:44.316419 21907 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:44.319311 21875 raft_consensus.cc:3055] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:44.331964 21875 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:44.301898 21699 consensus_queue.cc:260] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:44.333068 21875 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.334183 21875 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.334291 21699 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.319990 21744 consensus_queue.cc:1059] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:44.323361 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.336143 21892 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:44.336704 21892 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:44.337134 21892 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.336156 21900 raft_consensus.cc:3055] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:44.339481 21900 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:44.340610 21900 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:44.352173 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.352684 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.353155 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.331037 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 115502us
W20260709 13:19:44.354460 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.362157 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:44.364531 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:44.371711 17452 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:44.367499 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:44.377496 17449 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:44.371717 17594 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:19:44.378902 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 176463us
W20260709 13:19:44.368331 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.366233 17524 raft_consensus.cc:1240] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:44.382718 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.329936 18201 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:44.385736 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:44.386662 17447 raft_consensus.cc:2376] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11. Re-sending same reply.
I20260709 13:19:44.388387 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:44.389492 17450 raft_consensus.cc:2410] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:44.365563 21900 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.392861 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:44.399315 17446 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
W20260709 13:19:44.393613 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.394554 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.395407 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:44.365207 21744 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:44.366040 21465 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.397495 17527 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:44.404291 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:44.403440 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.407882 17449 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.406209 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.409330 17524 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:44.415068 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.415724 17528 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
W20260709 13:19:44.419945 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 54489.3us
I20260709 13:19:44.422668 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:44.424984 17526 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:44.410795 21744 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:44.432928 17595 raft_consensus.cc:2955] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 2 to 8, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:44.434264 21744 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:44.437255 21755 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:44.439191 17449 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:44.430188 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:44.449692 17526 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:44.454329 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:44.455566 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.456347 17601 raft_consensus.cc:2368] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11.
I20260709 13:19:44.458168 17528 raft_consensus.cc:3055] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:44.458627 17528 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:44.422232 21907 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.420939 21880 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:44.466952 21749 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:44.468611 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:44.471766 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.474694 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:44.479806 21373 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:44.424207 21465 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:44.481464 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.482445 17449 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:19:44.491201 17449 pending_rounds.cc:85] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 7
I20260709 13:19:44.491483 17449 pending_rounds.cc:107] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:19:44.491724 17449 raft_consensus.cc:2889] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:44.482990 17450 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:44.491917 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.484602 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.488193 17524 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:44.493108 17526 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:44.488461 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:44.483817 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.459563 17528 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:44.496114 17528 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:44.505654 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:44.506379 17601 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 8.
I20260709 13:19:44.511605 17599 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:44.511801 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:44.512569 17603 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:44.517669 18194 raft_consensus.cc:2410] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:44.518545 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:44.519464 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.521142 17522 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:44.522168 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.451489 21165 consensus_queue.cc:1059] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:19:44.524834 17528 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:19:44.527112 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:44.528096 17599 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:44.528337 17528 pending_rounds.cc:85] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 10
I20260709 13:19:44.529407 17525 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:19:44.529822 17525 pending_rounds.cc:85] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 6
I20260709 13:19:44.529647 17528 pending_rounds.cc:107] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:19:44.530323 17525 pending_rounds.cc:107] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:19:44.508630 21755 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.530630 17525 raft_consensus.cc:2889] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:44.530640 17528 raft_consensus.cc:2889] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:44.532630 17419 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:44.533907 17419 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:44.528646 21754 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:44.540194 21754 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.540272 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:44.540807 21754 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:44.541272 17449 raft_consensus.cc:2410] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:44.535858 21897 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.545594 21897 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:44.517073 21788 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.495203 21907 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:44.553517 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.538923 21755 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.554495 21790 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:44.556608 21755 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:44.557890 21465 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:44.521005 21880 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:44.560561 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:44.562105 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.562139 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:44.563131 17528 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:44.552585 21788 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:44.743681 21907 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:44.744264 21940 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.191s	user 0.002s	sys 0.016s
I20260709 13:19:44.551858 21811 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:44.536904 21744 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:44.759429 21939 log.cc:927] Time spent T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:19:44.527643 21879 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.235s
I20260709 13:19:44.764045 21811 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.536391 21165 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.235s
I20260709 13:19:44.534829 21784 consensus_queue.cc:1059] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.234s
I20260709 13:19:44.770148 21744 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.784497 21811 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:44.786091 21784 raft_consensus.cc:3055] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:44.786607 21784 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:44.787559 21784 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.788681 21784 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.790798 21276 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:44.786134 21744 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:44.793093 21891 consensus_meta.cc:287] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.749s	user 0.007s	sys 0.004s
I20260709 13:19:44.793493 21891 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.797549 21891 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:44.804255 21892 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:44.805580 21811 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.578409 21687 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.807358 21811 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:44.804709 21744 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.808992 21744 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:44.808846 21687 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:44.820942 21754 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:44.935580 21892 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:44.967272 21951 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:19:44.967967 21817 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:44.968374 21754 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:44.968576 21817 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:44.971253 21817 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:44.972572 21900 consensus_meta.cc:287] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.004s
W20260709 13:19:44.976974 21875 consensus_meta.cc:287] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.642s	user 0.006s	sys 0.006s
W20260709 13:19:44.979526 21948 log.cc:927] Time spent T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.147s	user 0.007s	sys 0.013s
W20260709 13:19:45.016224 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.019109 21373 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:45.019841 21373 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.022316 21373 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:45.039826 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:45.040709 17526 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:45.050904 17599 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:45.053989 17601 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:45.057118 17594 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:45.062388 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.063822 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:45.064670 17601 raft_consensus.cc:2368] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13.
I20260709 13:19:45.068784 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.070858 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.072455 17594 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:45.073936 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.078284 17594 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:45.078832 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:45.077771 17599 raft_consensus.cc:1240] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:45.079422 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.080538 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.079452 17601 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:19:45.095072 17453 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.014s	sys 0.052s
W20260709 13:19:45.095516 17453 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.014s	sys 0.052s
I20260709 13:19:45.097451 17601 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:45.098681 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:45.081286 17599 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:45.099627 17601 raft_consensus.cc:2368] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11.
I20260709 13:19:45.099835 17521 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:45.100459 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.100694 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.106607 17601 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:45.107583 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.108129 17601 raft_consensus.cc:2376] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10. Re-sending same reply.
I20260709 13:19:45.108968 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.101069 17599 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:45.110767 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.111931 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.081315 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.113711 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.114850 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.115389 17594 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:45.116209 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.117250 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.121774 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.123335 21373 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.126845 21373 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.123433 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.123857 21754 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:45.230798 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.231410 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.123998 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.125144 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.230633 21900 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:45.292430 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.292613 21900 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.125031 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.293717 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.294749 21934 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:45.295008 21900 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:45.295243 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 171873us
I20260709 13:19:45.294719 17601 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:45.296831 17569 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.297119 17601 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:45.297681 21934 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:45.297847 17599 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:45.297480 17594 raft_consensus.cc:2410] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:19:45.299268 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:45.300076 21934 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:45.301964 17601 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:45.303483 17528 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:45.311580 17528 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:45.316982 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.319957 17601 raft_consensus.cc:2393] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:45.361761 17451 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:19:45.362607 17451 pending_rounds.cc:85] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 8
I20260709 13:19:45.362905 17451 pending_rounds.cc:107] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:19:45.363197 17451 raft_consensus.cc:2889] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:45.377010 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.379644 17420 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.380020 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:45.380649 17594 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:45.381102 17447 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.011s	sys 0.018s
W20260709 13:19:45.381616 17447 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.011s	sys 0.018s
I20260709 13:19:45.386581 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:45.387591 17599 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.393532 21960 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.395646 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.395834 21960 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.394759 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.396836 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.397400 17602 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:19:45.395193 17420 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.397878 21960 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:45.398494 21960 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:45.399829 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.400297 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.402340 17594 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:45.404047 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:45.405318 17599 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:19:45.411885 21276 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:19:45.424384 17495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.013s	sys 0.008s
W20260709 13:19:45.433276 17495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.013s	sys 0.012s
W20260709 13:19:45.434412 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 945935us
I20260709 13:19:45.436223 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:45.447407 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2481) took 1480 ms. Trace:
I20260709 13:19:45.452811 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:45.460762 17453 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:45.460445 17525 rpcz_store.cc:276] 0709 13:19:43.967400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.967695 (+   295us) service_pool.cc:224] Handling call
0709 13:19:43.968071 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.532780 (+564709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.447007 (+914227us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54002c9054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:45.447291 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290209024}
I20260709 13:19:45.454701 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:45.461800 17451 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:45.453336 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:45.462205 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:45.456095 21788 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:45.455929 17447 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:45.463166 21788 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.457564 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:45.463712 21788 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.464169 17454 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
W20260709 13:19:45.461234 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.456933 17449 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:45.463186 17451 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:45.465893 21788 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:45.473474 21723 raft_consensus.cc:3055] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:45.474121 21723 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:45.480933 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:45.475241 21723 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.485415 21723 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:45.496726 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:45.498080 17449 raft_consensus.cc:2393] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 14: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:45.481927 17451 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:45.503829 17454 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:45.437763 17495 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:45.508410 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:45.509315 17454 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
W20260709 13:19:45.511811 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 74160us
I20260709 13:19:45.513928 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:45.498193 21373 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:45.520234 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 47039.8us
I20260709 13:19:45.518815 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:45.519639 21892 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:45.521332 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:45.522841 17451 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.523150 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:45.528258 17451 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:45.515337 21880 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:45.512428 21960 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.522539 21892 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:45.531368 21892 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:45.531407 17450 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:45.532445 21960 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:45.532968 21960 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.530345 21879 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.537328 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:45.537802 21879 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:45.540122 21879 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:45.536973 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:45.541584 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.542326 17594 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 13.
I20260709 13:19:45.537972 17451 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:45.544126 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:45.547510 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:45.548907 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.551143 17569 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.551306 21755 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:45.552083 21821 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:45.554365 21832 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:45.554831 21832 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.555181 21832 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.556002 17454 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:45.542377 21960 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.559544 21880 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:45.560688 21960 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:45.560904 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet ec32c18bcdaa4eca99f08bba98bb1e0e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:45.561995 21788 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:45.563005 21880 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:45.567111 21821 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:45.566866 21832 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:45.563293 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:45.568415 21880 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:45.568878 21880 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:45.569327 21880 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.572081 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:45.574863 21879 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.575577 21811 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:45.578533 17523 raft_consensus.cc:1275] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:45.579155 17568 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:45.579890 21572 raft_consensus.cc:2764] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:19:45.580624 21971 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:45.581099 21971 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:45.581554 21971 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.581773 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:45.583580 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:45.583647 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:45.584692 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:45.584738 17523 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.586395 17568 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:45.587442 17568 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:45.588178 21821 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:45.588521 21723 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:45.588799 21755 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:45.588601 21821 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.589785 21821 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.589126 21723 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.590796 21723 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:45.586719 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:45.595007 17521 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:19:45.597425 21934 consensus_queue.cc:1059] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:45.597499 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:45.599375 21755 raft_consensus.cc:3055] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:45.600629 21755 raft_consensus.cc:740] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:45.601831 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.601461 21755 consensus_queue.cc:260] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.602939 21755 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:45.609035 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 213889us
I20260709 13:19:45.609045 17521 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:45.575098 21276 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.614253 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.615896 17523 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:45.617692 21744 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:45.605962 21723 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.620060 17420 leader_election.cc:400] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13.
I20260709 13:19:45.620465 21723 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:45.621901 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.576030 21879 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:45.619958 17523 raft_consensus.cc:1240] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:45.626842 17523 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:45.628307 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 56319.7us
I20260709 13:19:45.629288 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:45.570855 21892 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.626256 17568 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:45.630074 21276 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:45.630909 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:45.632323 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:45.633141 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 74984us
I20260709 13:19:45.634642 17569 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.633839 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:45.635861 17523 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:45.637499 17420 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.639010 17420 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.643091 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:45.646826 17420 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.647490 21811 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:45.640415 21821 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:45.647929 21811 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.648306 21811 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:44.558938 17419 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:45.649492 21821 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:45.641332 21832 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:45.627715 21723 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:19:45.649981 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 1.091e+06us
I20260709 13:19:45.652679 17528 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:45.655131 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 659) took 1236 ms. Trace:
I20260709 13:19:45.659582 17520 rpcz_store.cc:276] 0709 13:19:44.418906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.419118 (+   212us) service_pool.cc:224] Handling call
0709 13:19:44.431616 (+ 12498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.510775 (+ 79159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:44.510806 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:44.510853 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:44.510884 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.654834 (+1143950us) spinlock_profiling.cc:243] Waited 79 ms on lock 0x7b5400414954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:45.654899 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.655056 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181628672}
I20260709 13:19:45.670854 17528 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:19:45.676383 17445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.191s	user 0.015s	sys 0.011s
W20260709 13:19:45.676929 17445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.015s	sys 0.011s
W20260709 13:19:45.679170 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 91202.1us
I20260709 13:19:45.680156 18166 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.683898 21975 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:45.685338 21975 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:45.686586 21276 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:45.675529 21723 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:45.687700 21723 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.688027 21723 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.688477 21784 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:45.689203 21784 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:45.689534 21784 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.685770 21975 raft_consensus.cc:697] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:45.689860 21784 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:45.690702 21975 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.695569 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:45.696120 17454 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:45.698487 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2266) took 1194 ms. Trace:
I20260709 13:19:45.653717 21892 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:45.699043 17445 rpcz_store.cc:276] 0709 13:19:44.483582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.483710 (+   128us) service_pool.cc:224] Handling call
0709 13:19:44.484066 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:44.484526 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:44.484563 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:44.485189 (+   626us) log.cc:844] Serialized 52 byte log entry
0709 13:19:45.677384 (+1192195us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:45.677440 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.677537 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.677593 (+    56us) raft_consensus.cc:1685] finished
0709 13:19:45.677610 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.677762 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3137,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":13094,"thread_start_us":1191752,"threads_started":1,"wal-append.queue_time_us":330970}
I20260709 13:19:45.659816 21961 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:45.702126 21788 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:45.705037 21880 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.668185 17523 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:45.682351 21744 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:45.708837 18167 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:45.683053 21969 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:45.706398 21276 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:45.726099 21969 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:45.730396 21969 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.731698 21961 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:45.732278 21961 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:45.732604 21961 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:45.733393 21755 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:45.734997 17521 raft_consensus.cc:1240] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:45.736208 21880 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:45.737335 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.737627 21879 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:45.738435 17448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.179s	user 0.013s	sys 0.015s
W20260709 13:19:45.738867 17448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.013s	sys 0.016s
I20260709 13:19:45.739349 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.739807 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2255) took 1363 ms. Trace:
I20260709 13:19:45.713830 21788 raft_consensus.cc:697] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:45.740890 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.740320 17448 rpcz_store.cc:276] 0709 13:19:44.376650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.376766 (+   116us) service_pool.cc:224] Handling call
0709 13:19:44.390747 (+ 13981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.406887 (+ 16140us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:44.505060 (+ 98173us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.739355 (+1234295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.739431 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:45.739502 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.739587 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.739738 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":363019,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":1152,"thread_start_us":1290957,"threads_started":2,"wal-append.queue_time_us":294831}
W20260709 13:19:45.749571 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 93002.8us
I20260709 13:19:45.749315 21723 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.754401 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:45.755311 21723 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:45.748656 21971 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.742322 21788 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.751816 21968 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:45.758515 21968 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.758673 21971 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:45.759351 21968 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:45.759756 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 128830us
I20260709 13:19:45.760989 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:45.761590 17523 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.761858 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:45.763429 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 128888us
I20260709 13:19:45.767428 17568 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:45.769064 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:45.772782 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:45.773712 17523 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:19:45.775139 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:45.767807 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.776619 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:45.766764 21165 consensus_queue.cc:1059] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:19:45.779072 17569 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:45.780835 21983 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:19:45.780864 21811 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:45.795723 21981 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:45.797781 21981 raft_consensus.cc:697] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:45.798770 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.799510 21880 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.798822 21981 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.799997 21880 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:45.802845 21755 raft_consensus.cc:3055] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:45.749814 21974 consensus_queue.cc:1048] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:19:45.810935 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:45.811533 17598 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:19:45.812724 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 180465us
I20260709 13:19:45.813452 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:45.813833 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:45.814575 17527 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.821645 17419 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:45.835634 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:45.836751 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.797504 21811 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:45.802007 21880 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:45.838420 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:45.809998 21755 raft_consensus.cc:740] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:45.767781 21723 consensus_queue.cc:1059] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:19:45.830226 21821 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:45.837291 21980 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:19:45.862228 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.853173 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 47608.1us
I20260709 13:19:45.862715 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:45.875531 17527 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
W20260709 13:19:45.881727 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 172992us
I20260709 13:19:45.881927 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:45.855078 21276 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:45.854800 21811 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:45.859735 21821 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:45.881446 21892 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:45.917635 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 84404.2us
I20260709 13:19:45.905475 21687 raft_consensus.cc:3055] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:45.938185 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:45.940927 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 294161us
I20260709 13:19:45.945305 17419 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:45.946535 17420 leader_election.cc:400] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11.
I20260709 13:19:45.908362 21980 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:45.941869 17495 connection.cc:256] RPC call timeout handler was delayed by -1.155461589999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
I20260709 13:19:45.948768 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:45.951238 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:45.946969 21687 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:45.909677 21977 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.905118 21969 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:45.941821 21821 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:45.981976 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 115333us
I20260709 13:19:46.021477 17420 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.022403 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:46.037187 17596 raft_consensus.cc:2410] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:46.023168 17598 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 15.
I20260709 13:19:46.037292 17600 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:45.946134 21811 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:46.039475 17569 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.044494 17600 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:45.937075 21979 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:19:45.952668 21892 raft_consensus.cc:697] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:46.047647 17598 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:46.048527 21892 consensus_queue.cc:237] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:46.049110 17529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.491s	user 0.005s	sys 0.009s
I20260709 13:19:46.049346 21998 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:46.049943 22002 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.050089 21998 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:46.025770 21978 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:46.040057 21984 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.157s	user 0.000s	sys 0.007s
I20260709 13:19:45.936211 21755 consensus_queue.cc:260] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:46.044350 18167 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.071347 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:46.049428 17529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.491s	user 0.005s	sys 0.009s
I20260709 13:19:46.072487 17529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2489) took 1568 ms. Trace:
I20260709 13:19:45.945294 17527 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 7.
I20260709 13:19:46.066800 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:46.068939 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 123753us
I20260709 13:19:46.073680 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:46.074385 17598 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.074853 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:46.075487 17527 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
I20260709 13:19:46.077878 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:46.079030 17599 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:46.081840 17597 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 15. Ops: []
I20260709 13:19:46.072839 17529 rpcz_store.cc:276] 0709 13:19:44.503673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.503806 (+   133us) service_pool.cc:224] Handling call
0709 13:19:44.504216 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:44.504607 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:44.504643 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:44.530928 (+ 26285us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.072103 (+1541175us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:46.072146 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.072215 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.072268 (+    53us) raft_consensus.cc:1685] finished
0709 13:19:46.072284 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.072428 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5885,"raft.queue_time_us":3989,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4344,"thread_start_us":1513756,"threads_started":1,"wal-append.queue_time_us":276973,"wal-append.run_cpu_time_us":8792,"wal-append.run_wall_time_us":1185605}
I20260709 13:19:46.072729 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:46.082563 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:46.083607 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:46.090422 17599 raft_consensus.cc:2393] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:46.092433 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.091341 17598 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:46.094416 17597 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:46.094523 17569 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.080927 21982 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:46.112329 21995 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:19:46.112782 21998 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:46.112692 21982 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:46.114297 22000 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:46.115017 21982 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:46.116748 21994 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:19:46.081916 21978 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:46.114351 21990 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:19:46.115049 22000 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:46.120194 21978 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:46.100698 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:46.098007 21988 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:46.114440 17525 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:46.111913 21934 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:46.081715 21880 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:46.124737 17603 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:46.155804 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:46.098636 21276 raft_consensus.cc:2804] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:46.095902 21992 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:46.098969 21975 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:46.183161 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 231977us
I20260709 13:19:46.180306 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:46.035575 21977 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:46.185588 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:46.121731 21981 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:46.095695 21983 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:19:46.107977 21979 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:46.086848 21961 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:46.186685 21962 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:46.094262 21997 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:19:46.162283 21999 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:46.218529 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:46.105847 21980 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:46.219204 22006 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:46.218305 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:46.174172 21993 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.214401 21276 raft_consensus.cc:697] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:46.161741 21978 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:46.218955 21892 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:46.233409 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:46.222443 21979 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:46.234869 21999 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.234946 17596 raft_consensus.cc:2368] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13.
I20260709 13:19:46.236089 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:46.236334 22006 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:46.223080 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 201687us
I20260709 13:19:46.230189 17597 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
W20260709 13:19:46.237221 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 110070us
I20260709 13:19:46.472574 17598 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:46.248730 21993 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:46.253306 17599 raft_consensus.cc:1275] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:46.099416 21687 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:46.256851 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:46.419389 17446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.887s	user 0.009s	sys 0.032s
I20260709 13:19:46.254410 22003 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:46.307951 17624 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff5a0 after lost signal to thread 16332
I20260709 13:19:46.217998 21992 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:46.264292 21979 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:46.370965 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 136137us
I20260709 13:19:46.284214 21978 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:46.337417 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.390600 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 90750.4us
I20260709 13:19:46.264429 21892 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:46.450565 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.161707 21811 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:46.386359 21276 consensus_queue.cc:237] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:46.154779 22000 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:46.284884 21934 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:19:46.479487 21998 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.279445 21999 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.475732 22012 consensus_queue.cc:1059] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:19:46.468992 22009 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.214s	user 0.005s	sys 0.000s
I20260709 13:19:46.483717 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:46.485603 17420 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:46.486094 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.486371 17446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.954s	user 0.009s	sys 0.040s
I20260709 13:19:46.487620 17569 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.477334 22006 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:46.471891 21784 consensus_meta.cc:287] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.781s	user 0.014s	sys 0.014s
I20260709 13:19:46.350371 21165 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:19:46.476516 21977 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:46.501348 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:46.516901 17599 raft_consensus.cc:2368] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14.
I20260709 13:19:46.502079 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:46.488370 21969 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:46.501511 21968 consensus_meta.cc:287] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.003s
I20260709 13:19:46.519263 17420 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.494184 21993 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.524464 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.530448 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:46.530612 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:46.534047 17525 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:46.494712 21821 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:46.553196 17569 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.555200 17420 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.557101 17525 raft_consensus.cc:1240] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:46.502651 21998 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:46.491468 22003 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:46.534781 21997 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:46.522423 21784 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:46.612284 21784 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:46.612880 21784 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.535429 21993 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:46.615854 21993 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:46.532578 21968 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:46.618290 22013 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:46.619189 21968 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:46.621008 21978 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:46.586562 22010 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:19:46.561215 22026 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:46.605242 22016 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:46.605832 21892 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:46.609160 22003 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:46.629266 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:46.568806 21961 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:46.638563 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:46.580065 21934 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:46.643070 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:46.529368 22015 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:19:46.641310 17596 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:46.643126 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:46.568361 22021 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:46.644873 17525 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:46.649516 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:46.649673 21992 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:46.652201 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:46.652323 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:46.652995 18198 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:46.653299 17602 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:46.653879 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:46.656546 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:46.662343 21961 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:46.663195 21821 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:46.627406 22026 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.672508 18167 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.676497 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:46.677196 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:46.672334 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:46.646499 21934 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:46.705621 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:46.702653 17529 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
W20260709 13:19:46.689080 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 133321us
W20260709 13:19:46.706544 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 151440us
I20260709 13:19:46.710388 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.711756 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:46.712931 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:46.715083 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:46.716032 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:46.717085 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2260) took 2293 ms. Trace:
I20260709 13:19:46.717387 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:46.696065 22015 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.721047 17448 raft_consensus.cc:2393] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:46.722326 17495 leader_election.cc:400] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13.
I20260709 13:19:46.722656 17495 leader_election.cc:403] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:46.717006 21784 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:46.723157 17420 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.724327 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:46.725070 17520 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.726472 17495 leader_election.cc:400] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14.
I20260709 13:19:46.726910 17495 leader_election.cc:403] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:46.705718 22026 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.730499 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:46.732427 22022 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.711251 21934 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.729048 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:46.643903 22016 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:46.737304 21968 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.696219 21978 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:19:46.714157 21980 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:19:46.691949 21892 consensus_queue.cc:1059] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:19:46.718180 17446 rpcz_store.cc:276] 0709 13:19:44.424961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.425078 (+   117us) service_pool.cc:224] Handling call
0709 13:19:44.447399 (+ 22321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:44.458116 (+ 10717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:44.458148 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:44.501154 (+ 43006us) log.cc:844] Serialized 52 byte log entry
0709 13:19:46.508303 (+2007149us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:46.622721 (+114418us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.716682 (+ 93961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.716816 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.716875 (+    59us) raft_consensus.cc:1685] finished
0709 13:19:46.716889 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.717018 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1271,"prepare.queue_time_us":164174,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":11844,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":4422,"thread_start_us":2175277,"threads_started":3,"wal-append.queue_time_us":320426,"wal-append.run_cpu_time_us":9134,"wal-append.run_wall_time_us":1136021}
W20260709 13:19:46.823704 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 100919us
I20260709 13:19:46.734450 21970 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:19:46.732856 22024 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:46.733557 22014 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:19:46.717944 21875 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:46.731666 17454 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:46.702747 22003 consensus_queue.cc:1059] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:19:46.718005 21998 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:46.718138 21960 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:46.701808 21961 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:46.669999 21999 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:46.721199 22012 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:46.819562 18196 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:46.887101 17520 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:46.820164 17450 raft_consensus.cc:2410] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:19:46.821079 21995 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:46.729110 22015 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:46.713550 22007 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:19:46.894560 22003 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14.
I20260709 13:19:46.729887 22021 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:46.730345 21969 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13.
I20260709 13:19:46.824720 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:46.895581 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 169218us
W20260709 13:19:46.896054 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 71556us
I20260709 13:19:46.896541 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:46.838016 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:46.828536 18200 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 8.
W20260709 13:19:46.821797 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 111016us
I20260709 13:19:46.898291 17446 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:46.826331 21992 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:46.901366 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:46.904650 17595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.404s	user 0.011s	sys 0.015s
W20260709 13:19:46.905049 17595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.404s	user 0.012s	sys 0.016s
I20260709 13:19:46.905795 18166 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:46.906486 18197 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:46.917943 17596 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:46.918646 22023 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:46.919240 22023 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:46.919703 22023 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.922868 21969 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:46.924389 22016 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:46.930354 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.952631 17454 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:19:46.954213 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:46.955060 17520 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:46.821581 22022 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:46.980687 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.924927 21969 consensus_queue.cc:1059] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:19:46.906209 21784 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:46.905524 22012 raft_consensus.cc:697] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:46.826467 21979 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.001691 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:47.005338 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 108647us
I20260709 13:19:47.007396 17420 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.953330 21998 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:46.952064 22000 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:47.009543 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:46.957592 22024 raft_consensus.cc:697] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:47.033514 17446 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:19:47.018721 21998 raft_consensus.cc:697] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:47.040632 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:47.045212 22038 log.cc:927] Time spent T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:19:47.050357 22012 consensus_queue.cc:237] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:47.054625 22036 log.cc:927] Time spent T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
W20260709 13:19:47.055583 22035 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 13:19:47.056735 22033 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:19:47.058053 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:47.058689 17520 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:47.063434 22037 log.cc:927] Time spent T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:19:47.066758 22044 raft_consensus.cc:3055] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:47.067401 22044 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:47.068567 22044 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.071720 21979 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:47.074862 21961 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:47.056770 21999 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:47.064766 22015 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:47.082456 22022 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:47.085201 22000 consensus_queue.cc:1059] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:19:46.986965 22006 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.086877 17601 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:47.088187 22006 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:47.028784 21784 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:47.090039 22024 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.101312 17520 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 13.
I20260709 13:19:47.097672 22044 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.109889 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:47.117440 22016 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:47.119814 22016 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:47.122179 21934 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.123342 17598 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.124241 21986 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:47.126379 22016 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.129079 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:47.129841 17523 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:47.126698 22023 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.128840 22000 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:47.132735 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 92229.4us
I20260709 13:19:47.139688 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.140918 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.131887 21934 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:47.145215 17420 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:47.138337 21811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.004s
W20260709 13:19:47.151050 21811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.008s	sys 0.004s
I20260709 13:19:47.154520 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.154964 21811 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.155758 21811 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:47.156446 21811 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.155999 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:47.164732 17420 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.146013 21960 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:47.131258 22026 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.138085 21900 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:19:47.135281 22000 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.191282 17594 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:47.139314 21998 consensus_queue.cc:237] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.200476 22013 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:47.186506 21961 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:47.211334 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 46704.5us
I20260709 13:19:47.239312 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.191352 22055 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.241457 22055 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:47.244910 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:47.246400 22058 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.247437 17420 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.68:36313 timed out after 1.952s (SENT) [suppressed 15 similar messages]
I20260709 13:19:47.200978 21960 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:47.249972 22055 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.247519 21992 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:47.263504 22057 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.264272 22057 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.251782 21961 raft_consensus.cc:697] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:47.268606 21961 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.274192 22023 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:47.253731 22055 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.282248 22023 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:47.283155 22000 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:47.260538 22058 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.286872 22058 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:47.281484 22055 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:47.288826 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:47.292662 22026 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:47.295208 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:47.296423 22057 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:47.296936 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:47.314589 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 67198.7us
I20260709 13:19:47.317250 22057 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:47.317840 22057 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.320024 22057 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:47.320551 17420 connection.cc:256] RPC call timeout handler was delayed by -1.1695950150001408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
I20260709 13:19:47.320696 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:47.321225 21961 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:47.321422 17420 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.321518 17520 raft_consensus.cc:2393] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:47.321727 21961 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.322595 22057 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.323853 21961 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:47.322198 22059 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.324141 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.324565 22059 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.282852 22023 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.326169 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:47.326444 22025 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.721s	user 0.013s	sys 0.016s
I20260709 13:19:47.326763 17447 raft_consensus.cc:2376] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11. Re-sending same reply.
I20260709 13:19:47.327175 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.327782 17450 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
W20260709 13:19:47.328073 18194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42538 (request call id 398) took 4105 ms (client timeout 1952 ms). Trace:
I20260709 13:19:47.334048 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.334237 17448 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:47.334335 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:47.328505 18194 rpcz_store.cc:269] 0709 13:19:43.222562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.222747 (+   185us) service_pool.cc:224] Handling call
0709 13:19:43.890912 (+668165us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800003c98. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab2a41b71 00007f5ab2a41a22 00007f5abb95ac09 00007f5abaab4ee0 00007f5abab7e0ab 00007f5abab7e131 00007f5abab2c0a0 00007f5abab2b984 00007f5ab40a66d4 00007f5ab40a6662
0709 13:19:47.327848 (+3436936us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b54003fded4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:47.328000 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1467359360}
I20260709 13:19:47.335654 17446 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:47.335881 17454 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:47.336669 17450 raft_consensus.cc:2368] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12.
I20260709 13:19:47.321808 21811 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.340660 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.342404 17450 raft_consensus.cc:2368] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13.
I20260709 13:19:47.344558 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:47.345240 17520 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:47.345539 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.345955 17450 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.346993 22059 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:47.348878 22007 raft_consensus.cc:3055] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:47.349309 22007 raft_consensus.cc:740] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:47.350180 22007 consensus_queue.cc:260] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.351600 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.351814 22023 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:47.352744 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.348835 17449 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
W20260709 13:19:47.353757 17624 debug-util.cc:398] Leaking SignalData structure 0x7b08000d00c0 after lost signal to thread 17386
I20260709 13:19:47.355178 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2264) took 2873 ms. Trace:
I20260709 13:19:47.355580 17452 rpcz_store.cc:276] 0709 13:19:44.481703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.481866 (+   163us) service_pool.cc:224] Handling call
0709 13:19:44.482266 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:44.482755 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:44.482796 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:44.483444 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.560351 (+ 76907us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:44.560390 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.560456 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.354901 (+2794445us) raft_consensus.cc:1685] finished
0709 13:19:47.354929 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.355105 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3017,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":12326,"thread_start_us":76541,"threads_started":1,"wal-append.queue_time_us":356873,"wal-append.run_cpu_time_us":22032,"wal-append.run_wall_time_us":1171956}
I20260709 13:19:47.362636 17446 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:47.364729 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.365321 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.366009 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.367048 17454 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15. Ops: [13.7-14.8]
I20260709 13:19:47.365398 17452 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.368140 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.368930 22023 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:47.369339 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.370894 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.371721 17446 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.371040 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.367215 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.374280 17449 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.369498 22023 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.377615 22023 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:47.374513 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.382233 17450 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:47.382885 17452 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:47.388156 17447 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:47.390715 17446 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:47.392238 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.392695 17446 raft_consensus.cc:1275] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:47.398455 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.406353 21811 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:47.395978 22008 log.cc:927] Time spent T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.917s	user 0.000s	sys 0.001s
I20260709 13:19:47.407253 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:47.404124 17447 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:47.393481 17454 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:47.408896 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.001s	sys 0.014s
I20260709 13:19:47.402309 17449 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:47.411778 17450 raft_consensus.cc:1240] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:47.412339 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.002s	sys 0.014s
I20260709 13:19:47.415165 17450 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:47.418164 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:47.422690 22005 raft_consensus.cc:3055] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:47.423151 22005 raft_consensus.cc:740] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:47.423946 22005 consensus_queue.cc:260] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.425192 22005 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.425405 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:47.426703 22014 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:47.427088 22051 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.239s	user 0.004s	sys 0.000s
I20260709 13:19:47.427405 22014 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:47.428341 22014 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.430248 17450 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:47.430446 22023 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:47.431810 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.432469 17450 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:47.432070 22023 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:47.433570 17495 leader_election.cc:400] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12.
I20260709 13:19:47.433909 17495 leader_election.cc:403] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:47.434437 22044 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12.
I20260709 13:19:47.434921 17495 leader_election.cc:400] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13.
I20260709 13:19:47.435250 17495 leader_election.cc:403] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:47.434134 22023 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:47.435765 22044 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13.
I20260709 13:19:47.436172 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:47.436806 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:47.437382 22044 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:47.437671 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:47.437827 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:47.438460 22044 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:47.438871 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:47.438992 22044 raft_consensus.cc:697] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:47.439872 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:47.444005 17520 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:47.444491 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:47.445928 17524 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:47.442253 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.441571 22014 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.447903 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:47.440045 22044 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.449717 22014 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:47.439988 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:46.224031 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:47.456306 22019 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.877s	user 0.001s	sys 0.001s
I20260709 13:19:47.457562 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2523) took 1629 ms. Trace:
I20260709 13:19:47.457908 22023 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:47.458782 22024 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:47.459141 22024 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:47.459952 22024 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.460911 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.461443 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2507) took 1877 ms. Trace:
I20260709 13:19:47.461527 17447 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:47.461905 17521 rpcz_store.cc:276] 0709 13:19:45.583715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.612519 (+ 28804us) service_pool.cc:224] Handling call
0709 13:19:45.612900 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.735431 (+122531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.461229 (+1725798us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540014d7d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:47.461388 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280308096}
I20260709 13:19:47.459755 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:47.457950 17528 rpcz_store.cc:276] 0709 13:19:45.827905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.121349 (+293444us) service_pool.cc:224] Handling call
0709 13:19:46.121681 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.162709 (+ 41028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.162753 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.177990 (+ 15237us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.456696 (+278706us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:46.456750 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.456850 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.455567 (+998717us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:47.457213 (+  1646us) raft_consensus.cc:1685] finished
0709 13:19:47.457243 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.457491 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7574,"raft.queue_time_us":249693,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":8085,"spinlock_wait_cycles":40134016,"thread_start_us":232204,"threads_started":1,"wal-append.queue_time_us":298378}
I20260709 13:19:47.465504 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:47.465679 22023 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.466411 22023 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:47.466746 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:47.467490 22023 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.467885 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:47.468602 22023 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:47.469344 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:47.470853 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.472357 17419 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:47.474510 17624 debug-util.cc:398] Leaking SignalData structure 0x7b080010f480 after lost signal to thread 17478
I20260709 13:19:47.474983 17419 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:47.481118 22014 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:47.482565 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.482703 17595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1741) took 3059 ms. Trace:
W20260709 13:19:47.483098 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.484393 21373 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:47.487336 21961 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:47.487776 21961 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.488111 21961 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.488729 21784 raft_consensus.cc:3055] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:47.489130 21784 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:47.492120 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.492734 21754 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:47.493069 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:47.493310 21754 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.493782 22006 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:47.493943 17597 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.494311 22006 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.495553 21754 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:47.496107 21754 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:47.497996 17522 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.498618 17601 raft_consensus.cc:1240] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 15. Ops: []
I20260709 13:19:47.492754 17594 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:47.499713 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.500190 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.500921 21817 consensus_queue.cc:1059] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:47.501947 21817 raft_consensus.cc:3055] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:47.483114 17595 rpcz_store.cc:276] 0709 13:19:44.423721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.423880 (+   159us) service_pool.cc:224] Handling call
0709 13:19:44.432537 (+  8657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.432761 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:44.442881 (+ 10120us) log.cc:844] Serialized 14 byte log entry
0709 13:19:47.482356 (+3039475us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:47.482408 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:47.482459 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.482530 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.482645 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":576885,"raft.queue_time_us":580863,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":2404562,"threads_started":1,"wal-append.queue_time_us":333826,"wal-append.run_cpu_time_us":1066,"wal-append.run_wall_time_us":1015800}
I20260709 13:19:47.502444 21817 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:47.489946 21784 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.502722 21811 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:47.503322 21817 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:47.503794 22059 consensus_queue.cc:1175] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ddfe9cca0741489b994f8b0178c54fe7" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 12 index: 7 } }
I20260709 13:19:47.504541 21817 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.501809 22032 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:47.505236 22032 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.505617 22032 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.505754 21687 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.500977 22015 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.506575 22015 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:47.509150 17568 connection.cc:256] RPC call timeout handler was delayed by -1.0945365640000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:19:47.510118 21572 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.510164 21983 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:47.510465 22001 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:47.493189 22024 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.510772 21572 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.510854 21983 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.512089 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:47856 (request call id 9) took 1867 ms. Trace:
I20260709 13:19:47.512456 17451 rpcz_store.cc:276] 0709 13:19:45.651091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.651223 (+   132us) service_pool.cc:224] Handling call
0709 13:19:47.511818 (+1860595us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b5400351e54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6c735 00007f5abab2cd29 00007f5ab40ab1d4 00007f5ab40ab162 00007f5ab40ab091 00007f5ab40ab00c 00007f5ab40aa2c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:47.511987 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189728640}
I20260709 13:19:47.513039 21572 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:47.513181 21983 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:47.500921 17594 raft_consensus.cc:2393] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:47.514300 21723 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:47.514968 21723 consensus_queue.cc:1243] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:47.517076 22030 consensus_queue.cc:1059] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:47.518266 21991 raft_consensus.cc:3055] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:47.514058 21983 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.518739 21991 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:47.519497 21996 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:47.503329 21784 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.496351 22006 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:47.519609 21991 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.511008 22001 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.522579 21991 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:47.521788 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 8999fe04fedd4bcc9305446ba6f99d23: Illegal state: Replica 0480cf54c3cc424ab94b963ef2ff5bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
W20260709 13:19:47.522852 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.525126 22001 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:47.526625 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:47.527464 17450 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:47.519168 21983 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.527841 21755 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.529558 21983 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:47.542977 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.543207 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.544314 17603 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:47.546584 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1977) took 1361 ms. Trace:
I20260709 13:19:47.546957 17603 rpcz_store.cc:276] 0709 13:19:46.185118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.185267 (+   149us) service_pool.cc:224] Handling call
0709 13:19:47.546415 (+1361148us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54003e9754. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:47.546524 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3030194048}
I20260709 13:19:47.547539 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.532208 17597 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:47.481730 22014 raft_consensus.cc:697] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:47.548904 22014 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:47.532549 22034 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.647s	user 0.000s	sys 0.002s
I20260709 13:19:47.550825 22015 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:47.552131 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.552688 17445 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:47.553994 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 84732.8us
I20260709 13:19:47.554735 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:47.558357 22022 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:47.558995 22022 raft_consensus.cc:697] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:47.559881 22022 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.562409 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.562887 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.563079 17451 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.564535 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:47.565197 17449 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.565361 17352 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 101) took 10948 ms. Trace:
I20260709 13:19:47.414309 21875 raft_consensus.cc:697] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:47.609694 17451 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:47.628996 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:47.638693 22030 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:47.624300 21821 consensus_queue.cc:1059] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:47.631466 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:47.656708 17595 raft_consensus.cc:2393] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:47.632462 17445 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:47.632377 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.615618 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:47.634457 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.635128 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:47.658862 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.636991 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:47.635344 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.659623 17601 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:47.639557 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.660758 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.654497 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:47.583515 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 63622.7us
I20260709 13:19:47.660888 17597 raft_consensus.cc:2393] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:47.661558 17601 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:47.602471 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:47.600858 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.619417 22024 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:19:47.664918 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.666510 17594 raft_consensus.cc:2393] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:19:47.666786 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 66038.8us
I20260709 13:19:47.667282 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:47.667903 17449 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
W20260709 13:19:47.665287 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 62893.8us
I20260709 13:19:47.665606 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:47.679356 17624 debug-util.cc:398] Leaking SignalData structure 0x7b0800302620 after lost signal to thread 17553
I20260709 13:19:47.674331 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.684247 21687 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:47.684475 17600 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:47.670619 17529 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:47.685974 22015 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:47.686592 22015 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.688841 22015 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:47.691541 22021 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:47.678813 21880 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:47.695600 17569 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.697697 17569 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.698555 21983 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:47.699100 21983 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:47.700021 21983 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.569964 17351 catalog_manager.cc:5697] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:47.703845 17351 catalog_manager.cc:5697] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 6 to 8, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 8 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
W20260709 13:19:47.683079 17624 debug-util.cc:398] Leaking SignalData structure 0x7b0800347660 after lost signal to thread 17554
W20260709 13:19:47.707985 17624 debug-util.cc:398] Leaking SignalData structure 0x7b080022fbc0 after lost signal to thread 17627
W20260709 13:19:47.708452 17624 debug-util.cc:398] Leaking SignalData structure 0x7b08003abe80 after lost signal to thread 17628
I20260709 13:19:47.668404 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.712540 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:47.714797 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.713989 17594 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:47.732539 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.712800 17603 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
W20260709 13:19:47.715850 17624 debug-util.cc:398] Leaking SignalData structure 0x7b080015b900 after lost signal to thread 18225
I20260709 13:19:47.721323 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.718565 22044 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:47.664208 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:47.565846 17352 rpcz_store.cc:276] 0709 13:19:36.616605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.620824 (+  4219us) service_pool.cc:224] Handling call
0709 13:19:47.565253 (+10944429us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:42.877102 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:42.877862 (+   760us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:42.877914 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:19:42.877982 (+    68us) tablet.cc:662] Decoding operations
0709 13:19:42.889611 (+ 11629us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:42.889697 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:42.889735 (+    38us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:19:42.890514 (+   779us) tablet.cc:701] Row locks acquired
0709 13:19:42.890571 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:19:42.890761 (+   190us) write_op.cc:270] Start()
0709 13:19:42.890905 (+   144us) write_op.cc:276] Timestamp: P: 1783603182890696 usec, L: 0
0709 13:19:42.890934 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:19:42.929711 (+ 38777us) log.cc:844] Serialized 2898 byte log entry
0709 13:19:43.914456 (+984745us) op_driver.cc:464] REPLICATION: finished
0709 13:19:44.030627 (+116171us) write_op.cc:301] APPLY: starting
0709 13:19:44.030754 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:44.290379 (+259625us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b180030d120. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab58a51e9 00007f5ab58f1c0a 00007f5ab58f14f7 00007f5ab58f1490 00007f5ab58a8f48 00007f5ab95bd1bb 00007f5ab95bd532 00007f5ab9604b93 00007f5ab94b1de3
0709 13:19:44.811050 (+520671us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:44.811118 (+    68us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:44.975684 (+164566us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:44.976176 (+   492us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:19:44.976239 (+    63us) write_op.cc:312] APPLY: finished
0709 13:19:44.978197 (+  1958us) log.cc:844] Serialized 73 byte log entry
0709 13:19:45.024117 (+ 45920us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:45.024258 (+   141us) write_op.cc:454] Released schema lock
0709 13:19:45.024348 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:45.024816 (+   468us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:45.024845 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":335153,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":115800,"apply.run_cpu_time_us":34114,"apply.run_wall_time_us":994149,"cfile_cache_hit":26,"cfile_cache_hit_bytes":27183,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":1259,"lbm_reads_lt_1ms":12,"num_ops":7,"prepare.queue_time_us":67150,"prepare.run_cpu_time_us":12421,"prepare.run_wall_time_us":220815,"raft.queue_time_us":358137,"raft.run_cpu_time_us":35412,"raft.run_wall_time_us":141890,"replication_time_us":1019801,"spinlock_wait_cycles":4515456,"thread_start_us":656722,"threads_started":5,"wal-append.queue_time_us":222267,"wal-append.run_cpu_time_us":83329,"wal-append.run_wall_time_us":2863267}]]}
I20260709 13:19:47.680385 21784 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:47.735625 17595 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
W20260709 13:19:47.735778 17624 debug-util.cc:398] Leaking SignalData structure 0x7b080027df40 after lost signal to thread 18226
I20260709 13:19:47.733667 17594 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:47.750824 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:47.707825 17569 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.725313 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:47.755213 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 47474.7us
I20260709 13:19:47.655771 22030 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:47.755175 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:47.705523 17351 catalog_manager.cc:5697] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:47.728149 21880 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:47.758744 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:47.765592 17601 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:47.769381 17597 raft_consensus.cc:1240] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.772534 17420 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.771445 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:47.776763 17601 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.714263 21961 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.781154 17569 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.782883 17569 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.777509 17595 raft_consensus.cc:2393] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:47.769279 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:47.724922 22048 consensus_queue.cc:1059] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:19:47.758725 22012 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:47.798378 17569 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:47.672698 22032 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:47.768946 22004 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.161s	user 0.022s	sys 0.000s
I20260709 13:19:47.791572 17603 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:47.796329 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1981) took 1540 ms. Trace:
I20260709 13:19:47.803771 17600 rpcz_store.cc:276] 0709 13:19:46.256322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.256538 (+   216us) service_pool.cc:224] Handling call
0709 13:19:47.796139 (+1539601us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400315454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:47.796265 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501703424}
I20260709 13:19:47.768376 21687 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:47.744210 22002 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:19:47.778916 22011 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:47.778661 21880 raft_consensus.cc:697] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:47.778786 22021 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.763867 22023 consensus_queue.cc:1059] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:19:47.782829 21723 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:47.797840 22026 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.754963 21875 consensus_queue.cc:237] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.820125 17600 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:47.799641 21788 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:47.797658 22017 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.812620 22011 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.821923 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:47.844995 17527 raft_consensus.cc:2410] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:19:47.845700 17524 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13. Ops: [10.8-12.9]
I20260709 13:19:47.846163 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:47.847209 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:47.830011 17351 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 8 to 11, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 11 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.833133 17600 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:47.807183 21373 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:47.837527 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.838519 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:47.798175 21979 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:47.834847 21788 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:47.806712 22004 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.023s	sys 0.000s
I20260709 13:19:47.887627 21880 consensus_queue.cc:237] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.852674 22011 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.806918 22012 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:47.833472 22015 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:47.835960 22026 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:47.964428 22005 consensus_meta.cc:287] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.006s
I20260709 13:19:47.956796 21788 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.946256 18197 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
W20260709 13:19:47.908591 22067 log.cc:927] Time spent T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:19:47.891996 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:47.964924 17351 catalog_manager.cc:5697] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 7 to 8, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 8 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.946121 21979 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:47.983856 17528 raft_consensus.cc:3060] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.884619 21373 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.029843 17351 catalog_manager.cc:5697] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 8 to 9, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 9 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:48.031731 17351 catalog_manager.cc:5697] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 8 to 9, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 9 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
W20260709 13:19:48.059892 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.087888 17525 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:48.029485 21979 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:48.029456 21980 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.096915 17351 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 6 to 7, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 7 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:48.102883 17528 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:48.140647 17351 catalog_manager.cc:5697] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 5 to 9, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 9 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:48.093864 22002 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:48.250415 22080 log.cc:927] Time spent T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
W20260709 13:19:48.271588 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.286868 22083 log.cc:927] Time spent T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:48.142527 22030 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:48.376332 18164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.030s	sys 0.066s
W20260709 13:19:48.376734 18164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.030s	sys 0.066s
W20260709 13:19:48.379462 18167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.015s	sys 0.050s
W20260709 13:19:48.379935 18167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.015s	sys 0.050s
I20260709 13:19:48.318998 17351 catalog_manager.cc:5697] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 5 to 8, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 8 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:48.145464 22032 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:48.380273 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 594497us
W20260709 13:19:48.407785 17569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.024s	sys 0.016s
W20260709 13:19:48.408571 17569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.024s	sys 0.016s
W20260709 13:19:48.409262 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 610892us
I20260709 13:19:48.410648 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:48.411659 17594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.008s	sys 0.031s
W20260709 13:19:48.425602 17594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.009s	sys 0.031s
W20260709 13:19:48.399324 17495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.012s	sys 0.030s
W20260709 13:19:48.426569 17495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.012s	sys 0.030s
W20260709 13:19:48.426968 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 631253us
W20260709 13:19:48.398658 22082 log.cc:927] Time spent T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.171s	user 0.000s	sys 0.003s
W20260709 13:19:48.400409 22076 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.389s	user 0.002s	sys 0.007s
W20260709 13:19:48.409220 22073 log.cc:927] Time spent T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.455s	user 0.002s	sys 0.007s
W20260709 13:19:48.432348 21754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.016s	sys 0.025s
I20260709 13:19:48.447355 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
W20260709 13:19:48.409346 22079 log.cc:927] Time spent T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.309s	user 0.000s	sys 0.009s
I20260709 13:19:48.453523 17351 catalog_manager.cc:5697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 7 to 10, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 10 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:48.408720 22078 log.cc:927] Time spent T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.378s	user 0.002s	sys 0.007s
W20260709 13:19:48.438196 21996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.014s	sys 0.028s
I20260709 13:19:48.459226 18194 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:48.467774 17526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.002s	sys 0.014s
W20260709 13:19:48.459160 21687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.022s	sys 0.041s
I20260709 13:19:48.473228 17351 catalog_manager.cc:5697] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 10 to 11, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 11 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.401854 22002 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:48.482926 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.465245 22006 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:48.496299 17351 catalog_manager.cc:5697] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 5 to 8, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 8 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:48.476233 21754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.016s	sys 0.026s
W20260709 13:19:48.483402 21996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.018s	sys 0.028s
W20260709 13:19:48.481564 21687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.023s	sys 0.041s
I20260709 13:19:48.489108 22015 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:48.519078 17526 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:48.521313 17351 catalog_manager.cc:5697] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:48.529458 17596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1997) took 1603 ms. Trace:
I20260709 13:19:48.530932 17523 raft_consensus.cc:1240] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:48.526139 21687 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:48.501801 22012 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:48.547502 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1999) took 1056 ms. Trace:
I20260709 13:19:48.535257 17351 catalog_manager.cc:5697] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:48.529918 17596 rpcz_store.cc:276] 0709 13:19:46.925568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.951033 (+ 25465us) service_pool.cc:224] Handling call
0709 13:19:46.951410 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:47.483296 (+531886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.483323 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:47.483891 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 13:19:47.737619 (+253728us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:47.758377 (+ 20758us) log.cc:844] Serialized 14 byte log entry
0709 13:19:47.780419 (+ 22042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.780492 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:48.529224 (+748732us) raft_consensus.cc:1685] finished
0709 13:19:48.529242 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:48.529393 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":553263,"prepare.queue_time_us":20495,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":560707,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":12190,"spinlock_wait_cycles":4357888,"thread_start_us":253327,"threads_started":1,"wal-append.queue_time_us":421026}
I20260709 13:19:48.548175 17599 rpcz_store.cc:276] 0709 13:19:47.490732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.505566 (+ 14834us) service_pool.cc:224] Handling call
0709 13:19:47.505884 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.506223 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.506251 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.506710 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.734531 (+227821us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:47.734570 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.734636 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:48.547184 (+812548us) raft_consensus.cc:1685] finished
0709 13:19:48.547219 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:48.547427 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":852,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":227493,"threads_started":1,"wal-append.queue_time_us":477655}
I20260709 13:19:48.520313 22026 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:48.559607 17351 catalog_manager.cc:5697] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:48.565956 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 2000) took 1074 ms. Trace:
I20260709 13:19:48.566412 17598 rpcz_store.cc:276] 0709 13:19:47.491039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.503358 (+ 12319us) service_pool.cc:224] Handling call
0709 13:19:47.503666 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.503997 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.504029 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.504501 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.729266 (+224765us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:47.729306 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.729374 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:48.565730 (+836356us) raft_consensus.cc:1685] finished
0709 13:19:48.565751 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:48.565881 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1326,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":224403,"threads_started":1,"wal-append.queue_time_us":449471}
I20260709 13:19:48.569304 17351 catalog_manager.cc:5697] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:48.535615 22006 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:48.589258 22088 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:19:48.591864 22007 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:48.595227 22085 log.cc:927] Time spent T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:19:48.595937 22081 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 13:19:48.613579 22091 log.cc:927] Time spent T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:19:48.613982 22095 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:48.614838 22095 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:48.622406 22082 log.cc:927] Time spent T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:48.623454 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2307) took 1064 ms. Trace:
I20260709 13:19:48.624344 22002 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:48.623798 17447 rpcz_store.cc:276] 0709 13:19:47.559050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.560195 (+  1145us) service_pool.cc:224] Handling call
0709 13:19:47.560508 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.560905 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:47.561496 (+   591us) log.cc:844] Serialized 14 byte log entry
0709 13:19:47.841555 (+280059us) log.cc:844] Serialized 14 byte log entry
0709 13:19:47.842178 (+   623us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.842695 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.842853 (+   158us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:47.846427 (+  3574us) log.cc:844] Serialized 14 byte log entry
0709 13:19:47.847482 (+  1055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.847570 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:48.623246 (+775676us) raft_consensus.cc:1685] finished
0709 13:19:48.623267 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:48.623395 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89953,"prepare.queue_time_us":116484,"prepare.run_cpu_time_us":390,"prepare.run_wall_time_us":23271,"raft.queue_time_us":4363,"raft.run_cpu_time_us":787,"raft.run_wall_time_us":166837,"spinlock_wait_cycles":48647552,"thread_start_us":277138,"threads_started":1,"wal-append.queue_time_us":526985}
I20260709 13:19:48.634579 22048 raft_consensus.cc:3055] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:48.635289 22048 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:48.636468 22077 log.cc:927] Time spent T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.201s	user 0.001s	sys 0.001s
I20260709 13:19:48.636554 22048 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:48.639962 22089 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:19:48.640229 17602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1998) took 1654 ms. Trace:
I20260709 13:19:48.640727 17602 rpcz_store.cc:276] 0709 13:19:46.985986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.986146 (+   160us) service_pool.cc:224] Handling call
0709 13:19:47.008392 (+ 22246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.487780 (+479388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.487812 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.488260 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.801872 (+313612us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:47.801929 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.802043 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:48.639943 (+837900us) raft_consensus.cc:1685] finished
0709 13:19:48.639963 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:48.640154 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":478934,"raft.queue_time_us":488179,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"thread_start_us":313205,"threads_started":1,"wal-append.queue_time_us":612151}
I20260709 13:19:48.598147 22030 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:48.642952 22030 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.643572 21755 raft_consensus.cc:3055] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:48.643961 21755 raft_consensus.cc:740] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:48.644754 21755 consensus_queue.cc:260] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.645740 21755 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.634567 22006 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.605428 17495 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:48.650602 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 45289.8us
I20260709 13:19:48.651201 22066 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:48.657569 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:48.659246 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 680390us
I20260709 13:19:48.662796 22057 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:48.663345 22057 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:48.663691 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.665527 22057 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:48.599272 22015 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:48.678432 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.634828 21687 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.645153 22030 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:48.649433 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2308) took 1064 ms. Trace:
I20260709 13:19:48.625746 22002 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:48.621798 21788 consensus_meta.cc:287] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.598s	user 0.002s	sys 0.005s
I20260709 13:19:48.701265 17452 rpcz_store.cc:276] 0709 13:19:47.584836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.585011 (+   175us) service_pool.cc:224] Handling call
0709 13:19:47.629111 (+ 44100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.629327 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:47.641180 (+ 11853us) log.cc:844] Serialized 14 byte log entry
0709 13:19:47.946193 (+305013us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.589479 (+643286us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b180043df80. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a79522 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:19:48.648913 (+ 59434us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:48.649004 (+    91us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:48.649091 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.649186 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:48.649355 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1387334,"prepare.queue_time_us":20725,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":2008,"raft.queue_time_us":708389,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":10745,"spinlock_wait_cycles":14774016,"thread_start_us":303964,"threads_started":1,"wal-append.queue_time_us":795514}
I20260709 13:19:48.611383 22012 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:48.601729 17351 catalog_manager.cc:5697] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 9 to 10, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 10 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:48.668051 17449 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:48.672384 17447 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:48.675096 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:48.676033 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:48.679312 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:48.683806 17453 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:48.711426 17451 raft_consensus.cc:2368] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13.
I20260709 13:19:48.711894 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:48.685298 17446 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:48.713255 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:48.713793 17446 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:48.688803 17596 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:48.689810 17603 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:48.708678 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:48.661748 17600 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:48.715958 17600 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:48.688695 22014 consensus_queue.cc:1059] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:19:48.705821 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:48.674155 22048 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.715830 17351 catalog_manager.cc:5697] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:48.718638 17454 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:48.718529 17351 catalog_manager.cc:5697] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:48.720176 17351 catalog_manager.cc:5697] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 6 to 7, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 7 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:48.617767 22095 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:48.725476 22095 consensus_queue.cc:1059] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:19:48.703009 21979 consensus_meta.cc:287] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.002s
I20260709 13:19:48.736402 22116 raft_consensus.cc:3055] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:48.722661 17351 catalog_manager.cc:5697] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 5 to 8, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 8 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.690140 22024 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:19:48.761632 22005 raft_consensus.cc:3055] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:48.726873 21811 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:48.706171 22001 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:19:48.761258 22004 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:48.763206 21784 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:48.796619 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.738627 22012 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.765616 22075 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:48.798748 21811 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.799386 22024 raft_consensus.cc:3055] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:48.800458 22004 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.794608 22005 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:48.763988 22116 raft_consensus.cc:740] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:48.804464 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:48.805512 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:48.812140 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 136407us
W20260709 13:19:48.833549 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 84264.6us
W20260709 13:19:48.834124 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 131789us
I20260709 13:19:48.713866 21788 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.839677 17523 raft_consensus.cc:1240] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:48.727123 22002 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:48.850423 22017 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:48.850867 22096 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:48.851773 22099 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:19:48.852502 21811 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:48.777335 21979 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.808681 21875 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.856765 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:48.859952 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:48.861878 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 175010us
I20260709 13:19:48.860410 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:48.823338 22024 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:48.865412 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:48.880435 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:48.869259 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:48.869351 17596 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:48.884373 17598 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:48.869728 17603 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:48.868820 17521 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:48.869848 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:48.883553 17450 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:48.888288 21754 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:48.887771 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:48.888734 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:48.857143 22001 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.899866 17420 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:48.824550 21784 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.902519 17450 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 10: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:48.835397 22075 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.911352 17420 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:48.913018 17420 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:48.915035 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:48.726919 22098 consensus_queue.cc:1175] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ddfe9cca0741489b994f8b0178c54fe7" responder_term: 13 status { last_received { term: 9 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13. Ops: [10.8-12.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:48.917411 22004 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:48.902972 22115 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:48.917984 22004 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.918642 22004 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:48.919232 22004 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:48.921016 17594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1800) took 1288 ms. Trace:
I20260709 13:19:48.921499 17594 rpcz_store.cc:276] 0709 13:19:47.632715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.751561 (+118846us) service_pool.cc:224] Handling call
0709 13:19:47.751891 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.752242 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.752274 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.762534 (+ 10260us) log.cc:844] Serialized 26 byte log entry
0709 13:19:48.426200 (+663666us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:48.532423 (+106223us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.558551 (+ 26128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.558637 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:48.920775 (+362138us) raft_consensus.cc:1685] finished
0709 13:19:48.920797 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:48.920952 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4288,"prepare.queue_time_us":291815,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":66437,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":9318,"thread_start_us":705846,"threads_started":2,"wal-append.queue_time_us":915858}
I20260709 13:19:48.927995 17450 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:19:48.859287 22017 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.937408 17450 raft_consensus.cc:1240] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:48.938925 17450 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:48.906507 22032 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:48.905573 22066 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:48.863070 22096 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.866796 21875 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.949604 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:48.948966 17569 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:48.953253 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:48.941854 17598 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:48.964697 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:48.966914 17569 leader_election.cc:400] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13.
I20260709 13:19:48.967710 17569 leader_election.cc:403] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:48.965333 22117 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:48.975099 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:48.930284 21811 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:48.905385 22001 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.984925 17569 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:48.969612 21723 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.900060 22005 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.994295 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:48.968942 21934 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:48.980502 21996 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:48.985158 22004 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.989542 21991 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13.
I20260709 13:19:48.937546 22024 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.018677 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:48.964115 22032 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.997936 22117 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.020547 17420 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:49.001128 21934 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.001159 22005 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.001627 21821 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:48.987412 21811 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:48.930488 22116 consensus_queue.cc:260] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.026219 22124 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:49.035692 22124 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:49.036178 22124 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.006704 22122 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.040932 22125 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:48.992334 22103 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:49.043009 22001 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:49.044647 21875 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.044782 21784 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.046689 21979 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:49.034596 22002 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:49.028787 21934 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.048457 22017 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:49.051039 22011 consensus_meta.cc:287] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 1.067s	user 0.012s	sys 0.000s
I20260709 13:19:49.051482 22011 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.029191 21821 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.052703 17527 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:49.052806 21821 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.053655 22011 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.034363 22130 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.046850 22032 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.023322 22057 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.019614 22066 raft_consensus.cc:697] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:49.059655 22117 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:49.049274 22124 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.074407 22117 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.074883 22117 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.075381 22066 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.067947 22075 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.078842 22096 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:49.076076 22124 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:49.055325 22024 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:49.085218 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 184492us
I20260709 13:19:49.054401 22012 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.054557 22115 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:49.094743 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.100314 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.041549 22125 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.065394 22116 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.077818 21934 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:49.120229 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.125080 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.127579 17602 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:49.058797 22130 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.112516 22002 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:19:49.122403 22124 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:49.139047 22113 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.402s	user 0.002s	sys 0.000s
I20260709 13:19:49.116099 22012 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:19:49.143602 21934 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:49.145735 22007 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:49.146476 22007 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.148978 22007 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.157025 22125 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:49.130121 21687 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.170987 21971 raft_consensus.cc:3055] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:49.136144 22005 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:49.172200 22124 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:49.205415 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 184970us
W20260709 13:19:49.203169 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 218319us
W20260709 13:19:49.203267 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.190121 21971 raft_consensus.cc:740] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:49.213354 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:49.213406 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:49.193940 21687 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.217300 17420 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:49.196210 22005 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.231101 21993 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:49.231741 21993 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.217922 21755 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.235301 22096 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:49.217993 22075 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.241290 22005 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.220996 21821 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:49.242125 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.243826 21821 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:49.225644 21687 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:49.244792 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.233753 21993 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:49.246264 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.246632 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:49.254508 17420 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:49.265954 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.253201 22075 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:49.261195 22048 consensus_meta.cc:287] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.004s
W20260709 13:19:49.272797 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet cb985f82c610405fb3774fe99cf142e7: Illegal state: Replica abf46e430b7e4ad4919ca2a717f37e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:49.261864 22097 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.274907 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:49.261577 22116 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.265153 21784 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.266281 22125 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:19:49.266848 22120 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:49.256430 21993 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:19:49.281267 17420 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.282330 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:49.286389 22130 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:49.287876 22121 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:49.288475 22084 log.cc:927] Time spent T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 1.143s	user 0.002s	sys 0.000s
I20260709 13:19:49.289683 22121 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:49.290203 22129 log.cc:927] Time spent T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.165s	user 0.000s	sys 0.002s
I20260709 13:19:49.280953 22116 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.292073 22004 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.292567 22116 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:49.292078 22121 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:49.293398 17523 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:49.293731 22121 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:49.294240 22121 raft_consensus.cc:697] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:49.295284 22143 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:19:49.296113 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:49.295089 22121 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.298049 22138 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:49.298677 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:49.268430 21832 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:19:49.279211 22097 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.303378 17452 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.270555 21879 consensus_queue.cc:1059] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:19:49.349692 21788 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.350386 21687 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.350732 21879 raft_consensus.cc:3055] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:49.340849 22075 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:49.356141 22124 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:49.362897 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 81731.3us
I20260709 13:19:49.362774 17597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 588) took 1657 ms. Trace:
I20260709 13:19:49.366165 17452 raft_consensus.cc:2468] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:49.366261 17597 rpcz_store.cc:276] 0709 13:19:47.704934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.773445 (+ 68511us) service_pool.cc:224] Handling call
0709 13:19:47.773764 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.792289 (+ 18525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.792320 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:47.792361 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:47.792393 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.362507 (+1570114us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b5400062054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:49.362559 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.362714 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42120064}
I20260709 13:19:49.368121 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:49.369184 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:49.370715 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:49.371553 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:49.372231 17594 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:49.373067 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:49.373675 17598 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:19:49.374348 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:49.374905 17601 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.368858 17452 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:49.376717 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:49.377912 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:49.378254 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:49.378911 17603 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
W20260709 13:19:49.380139 18197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42536 (request call id 300) took 1780 ms (client timeout 2247 ms). Trace:
I20260709 13:19:49.378556 17452 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:49.386672 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:49.387677 17598 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:49.389808 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:49.390326 17420 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.394579 17601 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
W20260709 13:19:49.380683 18197 rpcz_store.cc:269] 0709 13:19:47.599914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.600045 (+   131us) service_pool.cc:224] Handling call
0709 13:19:49.379976 (+1779931us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54007b1954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:49.380087 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394628992}
I20260709 13:19:49.397306 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.338811 21832 consensus_queue.cc:1243] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:49.400221 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:49.400235 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:49.406225 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:49.351583 22117 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.363094 21879 raft_consensus.cc:740] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:19:49.411857 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 147014us
I20260709 13:19:49.379246 21755 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.418552 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:49.419342 17452 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:49.406560 21980 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:19:49.399626 22124 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:49.428922 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:49.431672 17452 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.302685 22138 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.396030 21687 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.406147 22005 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 13:19:49.439868 17527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 2548) took 1607 ms (client timeout 2087 ms). Trace:
I20260709 13:19:49.420213 22115 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:49.441622 17527 rpcz_store.cc:269] 0709 13:19:47.832612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.891718 (+ 59106us) service_pool.cc:224] Handling call
0709 13:19:49.439663 (+1547945us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003412d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:49.439808 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2396137728}
I20260709 13:19:49.398077 22075 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.448130 22157 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:49.450541 22157 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:49.450958 22157 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.413975 22116 consensus_queue.cc:1059] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:19:49.461947 17599 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:49.447603 21993 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:49.462082 17452 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:49.465435 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:49.469197 22097 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:49.461844 21983 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.435802 22124 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.474526 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:49.460373 22156 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:49.475545 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.476078 17452 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:49.463862 21999 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:19:49.449307 22115 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.465293 21993 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:49.456634 22119 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.199s
I20260709 13:19:49.462431 22120 raft_consensus.cc:697] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:49.488232 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:49.477975 22149 log.cc:927] Time spent T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:19:49.481284 22124 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:49.484663 21993 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.490846 22116 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.501502 22116 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.501813 22115 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.477416 21983 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.536274 21983 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:49.465040 21879 consensus_queue.cc:260] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.483151 22156 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:49.537963 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 112942us
I20260709 13:19:49.500584 22155 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:49.542709 17527 pending_rounds.cc:85] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 7
I20260709 13:19:49.545172 22075 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:49.545584 17527 pending_rounds.cc:107] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:19:49.545951 17527 raft_consensus.cc:2889] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:49.551108 22107 log.cc:927] Time spent T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.813s	user 0.003s	sys 0.000s
I20260709 13:19:49.552517 21687 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:49.553930 22022 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.477823 22158 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
W20260709 13:19:49.556099 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 158891us
I20260709 13:19:49.537266 22116 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.556860 17420 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.560949 18167 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:49.561149 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.554584 22022 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.564304 17420 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.556417 21979 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.559839 21879 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.563925 21744 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:49.564222 22075 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:49.592308 21744 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:49.592448 22075 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:49.592717 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:49.554257 22120 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.593143 22075 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.593617 17520 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:49.575500 22156 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:49.575896 22163 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:49.594334 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.594558 22163 raft_consensus.cc:697] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:49.571358 17495 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:49.595548 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.595594 22163 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.596539 17529 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:49.597008 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:49.577039 22166 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.597882 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:49.566412 22117 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.598322 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:49.598871 22115 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:49.599274 22115 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:49.599553 22116 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:49.599648 22115 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.600011 22116 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:49.600422 22116 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.580750 21784 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.587426 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:49.602807 17601 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.590690 22161 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:49.604135 22161 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.606591 22161 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.576398 21979 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.607962 21971 consensus_queue.cc:260] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.608964 21979 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:49.609185 21788 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:49.592880 21744 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.609747 21788 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:49.557428 22155 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.610651 21788 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.584946 22022 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.600324 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.594597 17569 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.613211 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.590855 21961 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.614501 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:49.614986 17601 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:49.615556 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.616156 17525 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
W20260709 13:19:49.616278 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.616956 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.618173 17448 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:49.619128 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:49.621652 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.616652 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.622586 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.623528 17569 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.624032 17520 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:49.625311 22156 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.622305 22095 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:49.626806 22095 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.628760 22095 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.614980 22155 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:49.629369 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:49.630988 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.631395 22161 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.631976 22161 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.632477 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.633517 17526 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:49.634846 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.636421 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.637300 17528 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:49.640941 21977 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:49.644423 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.646531 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:49.648533 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.651803 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.619596 17448 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:49.653991 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:49.644012 17419 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:49.657874 17419 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:49.647400 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.659194 17529 raft_consensus.cc:2410] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:19:49.663582 17529 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:19:49.665942 17529 pending_rounds.cc:85] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 6
I20260709 13:19:49.609014 21971 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.665391 17448 raft_consensus.cc:2393] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 14: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:49.661604 17520 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:49.643707 21687 raft_consensus.cc:2804] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:49.649173 21977 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.666774 17529 pending_rounds.cc:107] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:19:49.660223 22097 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:49.664410 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 103585us
I20260709 13:19:49.677443 17601 raft_consensus.cc:1275] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:49.652616 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.674278 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.585458 22157 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.670634 17419 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:49.687335 21687 raft_consensus.cc:697] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:49.687863 17419 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:49.688400 21687 consensus_queue.cc:237] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:49.689776 22087 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 1.104s	user 0.001s	sys 0.001s
I20260709 13:19:49.690796 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:49.691890 22021 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.698421 22096 consensus_queue.cc:1059] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:19:49.697549 21993 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.699268 22096 raft_consensus.cc:3055] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:49.699662 22096 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:49.700520 21993 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:49.700435 22096 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:49.705114 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.680156 17529 raft_consensus.cc:2889] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:49.676627 17569 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.667594 21784 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.665594 22155 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:49.683758 17528 raft_consensus.cc:2410] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:49.685205 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.682804 18167 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:49.660006 22161 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.713065 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:49.713390 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:49.626216 22156 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.714084 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:49.681658 21977 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.711658 17420 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.716816 17594 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:49.718340 21975 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:49.681981 22097 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.720965 21975 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.721099 22097 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.721467 21975 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.708818 22155 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:49.722450 22155 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.722854 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:49.723553 17598 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:49.725279 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.707850 22096 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.731839 22156 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.732676 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:49.733858 22115 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.736963 21811 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.738200 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.738960 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:49.717736 17601 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.741557 17449 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
W20260709 13:19:49.743724 22086 log.cc:927] Time spent T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 1.149s	user 0.001s	sys 0.006s
I20260709 13:19:49.725863 21784 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:49.751829 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 69151.1us
I20260709 13:19:49.753700 17419 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:49.741240 22161 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:49.763918 17525 raft_consensus.cc:2393] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:49.766170 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.751621 22156 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:49.774362 17568 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:49.783100 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.786784 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.795719 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.796265 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.797986 17601 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
W20260709 13:19:49.798522 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 44960.7us
I20260709 13:19:49.760803 21968 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:49.767545 21784 raft_consensus.cc:697] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:49.808035 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:49.764726 22161 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:49.831854 17419 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:49.762794 21744 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:49.799597 22011 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:49.803596 22144 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:49.842996 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 172796us
I20260709 13:19:49.767017 22075 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.802490 22167 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:49.794474 22156 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:49.776716 21832 consensus_queue.cc:1059] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:19:49.832278 22161 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.813529 21821 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:49.828604 21968 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:19:49.842597 22006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.191s	user 0.020s	sys 0.039s
I20260709 13:19:49.843235 22145 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:49.858896 22156 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:49.903164 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 132846us
I20260709 13:19:49.845968 22011 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:49.871841 22006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.222s	user 0.020s	sys 0.039s
I20260709 13:19:49.868723 21968 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.870232 22145 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:50.021682 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 113630us
W20260709 13:19:50.040795 22174 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:19:50.042989 21744 leader_election.cc:290] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:50.023545 22145 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.014334 22116 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:49.998520 22024 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:50.166831 22024 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:50.174865 22170 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:19:50.071316 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.964826 21811 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:50.036317 21971 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:50.071707 22115 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:49.871091 21821 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:50.151261 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.169713 22024 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:50.154624 22104 log.cc:927] Time spent T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.570s	user 0.000s	sys 0.007s
I20260709 13:19:50.154999 22011 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:50.160730 21977 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:50.164623 22075 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:50.166098 22167 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:50.262856 22024 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:50.228377 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.268400 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.262053 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:49.874101 21784 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:50.274060 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.275991 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:50.278909 22024 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:50.254334 21975 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:50.275194 22167 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:50.284274 22161 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:50.286480 22167 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:50.288796 22161 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:50.254392 22166 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.281701 22024 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:50.304389 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.305248 18197 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:50.308197 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.206082 21811 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:50.256590 21971 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:50.321908 17520 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:50.328140 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.302176 22166 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:50.346165 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.349763 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:50.349869 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:50.351069 17568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.024s	sys 0.072s
W20260709 13:19:50.351504 17568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.024s	sys 0.072s
W20260709 13:19:50.351804 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 541548us
I20260709 13:19:50.352653 17568 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:50.358840 22189 log.cc:927] Time spent T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:19:50.361325 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.361646 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.362707 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:50.366765 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 344162us
I20260709 13:19:50.369869 17568 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:50.372418 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.375527 21983 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:50.376123 21983 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:50.392246 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:50.396885 22184 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:50.397861 21373 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:50.398546 17600 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:50.399215 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 595) took 2582 ms. Trace:
I20260709 13:19:50.399516 17600 rpcz_store.cc:276] 0709 13:19:47.816545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.818622 (+  2077us) service_pool.cc:224] Handling call
0709 13:19:47.819996 (+  1374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.661258 (+841262us) spinlock_profiling.cc:243] Waited 63.3 ms on lock 0x7b4c00418400. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab3e32a20 00007f5ab3e43a29 00007f5ab3e09644 00007f5ab3e30f2d 00007f5ab3e30b93 00007f5ab5b6118b 00007f5ab5b61cb5 00007f5ab5b5cf30 00007f5ab5b5e7de 00007f5ab5b68b49 00007f5ab5b69416
0709 13:19:50.398284 (+1737026us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400245520. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5adddc0 00007f5ab5b68d87 00007f5ab5b69470 00007f5ab5b65d8f 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c
0709 13:19:50.398902 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.399164 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567400576}
W20260709 13:19:50.401178 22102 log.cc:927] Time spent T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 1.762s	user 0.007s	sys 0.005s
I20260709 13:19:50.402436 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.403574 22135 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.404160 22135 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:50.409323 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2332) took 1170 ms. Trace:
I20260709 13:19:50.410457 22194 consensus_queue.cc:1048] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:50.411890 22194 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.412331 22194 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:50.409783 17448 rpcz_store.cc:276] 0709 13:19:49.239015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.677571 (+438556us) service_pool.cc:224] Handling call
0709 13:19:49.702437 (+ 24866us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:49.738566 (+ 36129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.738603 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:49.739190 (+   587us) log.cc:844] Serialized 52 byte log entry
0709 13:19:49.868799 (+129609us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:50.004457 (+135658us) log.cc:844] Serialized 14 byte log entry
0709 13:19:50.004738 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.408452 (+403714us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b5400320354. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:50.408504 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.408558 (+    54us) raft_consensus.cc:1685] finished
0709 13:19:50.408840 (+   282us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.409128 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":136003,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":1285,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":26371,"spinlock_wait_cycles":82134272,"thread_start_us":102752,"threads_started":1,"wal-append.queue_time_us":545037}
I20260709 13:19:50.416795 22166 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:50.417076 17448 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:50.371177 22006 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:50.378611 21687 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:50.397068 22187 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:50.419507 22116 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:50.386677 22163 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:50.420172 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.427942 21983 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:50.445890 18197 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
W20260709 13:19:50.399530 22178 log.cc:927] Time spent T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.107s	user 0.000s	sys 0.002s
I20260709 13:19:50.423353 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55884 (request call id 2335) took 1183 ms. Trace:
I20260709 13:19:50.424582 21968 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:50.427174 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:50.423235 22156 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:50.494556 17447 raft_consensus.cc:1240] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:50.495369 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1907) took 1119 ms. Trace:
I20260709 13:19:50.495766 17447 rpcz_store.cc:276] 0709 13:19:49.375695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.487024 (+1111329us) service_pool.cc:224] Handling call
0709 13:19:50.494387 (+  7363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.495076 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.495304 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.443593 21971 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:50.444165 21821 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:50.445406 22155 consensus_meta.cc:287] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.722s	user 0.000s	sys 0.009s
I20260709 13:19:50.444993 22163 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:50.445760 22151 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.095s	user 0.000s	sys 0.002s
W20260709 13:19:50.420935 22096 consensus_meta.cc:287] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.002s
W20260709 13:19:50.446470 22152 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 1.095s	user 0.001s	sys 0.002s
I20260709 13:19:50.460798 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:50.463850 22135 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:50.428794 22097 consensus_meta.cc:287] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.004s
I20260709 13:19:50.502107 18197 raft_consensus.cc:1240] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:50.494758 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:50.504243 17420 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:50.475908 17446 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:19:50.470546 22131 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.337s	user 0.005s	sys 0.002s
I20260709 13:19:50.479478 22169 raft_consensus.cc:3055] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:50.479858 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:50.481418 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:50.494764 22057 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:50.491075 17445 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:50.510190 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1910) took 1133 ms. Trace:
I20260709 13:19:50.510552 17445 rpcz_store.cc:276] 0709 13:19:49.376738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.488439 (+1111701us) service_pool.cc:224] Handling call
0709 13:19:50.488841 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.509908 (+ 21067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.510133 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.511776 17445 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:50.512396 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1918) took 1131 ms. Trace:
I20260709 13:19:50.512723 17445 rpcz_store.cc:276] 0709 13:19:49.380904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.511326 (+1130422us) service_pool.cc:224] Handling call
0709 13:19:50.511601 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.512161 (+   560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.512342 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.489689 17450 rpcz_store.cc:276] 0709 13:19:49.239834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.295694 (+ 55860us) service_pool.cc:224] Handling call
0709 13:19:50.423143 (+1127449us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b5400110b54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:50.423268 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847565184}
I20260709 13:19:50.440436 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2337) took 1189 ms. Trace:
I20260709 13:19:50.504405 17447 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:50.505120 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1911) took 1128 ms. Trace:
I20260709 13:19:50.477731 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:50.514245 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1915) took 1134 ms. Trace:
I20260709 13:19:50.501670 18194 raft_consensus.cc:2376] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11. Re-sending same reply.
I20260709 13:19:50.421350 17448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1906) took 1046 ms. Trace:
I20260709 13:19:50.508971 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:50.514881 17447 rpcz_store.cc:276] 0709 13:19:49.379969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.496639 (+1116670us) service_pool.cc:224] Handling call
0709 13:19:50.504079 (+  7440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.513960 (+  9881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.514188 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.515918 17523 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:50.513751 17449 rpcz_store.cc:276] 0709 13:19:49.251239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.752562 (+501323us) service_pool.cc:224] Handling call
0709 13:19:49.752896 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.757872 (+  4976us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:49.793793 (+ 35921us) log.cc:844] Serialized 14 byte log entry
0709 13:19:50.200535 (+406742us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.253852 (+ 53317us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.254089 (+   237us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:50.254147 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.254250 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.406603 (+152353us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b48003303d8. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abaa8faa1 00007f5abaa86b37 00007f5abaa869ca 00007f5abab7e26f 00007f5abab7df37 00007f5abab9255c 00007f5abab92508 00007f5abab92488 00007f5abab92443 00007f5abab916ec 00007f5ab9abba96
0709 13:19:50.435162 (+ 28559us) raft_consensus.cc:1685] finished
0709 13:19:50.440205 (+  5043us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.440370 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4488,"prepare.queue_time_us":34951,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":7212,"raft.run_cpu_time_us":2587,"raft.run_wall_time_us":696600,"spinlock_wait_cycles":9264384,"thread_start_us":370465,"threads_started":1,"wal-append.queue_time_us":507008}
I20260709 13:19:50.497514 22194 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:50.518213 17448 rpcz_store.cc:276] 0709 13:19:49.375369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.416609 (+1041240us) service_pool.cc:224] Handling call
0709 13:19:50.416918 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.419806 (+  2888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.421290 (+  1484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.519835 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.520504 18196 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:50.514014 17446 rpcz_store.cc:276] 0709 13:19:49.377273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.475197 (+1097924us) service_pool.cc:224] Handling call
0709 13:19:50.475544 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.504840 (+ 29296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.505060 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.523495 17446 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:50.525743 17446 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:50.529821 17450 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:50.530324 17446 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:50.531047 17449 raft_consensus.cc:1240] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:50.534946 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.506825 22120 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:50.507069 21744 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:50.507143 22169 raft_consensus.cc:740] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:50.500650 22155 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:50.517143 21811 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:50.582909 17448 raft_consensus.cc:1240] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:50.585414 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:50.586248 17446 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:50.587450 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:50.588755 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:50.589378 17446 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:19:50.506072 22097 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:50.597623 17450 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:50.540135 22120 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:50.522781 22057 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:50.618419 22169 consensus_queue.cc:260] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:50.536868 22185 consensus_queue.cc:1059] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:19:50.628234 21968 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:50.632483 22145 consensus_meta.cc:287] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
I20260709 13:19:50.638229 18195 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:50.638789 22192 consensus_queue.cc:1059] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:50.610752 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1902) took 1925 ms. Trace:
I20260709 13:19:50.544355 22158 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.265s
I20260709 13:19:50.871019 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:50.871636 18192 raft_consensus.cc:2376] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10. Re-sending same reply.
I20260709 13:19:50.874063 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:50.830322 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.865916 17453 rpcz_store.cc:276] 0709 13:19:48.685651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.764908 (+ 79257us) service_pool.cc:224] Handling call
0709 13:19:48.790831 (+ 25923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.969519 (+178688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.975276 (+  5757us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.975940 (+   664us) log.cc:844] Serialized 26 byte log entry
0709 13:19:49.022651 (+ 46711us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:49.022675 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.022721 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.469850 (+1447129us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:50.592411 (+122561us) raft_consensus.cc:1685] finished
0709 13:19:50.592445 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.610660 (+ 18215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29978,"raft.queue_time_us":108073,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":20816,"spinlock_wait_cycles":2927488,"thread_start_us":185159,"threads_started":2,"wal-append.queue_time_us":123388}
I20260709 13:19:50.871426 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.640195 22156 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:50.580128 22161 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:50.643532 21980 raft_consensus.cc:3055] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:50.813123 22120 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:50.878731 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:50.883881 22155 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:50.656989 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:50.896503 17453 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:19:50.857306 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:50.902627 17446 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:19:50.911612 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:50.912640 17453 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:50.919436 17451 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:50.921248 17451 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:50.928388 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:50.928726 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.935439 22057 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:50.872620 21784 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:50.895759 21875 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.955231 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 2008) took 2275 ms. Trace:
I20260709 13:19:50.939018 17448 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:19:50.940039 22106 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 2.355s	user 0.010s	sys 0.014s
I20260709 13:19:50.940369 22097 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:50.904819 22161 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:50.874228 22158 consensus_queue.cc:1243] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:50.869778 22145 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:50.862339 21877 consensus_queue.cc:1059] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
W20260709 13:19:50.944152 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.996793 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.944823 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2540) took 3127 ms. Trace:
I20260709 13:19:50.998970 17521 rpcz_store.cc:276] 0709 13:19:47.817345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.817515 (+   170us) service_pool.cc:224] Handling call
0709 13:19:47.818353 (+   838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.885899 (+1067546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.944534 (+2058635us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400090e54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:50.944736 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2415361792}
W20260709 13:19:50.948673 17569 connection.cc:256] RPC call timeout handler was delayed by -1.1532288420000896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 13:19:50.953416 17520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.012s	sys 0.060s
I20260709 13:19:50.955742 17599 rpcz_store.cc:276] 0709 13:19:48.679814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.680165 (+   351us) service_pool.cc:224] Handling call
0709 13:19:48.680476 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.463265 (+782789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.954935 (+1491670us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b540027b0d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:50.955154 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1796697856}
I20260709 13:19:50.954663 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 2071) took 1320 ms. Trace:
I20260709 13:19:50.983700 18193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:50.895623 21980 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:50.958675 22101 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.937702 18199 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:50.952700 17452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2326) took 2108 ms. Trace:
W20260709 13:19:51.011770 17520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.012s	sys 0.060s
I20260709 13:19:51.023015 17597 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:19:51.011868 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.953969 22021 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:51.012110 17526 rpcz_store.cc:276] 0709 13:19:49.634015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.840840 (+206825us) service_pool.cc:224] Handling call
0709 13:19:49.841237 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.033702 (+192465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.033747 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:50.033801 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:50.033845 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.954313 (+920468us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54000203d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:50.954377 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.954588 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441887616}
I20260709 13:19:51.023779 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2583) took 1253 ms. Trace:
W20260709 13:19:51.021404 17568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.001s	sys 0.028s
I20260709 13:19:51.024816 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.025949 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.024542 17452 rpcz_store.cc:276] 0709 13:19:48.843831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.493177 (+649346us) service_pool.cc:224] Handling call
0709 13:19:49.493392 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.493559 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:49.505388 (+ 11829us) log.cc:844] Serialized 14 byte log entry
0709 13:19:50.473476 (+968088us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b18003b80c0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab570623a 00007f5ab5b70a2a
0709 13:19:50.952258 (+478782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:50.952323 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:50.952394 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.952484 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.952634 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11407,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":2348,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":33349,"spinlock_wait_cycles":2373376,"thread_start_us":477558,"threads_started":1}
I20260709 13:19:51.029440 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:51.035625 18201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.018s	sys 0.016s
I20260709 13:19:51.027454 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:51.036031 18201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.018s	sys 0.016s
I20260709 13:19:51.033502 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:51.032457 17520 rpcz_store.cc:276] 0709 13:19:49.770273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.323013 (+552740us) service_pool.cc:224] Handling call
0709 13:19:50.371069 (+ 48056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.371334 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:50.390839 (+ 19505us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.023479 (+632640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:51.023522 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:51.023561 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.023627 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.023730 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21962,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":850,"thread_start_us":632274,"threads_started":1}
W20260709 13:19:51.032640 17568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.001s	sys 0.028s
I20260709 13:19:51.034094 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.029579 17602 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:51.044891 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.046419 17599 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:50.958930 21784 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.061879 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:51.063903 17599 raft_consensus.cc:1240] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:19:51.064527 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.066052 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.066236 17603 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:51.066854 17598 raft_consensus.cc:2468] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:19:51.065487 17597 raft_consensus.cc:1240] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:51.070344 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:50.989778 21875 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.072258 17595 raft_consensus.cc:1240] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:51.075820 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:51.072211 17523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:19:51.083212 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:51.087996 17521 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:51.089972 18166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.014s	sys 0.029s
W20260709 13:19:51.090618 18166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.014s	sys 0.029s
W20260709 13:19:51.090927 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 596197us
I20260709 13:19:51.093645 17523 raft_consensus.cc:606] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:51.028928 22101 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.075026 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.065128 22096 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.096877 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:51.098685 18166 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:51.096637 17602 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:51.099501 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2545) took 3272 ms. Trace:
I20260709 13:19:51.102430 17524 rpcz_store.cc:276] 0709 13:19:47.826855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.969433 (+142578us) service_pool.cc:224] Handling call
0709 13:19:48.017667 (+ 48234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.023558 (+  5891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.023615 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.047036 (+ 23421us) log.cc:844] Serialized 26 byte log entry
0709 13:19:48.477284 (+430248us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:48.477396 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.484205 (+  6809us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.922596 (+2438391us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:19:51.093002 (+170406us) raft_consensus.cc:1685] finished
0709 13:19:51.093032 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.099416 (+  6384us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5382,"raft.queue_time_us":6282,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":13513,"spinlock_wait_cycles":45261056,"thread_start_us":347832,"threads_started":1,"wal-append.queue_time_us":488819}
I20260709 13:19:51.028924 22200 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.104410 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:51.109391 22166 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:51.110004 22166 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:51.033316 22127 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.005s	user 0.016s	sys 0.030s
I20260709 13:19:51.113379 17445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 496) took 1522 ms. Trace:
I20260709 13:19:51.115005 17596 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:51.115362 17445 rpcz_store.cc:276] 0709 13:19:49.590883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.524034 (+933151us) service_pool.cc:224] Handling call
0709 13:19:50.524268 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.591805 (+ 67537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.591848 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:50.591904 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:50.591949 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.113135 (+521186us) spinlock_profiling.cc:243] Waited 67.3 ms on lock 0x7b54000dbbd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:51.113189 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.113319 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154880384}
W20260709 13:19:51.117887 22199 log.cc:927] Time spent T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:19:51.120682 17596 raft_consensus.cc:1240] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:51.127744 17602 raft_consensus.cc:1240] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:51.110479 22166 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:51.137509 18167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.003s	sys 0.051s
W20260709 13:19:51.116922 22127 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.090s	user 0.017s	sys 0.031s
W20260709 13:19:51.144025 18167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.004s	sys 0.051s
I20260709 13:19:51.146366 17521 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
W20260709 13:19:51.144569 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 611959us
I20260709 13:19:51.152638 17454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2322) took 2455 ms. Trace:
I20260709 13:19:51.153116 17454 rpcz_store.cc:276] 0709 13:19:48.697613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.145050 (+447437us) service_pool.cc:224] Handling call
0709 13:19:49.145433 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.214728 (+ 69295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.214756 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:49.214801 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:49.214828 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.152376 (+1937548us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b5400214b54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:51.152427 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.152576 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158903168}
I20260709 13:19:51.165053 17602 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:51.111423 22096 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.134182 22015 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:51.091364 21980 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.196601 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.122192 22200 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.201099 17521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:19:51.201824 17521 raft_consensus.cc:606] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:51.217279 17521 raft_consensus.cc:614] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:51.266928 22205 log.cc:927] Time spent T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 13:19:51.268567 22204 log.cc:927] Time spent T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:19:51.196008 22015 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:51.193842 21880 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:51.270481 21880 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:51.272440 22015 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:51.275727 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.276340 17602 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:51.273088 21880 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.277860 21980 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:51.294418 17602 raft_consensus.cc:1240] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:51.305672 22206 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:19:51.299060 21875 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.299840 21784 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.323367 17602 raft_consensus.cc:1240] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:51.278908 22161 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.281533 22145 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.329381 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:51.330571 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:51.331163 22157 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.335140 17447 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:51.336386 17450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2345) took 1612 ms. Trace:
I20260709 13:19:51.337370 18199 raft_consensus.cc:3055] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:51.327260 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:51.342888 17450 rpcz_store.cc:276] 0709 13:19:49.724270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.530777 (+806507us) service_pool.cc:224] Handling call
0709 13:19:50.531012 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.611834 (+ 80822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.336171 (+724337us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b540004fe54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:51.336329 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152620928}
I20260709 13:19:51.344285 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:51.345516 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 497) took 1754 ms. Trace:
I20260709 13:19:51.346115 17447 rpcz_store.cc:276] 0709 13:19:49.591171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.523892 (+932721us) service_pool.cc:224] Handling call
0709 13:19:50.540843 (+ 16951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.334972 (+794129us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b5400145120. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5adddc0 00007f5ab5b681c0 00007f5ab5b69231 00007f5ab5b65d8f 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c
0709 13:19:51.345249 (+ 10277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.345444 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7683456}
I20260709 13:19:51.343685 18199 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:51.350059 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:51.350872 17454 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:51.351420 17420 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:51.353529 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.354483 17602 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:51.362243 22157 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:51.362962 22157 raft_consensus.cc:697] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:51.359050 18199 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:51.364216 22157 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.364852 18199 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:51.356139 22161 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:51.377823 22057 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.389600 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.390769 17602 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:19:51.402449 17447 pending_rounds.cc:85] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 6
I20260709 13:19:51.402659 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:51.406956 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.439684 17447 pending_rounds.cc:107] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:51.440158 17447 raft_consensus.cc:2889] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:51.440726 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.407248 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.409905 17597 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:51.441769 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.443116 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:51.411571 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:51.405272 21755 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.393532 22032 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:51.419818 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.393091 21784 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:51.387333 22145 consensus_queue.cc:1059] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:19:51.429714 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:51.417341 22202 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:19:51.393777 22057 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.389766 22161 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.483656 17527 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:51.416906 22096 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:51.445798 17495 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.010s	sys 0.030s
W20260709 13:19:51.484573 17495 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.011s	sys 0.030s
W20260709 13:19:51.484944 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 568649us
W20260709 13:19:51.485468 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.485981 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.447021 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:51.447717 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:51.448541 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:51.432934 22200 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.455564 17454 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:51.462774 22145 raft_consensus.cc:3055] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:51.451833 21755 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:51.453613 22032 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.461301 21784 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.468312 21968 raft_consensus.cc:3055] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:51.533715 18199 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:51.474860 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:51.543255 17450 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:51.477200 17525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 2060) took 1869 ms (client timeout 2125 ms). Trace:
I20260709 13:19:51.478700 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:51.545117 17597 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:51.479609 17449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:47856 (request call id 10) took 2109 ms. Trace:
I20260709 13:19:51.539964 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:51.545691 17449 rpcz_store.cc:276] 0709 13:19:49.370298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.531996 (+1161698us) service_pool.cc:224] Handling call
0709 13:19:51.479280 (+947284us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400192b54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6c735 00007f5abab2cd29 00007f5ab40ab1d4 00007f5ab40ab162 00007f5ab40ab091 00007f5ab40ab00c 00007f5ab40aa2c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:51.479493 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779225984}
I20260709 13:19:51.482563 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.496856 22145 raft_consensus.cc:740] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:51.490556 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 344773us
I20260709 13:19:51.491267 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.558259 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:51.445000 22192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.031s	sys 0.020s
I20260709 13:19:51.509690 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.528934 18167 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:51.600353 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 71523.9us
I20260709 13:19:51.521903 17596 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:19:51.532301 17602 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:51.540088 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:51.546535 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:51.435200 22207 log.cc:927] Time spent T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:19:51.544862 17525 rpcz_store.cc:269] 0709 13:19:49.607973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.616743 (+  8770us) service_pool.cc:224] Handling call
0709 13:19:51.476920 (+1860177us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540037ffd4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:51.477122 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332905216}
I20260709 13:19:51.531508 21744 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.535454 21968 raft_consensus.cc:740] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:51.563807 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.536834 22138 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:51.564913 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:51.568763 21755 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:51.581957 22109 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:51.511384 22048 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:19:51.527602 22095 consensus_queue.cc:1059] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:19:51.537192 22208 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:19:51.613891 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.614334 22208 consensus_queue.cc:1243] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer abf46e430b7e4ad4919ca2a717f37e0e log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:51.614399 22095 raft_consensus.cc:3055] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:51.614688 17598 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:51.614951 22095 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:51.615695 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.611364 22109 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.615846 22095 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.616860 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:51.617111 22095 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:51.610781 21971 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:51.618386 21971 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:51.618856 21971 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.619844 22101 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:51.618396 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:51.622807 17595 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:51.624146 17595 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:51.595963 21977 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:51.596458 22145 consensus_queue.cc:260] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:51.626820 17598 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:51.627106 22145 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.628186 21975 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:51.629702 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.542150 22100 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:51.630373 22100 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:51.630924 22163 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.632592 22100 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:51.550081 21875 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:51.536646 22200 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 13:19:51.605017 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 58570.1us
I20260709 13:19:51.633239 21875 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:51.633934 21875 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:51.634274 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:51.635412 22200 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:51.608318 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:51.635905 22200 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.609182 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:51.542975 22044 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:19:51.635375 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:51.591981 22120 consensus_meta.cc:287] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
I20260709 13:19:51.561384 22156 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
W20260709 13:19:51.638656 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.639081 21880 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:51.639164 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:51.639528 21880 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.639936 21880 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:51.640683 17569 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:51.641084 22044 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:51.539512 22198 consensus_queue.cc:1059] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:19:51.642817 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:51.638082 22120 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:51.645828 17596 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:51.635946 22169 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.647648 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:51.643924 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:51.641851 17569 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:51.642725 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:51.650410 17525 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 10: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:51.641618 22044 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.650718 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:51.617733 22109 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:51.652750 21977 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:51.653553 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:51.653714 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:51.648276 22198 raft_consensus.cc:3055] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:51.654066 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:51.659653 17520 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:51.645807 22192 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:51.646792 22200 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:51.610823 21744 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:51.674998 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:51.655969 21975 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:51.666648 18201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42548 (request call id 411) took 1301 ms. Trace:
I20260709 13:19:51.645785 22006 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:51.648988 22048 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.645594 22138 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:51.656966 22198 raft_consensus.cc:740] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:19:51.691756 17603 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.025s	sys 0.014s
I20260709 13:19:51.687613 18201 rpcz_store.cc:276] 0709 13:19:50.361565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.362174 (+   609us) service_pool.cc:224] Handling call
0709 13:19:50.388919 (+ 26745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.414211 (+ 25292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.414243 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.453945 (+ 39702us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.038983 (+585038us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:51.039040 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.039129 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.662966 (+623837us) raft_consensus.cc:1685] finished
0709 13:19:51.662983 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.663101 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24868,"raft.queue_time_us":25175,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":560536,"threads_started":1,"wal-append.queue_time_us":714539}
W20260709 13:19:51.694526 17603 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.028s	sys 0.014s
I20260709 13:19:51.656298 22095 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.675570 22100 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:51.670806 22127 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:51.670902 21968 consensus_queue.cc:260] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:51.714931 21968 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:51.697000 21980 consensus_queue.cc:1059] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:19:51.720149 22120 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:51.701107 22044 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.721421 22044 raft_consensus.cc:3055] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:51.721845 22044 raft_consensus.cc:740] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:51.722267 21971 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:51.722941 22044 consensus_queue.cc:260] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.694250 22048 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.724973 21971 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:51.726776 22048 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.698568 22138 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:51.746618 22166 consensus_meta.cc:287] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.006s
W20260709 13:19:51.801118 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet abb20677645b433e839a2f21c9cc2ef3: Illegal state: Replica 0480cf54c3cc424ab94b963ef2ff5bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:51.470690 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:51.806859 17448 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:51.666009 17529 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
W20260709 13:19:51.823441 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.824941 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.825958 17494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.014s	sys 0.018s
W20260709 13:19:51.826519 17494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.014s	sys 0.018s
W20260709 13:19:51.666882 17568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.025s	sys 0.067s
W20260709 13:19:51.834519 17568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.025s	sys 0.067s
W20260709 13:19:51.841447 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 155023us
I20260709 13:19:51.700691 21744 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:51.848824 17569 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:51.850987 21971 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:51.852160 21977 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:51.852397 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.855924 22100 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:51.884196 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.884636 22224 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:51.885512 22224 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.892179 22224 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.710055 22127 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.700095 22095 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:51.936916 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.888687 21971 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:51.941906 22228 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.942675 22138 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.944116 22095 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.951717 22127 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:51.950398 22198 consensus_queue.cc:260] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:51.954156 17446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.012s
W20260709 13:19:51.954782 17446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.008s	sys 0.012s
I20260709 13:19:51.955423 21744 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:51.956269 21744 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:51.957607 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 130571us
W20260709 13:19:51.962770 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.966826 17452 raft_consensus.cc:1240] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:51.963166 21961 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:51.967842 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:51.968470 21961 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:51.970789 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.972661 17529 raft_consensus.cc:1240] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:51.963798 17448 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:51.964572 22048 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:51.978724 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 79404.5us
I20260709 13:19:51.975322 22048 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:51.984670 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1922) took 1439 ms. Trace:
I20260709 13:19:51.989279 22144 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:51.990833 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:51.991282 17523 raft_consensus.cc:3055] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:51.992365 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:51.993494 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:51.995750 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:51.942862 22228 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.036705 21811 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:19:52.012626 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.034359 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 311336us
I20260709 13:19:52.040323 21811 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.014828 17419 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:51.934293 22224 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:52.018982 21880 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.023789 22004 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.024228 21744 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:51.998857 22166 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:52.024957 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.021576 17523 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:52.025686 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.026669 21971 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:52.040454 22221 consensus_queue.cc:1059] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
W20260709 13:19:52.044487 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 0c198fb42e5b400c91f60d6969641780: Remote error: Service unavailable: leader transfer in progress
I20260709 13:19:52.019636 17446 rpcz_store.cc:276] 0709 13:19:50.545270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.910382 (+365112us) service_pool.cc:224] Handling call
0709 13:19:50.969197 (+ 58815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.969468 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:51.399300 (+429832us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.984029 (+584729us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:51.984132 (+   103us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:51.984234 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.984347 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.984582 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22813,"prepare.queue_time_us":667583,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":48318,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":149,"spinlock_wait_cycles":45594368,"thread_start_us":960827,"threads_started":2,"wal-append.queue_time_us":560783}
I20260709 13:19:52.042382 22212 consensus_queue.cc:1059] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:19:52.077047 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 62524.9us
I20260709 13:19:52.077440 22212 raft_consensus.cc:3055] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:52.077986 22212 raft_consensus.cc:740] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:52.078204 17419 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:52.079275 22021 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:52.080118 22021 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:52.080811 21880 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.081820 21811 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.081279 22212 consensus_queue.cc:260] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:52.083498 22212 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.083878 22057 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.086544 22161 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.027896 17524 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:19:52.011334 21961 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.075083 22224 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.028628 17521 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:52.035315 17529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:19:52.120404 22163 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:52.038507 22228 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.123364 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:52.126014 22044 raft_consensus.cc:3060] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:52.126366 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.129146 22224 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.129904 22004 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.143074 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.153983 17525 raft_consensus.cc:2410] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:52.042416 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:52.052809 17495 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:52.153170 22032 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.133834 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:52.053525 22237 consensus_queue.cc:1059] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:19:52.119020 17524 pending_rounds.cc:85] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 7
I20260709 13:19:52.133230 17453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55882 (request call id 1924) took 1587 ms. Trace:
I20260709 13:19:52.167497 17521 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:52.068487 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.065596 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2574) took 2398 ms. Trace:
I20260709 13:19:52.173216 17522 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:52.177703 18199 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:52.134804 21821 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.180430 22237 consensus_queue.cc:1243] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer 0480cf54c3cc424ab94b963ef2ff5bf4 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:52.180639 21821 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.181348 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:52.182381 17525 raft_consensus.cc:2393] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:19:52.182257 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 129615us
I20260709 13:19:52.183696 21821 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:52.185171 22200 consensus_meta.cc:287] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.008s
I20260709 13:19:52.053135 22095 consensus_queue.cc:1059] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.133s
W20260709 13:19:52.186234 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 144012us
I20260709 13:19:52.176262 17527 rpcz_store.cc:276] 0709 13:19:49.666627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.845609 (+178982us) service_pool.cc:224] Handling call
0709 13:19:51.480356 (+1634747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.492904 (+ 12548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.064938 (+572034us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540037ffd0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b658ad 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:52.065307 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3758806400}
W20260709 13:19:52.162376 21875 consensus_meta.cc:287] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.005s
I20260709 13:19:52.136023 22101 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.051942 22048 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.191890 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:52.136267 22145 consensus_meta.cc:287] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.011s
I20260709 13:19:52.178509 17524 pending_rounds.cc:107] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:19:52.077059 21784 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.215826 22185 raft_consensus.cc:3055] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:19:52.238406 17495 connection.cc:256] RPC call timeout handler was delayed by -1.1727133800000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
I20260709 13:19:52.190588 22237 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:52.134375 22030 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.240828 22237 raft_consensus.cc:697] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:52.241290 22030 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.242103 22237 consensus_queue.cc:237] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.243700 22030 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:52.214134 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 365552us
I20260709 13:19:52.245330 17569 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:52.247144 22110 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:52.230304 22233 log.cc:927] Time spent T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.182s	user 0.001s	sys 0.003s
I20260709 13:19:52.247821 22110 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.248342 22110 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.163980 17453 rpcz_store.cc:276] 0709 13:19:50.545780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.913534 (+367754us) service_pool.cc:224] Handling call
0709 13:19:50.913950 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.091395 (+177445us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:51.549550 (+458155us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.968761 (+419211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:51.968905 (+   144us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:51.969031 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.132793 (+163762us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400369054. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:52.132845 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.133023 (+   178us) inbound_call.cc:177] Queueing success response
0709 13:19:52.141174 (+  8151us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
Metrics: {"prepare.queue_time_us":545893,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":2753,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":315,"spinlock_wait_cycles":456038528,"thread_start_us":827776,"threads_started":2,"wal-append.queue_time_us":408086}
I20260709 13:19:52.223933 22095 raft_consensus.cc:3055] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:52.250185 22095 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:52.251598 22242 log.cc:927] Time spent T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:19:52.251336 22095 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.252765 22095 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:52.252978 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.218746 22166 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.215026 22004 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:52.222939 17450 consensus_meta.cc:287] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.011s
I20260709 13:19:52.255487 17450 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
W20260709 13:19:52.204770 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 68443.9us
I20260709 13:19:52.135020 22097 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.262482 22097 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:52.215929 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.263749 17522 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:52.239478 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:52.265347 18200 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 9: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:52.267221 17520 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:52.268471 22239 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.296s	user 0.000s	sys 0.003s
I20260709 13:19:52.269896 22097 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:52.190847 22101 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:52.272181 22232 log.cc:927] Time spent T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.313s	user 0.001s	sys 0.001s
I20260709 13:19:52.272303 22101 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:52.226109 17597 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:52.274652 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.275003 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.276218 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.277060 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.277169 17601 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:52.278524 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.278967 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.279260 17598 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:52.280225 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.281523 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.206401 22120 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.206293 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.212312 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:52.224504 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.227517 17599 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:52.225768 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.235606 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:52.240167 17603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52572 (request call id 602) took 1179 ms. Trace:
I20260709 13:19:52.247138 17569 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:52.213960 21687 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:52.226559 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.276221 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.265898 17522 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:19:52.291064 17522 pending_rounds.cc:85] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 6
I20260709 13:19:52.285769 17524 raft_consensus.cc:2889] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.291479 17522 pending_rounds.cc:107] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:19:52.290247 17602 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:52.291836 17522 raft_consensus.cc:2889] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:52.293792 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.208729 22169 consensus_meta.cc:287] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.005s
I20260709 13:19:52.294485 17528 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 8.
I20260709 13:19:52.294494 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.185706 22200 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.307673 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:52.307747 22120 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.308939 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:52.310854 22240 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.349s	user 0.000s	sys 0.002s
I20260709 13:19:52.285933 22185 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:52.308830 17528 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:52.179111 22127 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.316305 18201 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:52.287317 17603 rpcz_store.cc:276] 0709 13:19:51.060137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.067300 (+  7163us) service_pool.cc:224] Handling call
0709 13:19:51.067695 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.694942 (+627247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.694976 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.829688 (+134712us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.945247 (+115559us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:51.964764 (+ 19517us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.987818 (+ 23054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.987949 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.239771 (+251822us) raft_consensus.cc:1685] finished
0709 13:19:52.239802 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.239969 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22715,"prepare.queue_time_us":8136,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":85645,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":5209,"thread_start_us":735580,"threads_started":2,"wal-append.queue_time_us":344690}
I20260709 13:19:52.291087 21875 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.328858 17526 raft_consensus.cc:2368] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15.
I20260709 13:19:52.330142 22200 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:52.332304 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 85299us
I20260709 13:19:52.333176 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:52.336820 17523 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.315770 21687 raft_consensus.cc:697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:52.319584 17596 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:19:52.322942 22166 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.343983 22120 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.346354 22166 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:52.347728 17420 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.525s (SENT) [suppressed 7 similar messages]
I20260709 13:19:52.350435 17521 raft_consensus.cc:2410] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:52.351034 22015 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:52.357792 17529 raft_consensus.cc:606] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:52.358704 17529 raft_consensus.cc:614] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:52.361503 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.363977 17528 raft_consensus.cc:2468] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
I20260709 13:19:52.330158 21875 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.367851 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.371583 17523 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:52.368752 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 43980.8us
W20260709 13:19:52.383625 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 50541.3us
I20260709 13:19:52.369426 22101 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:52.357926 21784 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:52.403515 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 162935us
W20260709 13:19:52.402837 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 272217us
I20260709 13:19:52.398411 22101 raft_consensus.cc:697] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:52.418817 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.421139 22227 log.cc:927] Time spent T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.425s	user 0.001s	sys 0.004s
I20260709 13:19:52.413371 21784 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.412482 22185 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:52.442891 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:52.443122 22101 consensus_queue.cc:237] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:52.436439 21687 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.447624 17569 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:52.453418 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:52.451108 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:52.454457 17447 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:52.446575 22127 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:52.462608 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.462775 22198 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:52.463928 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.467324 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.462493 22144 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:52.470420 22144 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.470840 22144 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:52.470734 17521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
W20260709 13:19:52.473510 18164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.479400 22166 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:52.480407 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 52777us
I20260709 13:19:52.483552 18166 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:52.484519 22221 raft_consensus.cc:2804] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:52.485054 22221 raft_consensus.cc:697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:52.485260 22144 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.486562 21784 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.487474 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:52.487766 22144 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:52.488343 17449 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:52.488716 17569 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:52.489886 22144 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:52.490911 22110 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:52.493486 22110 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:52.496697 17352 catalog_manager.cc:5697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.497236 22221 consensus_queue.cc:237] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:52.498180 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.504892 17528 raft_consensus.cc:1275] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:19:52.505609 17523 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:19:52.503867 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.505770 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:52.505317 17528 pending_rounds.cc:85] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 7
I20260709 13:19:52.507352 17528 pending_rounds.cc:107] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:19:52.507779 17528 raft_consensus.cc:2889] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.474659 22237 raft_consensus.cc:2764] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:52.508217 17527 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 11: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:52.505635 17521 raft_consensus.cc:606] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:52.506163 17523 pending_rounds.cc:85] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 8
I20260709 13:19:52.507483 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:52.510105 17521 raft_consensus.cc:614] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:52.524288 17523 pending_rounds.cc:107] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:19:52.524633 17523 raft_consensus.cc:2889] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.510987 17603 pending_rounds.cc:85] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 8
W20260709 13:19:52.518992 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 44418us
I20260709 13:19:52.519131 21784 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:52.520390 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:52.521282 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:52.525177 17603 pending_rounds.cc:107] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:19:52.525869 17603 raft_consensus.cc:2889] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.532106 17594 raft_consensus.cc:2393] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:52.535282 21784 raft_consensus.cc:3055] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:52.535462 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.535820 21784 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:52.536819 21784 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.538286 21784 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:52.540299 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.540794 17419 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:52.542449 22157 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:52.543076 22157 raft_consensus.cc:697] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:52.543823 17523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:19:52.544574 22158 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.544166 22157 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.545285 22158 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:52.546254 18194 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 10.
I20260709 13:19:52.544472 17523 raft_consensus.cc:606] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:52.547317 17523 raft_consensus.cc:614] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:52.548225 22158 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:52.549381 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:52.550578 17527 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:52.552745 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 64165.5us
I20260709 13:19:52.554430 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.554944 22185 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.555270 17527 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 13.
I20260709 13:19:52.556988 18166 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:52.558001 22158 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:52.558568 22158 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.559070 22158 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.558673 21977 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:52.559836 17352 catalog_manager.cc:5697] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 2 to 8, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:52.562321 17419 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:52.563480 21977 consensus_queue.cc:1059] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:52.564689 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:52.564898 21977 raft_consensus.cc:3055] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:52.566857 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 66631.8us
I20260709 13:19:52.568388 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.569106 17526 pending_rounds.cc:85] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 7
I20260709 13:19:52.570492 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:52.571872 22251 log.cc:927] Time spent T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:19:52.597636 17526 pending_rounds.cc:107] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:19:52.561884 17352 catalog_manager.cc:5697] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 7 to 8, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 8 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:19:52.604387 17526 raft_consensus.cc:2889] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.605497 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:19:52.608166 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 103625us
I20260709 13:19:52.607712 17523 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:52.609584 17521 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:19:52.608341 17568 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:52.607937 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:52.597002 21977 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:52.612123 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 49969.7us
I20260709 13:19:52.615127 17352 catalog_manager.cc:5697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:52.621631 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 57097.5us
I20260709 13:19:52.622908 17419 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:52.615217 22004 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:52.612144 22237 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:52.622918 17569 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:52.610108 22144 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:52.632211 22237 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.631886 17352 catalog_manager.cc:5697] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 3 to 9, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 9 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.632882 17495 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:52.623430 21687 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:52.634310 17419 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:52.634728 22095 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:19:52.636782 22120 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:52.619580 22097 consensus_queue.cc:1059] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:19:52.640324 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:52.638620 21977 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.669487 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:52.666440 17445 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:52.635854 22127 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:52.672441 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 50124.5us
I20260709 13:19:52.643514 17352 catalog_manager.cc:5697] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:52.676905 18166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.636197 21687 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:52.667212 22252 log.cc:927] Time spent T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:19:52.691339 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 43860.1us
I20260709 13:19:52.640707 22015 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:52.640590 22120 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.638907 22004 raft_consensus.cc:697] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:52.695931 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:52.698683 17446 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:19:52.702000 21821 consensus_queue.cc:1059] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:52.702685 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:52.703402 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:52.703759 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:52.704049 17523 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:52.704408 17454 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:52.704437 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:52.705516 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:52.705622 22097 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:52.706307 17448 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:52.707759 21821 raft_consensus.cc:3055] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:52.708186 21821 raft_consensus.cc:740] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:52.703402 17446 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:52.705978 17451 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.710127 22145 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:52.709228 21821 consensus_queue.cc:260] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.711472 21821 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:52.717175 22120 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:52.723655 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.730111 22095 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:52.732332 22144 raft_consensus.cc:3055] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:52.732791 22144 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:52.734299 22144 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.726297 22004 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.740999 22144 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:52.743062 22237 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.732986 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:52.745600 22145 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:52.745970 22145 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.732064 17352 catalog_manager.cc:5697] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.746412 22145 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:52.758663 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 128460us
W20260709 13:19:52.763736 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 136116us
I20260709 13:19:52.634549 22110 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:19:52.686951 21687 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.766302 17451 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 16.
W20260709 13:19:52.769127 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 131711us
I20260709 13:19:52.758131 21977 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:52.776712 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:52.785157 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.780687 22127 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.799075 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.803450 22158 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:52.810302 22127 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.811102 17522 pending_rounds.cc:85] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 9
I20260709 13:19:52.811575 17522 pending_rounds.cc:107] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:19:52.811923 17522 raft_consensus.cc:2889] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.812567 22127 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:52.816267 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.816648 18167 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:52.817030 17528 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:52.818295 17521 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:52.819110 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.819895 21687 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:52.820362 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:52.821067 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:52.791388 21784 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:19:52.834218 17419 leader_election.cc:400] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15.
I20260709 13:19:52.835000 17419 leader_election.cc:403] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:19:52.838585 21961 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:52.840673 22258 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.050s	user 0.003s	sys 0.000s
I20260709 13:19:52.841418 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.842471 17524 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:52.843713 22157 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:52.844579 21821 consensus_queue.cc:1048] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:52.846876 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.851511 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.852494 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.805812 22158 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:52.846976 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:52.855733 17529 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:52.862139 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.862588 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.865396 17568 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:52.866271 22030 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:52.866669 22030 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:52.867069 22030 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.867503 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:52.868157 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.869069 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.871042 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:52.868171 17521 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:52.867777 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:52.874156 17351 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40488 (request call id 192) took 26978 ms (client timeout 15000 ms). Trace:
W20260709 13:19:52.881042 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 92256.4us
I20260709 13:19:52.883344 22030 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:52.885213 17352 catalog_manager.cc:5697] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.901571 17419 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:52.874610 17351 rpcz_store.cc:269] 0709 13:19:25.787621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.787947 (+   326us) service_pool.cc:224] Handling call
0709 13:19:52.760043 (+26972096us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:49.041832 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:49.042519 (+   687us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:49.042553 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:19:49.042570 (+    17us) tablet.cc:662] Decoding operations
0709 13:19:49.050896 (+  8326us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:49.050990 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:49.051019 (+    29us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:19:49.053409 (+  2390us) tablet.cc:701] Row locks acquired
0709 13:19:49.053429 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:49.053577 (+   148us) write_op.cc:270] Start()
0709 13:19:49.053686 (+   109us) write_op.cc:276] Timestamp: P: 1783603189053521 usec, L: 0
0709 13:19:49.053705 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:19:49.128205 (+ 74500us) log.cc:844] Serialized 8690 byte log entry
0709 13:19:49.478552 (+350347us) op_driver.cc:464] REPLICATION: finished
0709 13:19:49.678353 (+199801us) write_op.cc:301] APPLY: starting
0709 13:19:49.681320 (+  2967us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:50.411155 (+729835us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:50.411270 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:50.934706 (+523436us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:50.935074 (+   368us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:19:50.935120 (+    46us) write_op.cc:312] APPLY: finished
0709 13:19:50.935615 (+   495us) log.cc:844] Serialized 196 byte log entry
0709 13:19:51.329783 (+394168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:51.331762 (+  1979us) write_op.cc:454] Released schema lock
0709 13:19:51.332151 (+   389us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:51.336335 (+  4184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:51.341099 (+  4764us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":171916,"apply.run_cpu_time_us":102248,"apply.run_wall_time_us":1667043,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96131,"num_ops":22,"prepare.queue_time_us":187252,"prepare.run_cpu_time_us":14118,"prepare.run_wall_time_us":157002,"raft.queue_time_us":120154,"raft.run_cpu_time_us":57467,"raft.run_wall_time_us":77872,"replication_time_us":424658,"thread_start_us":757211,"threads_started":5,"wal-append.queue_time_us":790404,"wal-append.run_cpu_time_us":44316,"wal-append.run_wall_time_us":2303074}]]}
I20260709 13:19:52.909272 17495 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:19:52.900936 22255 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
W20260709 13:19:52.916076 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.920460 17352 catalog_manager.cc:5697] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.899290 22221 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:52.923476 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 106894us
I20260709 13:19:52.913021 21784 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:52.935599 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:52.931526 17419 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:52.940785 21744 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:52.954432 18165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.993850 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:52.946457 17419 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:52.995232 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 50649.9us
I20260709 13:19:52.997004 17450 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 13.
I20260709 13:19:52.997174 17451 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:52.906327 22145 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:53.007911 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:53.008623 17446 raft_consensus.cc:3060] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.939472 21784 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:52.944734 21744 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.027661 22030 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:53.028550 22030 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:53.034497 21744 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:53.040839 22158 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:53.041496 22158 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:53.045207 22144 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:53.045823 22144 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.047953 22144 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:53.048472 22144 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:53.048825 22144 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:53.050582 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:53.053077 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 364784us
I20260709 13:19:53.054840 17569 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:53.052758 22158 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:53.060604 21687 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:53.064216 22097 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:53.065063 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.070840 17529 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 14.
I20260709 13:19:53.064633 21961 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15.
I20260709 13:19:53.072606 18166 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:53.073710 17449 raft_consensus.cc:2393] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 11: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:53.078437 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.073061 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 74494.2us
W20260709 13:19:53.093914 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 197042us
I20260709 13:19:53.061635 21784 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.095641 17446 raft_consensus.cc:2468] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 14.
I20260709 13:19:53.099599 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:53.073585 22127 raft_consensus.cc:2764] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
W20260709 13:19:53.104686 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 234290us
I20260709 13:19:53.093176 22212 raft_consensus.cc:2804] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:53.049778 22144 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.110419 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:53.111280 18194 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 9: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:53.113179 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:53.112329 22237 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:53.125048 17529 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:53.129321 21977 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:53.130505 21977 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:53.130884 21977 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:53.131677 21977 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.132752 21977 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:53.133599 22198 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:53.135186 17450 raft_consensus.cc:1240] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:53.136664 17449 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:53.137998 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.137950 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.114342 22212 raft_consensus.cc:697] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
W20260709 13:19:53.144977 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.144927 17447 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:53.125934 22144 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:53.155277 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 158032us
I20260709 13:19:53.143440 22095 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:53.157310 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.157861 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.159582 17568 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:53.164490 17446 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
W20260709 13:19:53.166484 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 60247.7us
I20260709 13:19:53.153170 22212 consensus_queue.cc:237] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:53.146550 22120 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.173466 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:53.173964 22268 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:53.174459 22268 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.174779 22268 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.177456 17445 raft_consensus.cc:2393] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 11: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:53.178772 22120 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:53.155226 21961 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:53.184930 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.195062 22145 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:53.167124 17568 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:53.204089 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.189373 21784 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.209867 22101 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:53.210207 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:53.212276 22127 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.212873 22127 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.219295 22237 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.220108 22237 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:53.225621 17420 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:53.226150 21784 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:53.226501 22145 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:53.228219 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 282937us
I20260709 13:19:53.210449 22101 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.242944 17420 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:53.261116 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.262802 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:53.264096 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 93919.4us
I20260709 13:19:53.265069 22095 raft_consensus.cc:697] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:53.268451 22221 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:53.269703 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.270326 17603 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:53.270478 17600 raft_consensus.cc:3055] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:53.270803 17600 raft_consensus.cc:740] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:53.271243 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.271477 17600 consensus_queue.cc:260] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:53.271803 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:53.272449 17529 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.241580 22101 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:53.277156 17600 raft_consensus.cc:3060] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.227931 22145 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:19:53.230332 21744 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.281702 17451 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:53.278942 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:53.280720 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:53.279625 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:53.287220 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:53.287994 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.282716 21744 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:53.303488 18167 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:53.291676 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:53.292793 17521 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
W20260709 13:19:53.293169 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 50313.9us
I20260709 13:19:53.266104 22032 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:53.305498 17521 pending_rounds.cc:85] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 8
I20260709 13:19:53.305454 17520 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.301448 22127 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:53.303328 17524 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:53.306038 17521 pending_rounds.cc:107] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:19:53.307889 17521 raft_consensus.cc:2889] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:53.312218 17522 raft_consensus.cc:1240] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:53.324517 17527 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:53.328269 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:53.316550 22032 raft_consensus.cc:697] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:53.311908 22166 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:53.335453 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:53.337832 22032 consensus_queue.cc:237] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.314008 21784 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:53.344220 21784 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.346622 21784 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:53.348991 17600 raft_consensus.cc:1275] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:19:53.349521 17600 pending_rounds.cc:85] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 9
I20260709 13:19:53.349890 17600 pending_rounds.cc:107] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:19:53.350445 17600 raft_consensus.cc:2889] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:53.351615 22095 consensus_queue.cc:237] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:53.354743 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.357913 22120 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:53.331197 22030 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:19:53.359263 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.330839 22275 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:53.359661 22268 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.359908 22275 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:53.363648 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.361819 22275 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:53.366132 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:53.366079 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:53.371671 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:53.372227 17522 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.327677 22198 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:53.378886 17521 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:53.335994 21687 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.362310 22166 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:53.396076 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 67929.6us
I20260709 13:19:53.361791 22268 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:53.377525 21821 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:53.377871 22127 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:53.410607 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:53.399794 22166 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.402173 22157 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:19:53.417521 21821 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.430733 21821 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:53.379585 22030 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.433524 22030 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:53.399475 21687 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.436314 21687 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:53.437669 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:53.439404 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:53.441977 21744 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:53.442320 22269 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.385154 17529 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:53.426782 22274 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:19:53.449513 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 146129us
I20260709 13:19:53.460863 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:53.472184 17568 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:53.474150 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 193762us
W20260709 13:19:53.477376 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 70349.1us
I20260709 13:19:53.460265 22269 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.488075 22287 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.488667 22287 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:53.490990 22287 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:53.493871 22157 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:53.480899 22144 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:53.494881 21744 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:53.495656 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:53.499439 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.500341 17600 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 13.
I20260709 13:19:53.502489 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:53.505504 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:53.507723 22144 raft_consensus.cc:697] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:53.508781 22144 consensus_queue.cc:237] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.510389 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:53.514220 22264 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:53.515365 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:53.517632 17524 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 15: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:53.515592 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:53.469735 22212 consensus_queue.cc:1048] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:19:53.546341 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.546389 18200 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:53.552042 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.552734 17450 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:53.553485 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.554080 17446 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
W20260709 13:19:53.539011 22257 log.cc:927] Time spent T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:19:53.555785 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.557807 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:53.555920 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.560173 17449 raft_consensus.cc:2393] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 11: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:53.557775 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.488679 22269 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:53.538481 22185 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.580020 17602 raft_consensus.cc:2393] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:53.514894 22264 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:53.580644 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:53.581090 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.584075 17594 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 10.
I20260709 13:19:53.591923 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.592442 17603 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:53.558430 22279 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:53.594779 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:53.601254 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 114845us
I20260709 13:19:53.608167 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:53.607856 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.610713 17454 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 15. Current term is 16. Ops: [13.7-15.9]
I20260709 13:19:53.611696 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.613389 17596 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:53.593261 22293 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:53.587273 22185 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:53.613312 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:53.617005 17520 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:53.614957 17451 raft_consensus.cc:2393] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 11: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:53.618201 17419 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:53.618465 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.619175 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.619742 17602 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:53.625054 22291 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:53.625953 22291 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:53.616216 22293 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.627372 22291 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.628451 22293 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.640980 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.641929 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.652643 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.653582 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.654230 17600 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:53.648295 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.655479 17522 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:53.661128 22185 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:53.666150 17568 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:53.669535 17522 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:53.679829 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.680558 17526 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:53.688020 22293 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:53.695957 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.697414 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:53.699119 17600 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:19:53.699348 17596 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.703083 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:53.666180 21687 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:53.710197 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:53.693552 22015 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:53.713716 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.715476 17453 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 14.
I20260709 13:19:53.664922 22101 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.720501 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:53.723475 22298 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:53.737577 17529 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:53.738135 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.669080 22279 consensus_queue.cc:1059] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:19:53.753341 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:53.757316 17594 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:53.753813 17596 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:53.721714 22015 raft_consensus.cc:697] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:53.831585 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.832197 17597 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:53.832468 22015 consensus_queue.cc:237] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:53.833122 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:53.834570 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.830534 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:53.830883 17601 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.839993 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:53.831291 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.830598 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:53.842836 17599 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.842941 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.844053 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:53.720103 21687 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:53.835002 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.846381 22030 consensus_queue.cc:1059] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:53.846982 17596 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:53.847849 17597 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:53.836721 22166 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:53.830542 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:53.848317 17600 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:53.851282 17594 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:19:53.848907 17602 raft_consensus.cc:2376] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14. Re-sending same reply.
W20260709 13:19:53.868665 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 109279us
W20260709 13:19:53.906638 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.908985 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:53.909797 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.912325 22293 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:53.918087 17601 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:53.923249 17600 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:19:53.924223 18201 raft_consensus.cc:2393] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 11: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
W20260709 13:19:53.933353 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 67321us
I20260709 13:19:53.865379 21977 raft_consensus.cc:3055] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:53.857170 21687 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:53.944075 22299 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:53.946655 22101 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:53.948312 17601 raft_consensus.cc:1240] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:53.960882 17527 raft_consensus.cc:1240] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:53.955379 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 329658us
I20260709 13:19:53.974377 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.975020 17598 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
W20260709 13:19:53.980280 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 55191.6us
W20260709 13:19:53.982539 17420 leader_election.cc:336] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Timed out: RequestConsensusVote RPC to 127.15.242.67:36581 timed out after 1.525s (SENT)
I20260709 13:19:53.984128 17603 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:53.984575 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:53.985216 17598 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:53.922474 22264 leader_election.cc:290] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:53.989102 17599 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:53.991329 17453 raft_consensus.cc:1275] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:53.992129 22221 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.992719 22221 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:53.994155 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:53.995095 17445 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:53.995807 22221 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:53.993103 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:53.998492 17454 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.999752 17420 leader_election.cc:304] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:53.923990 22276 raft_consensus.cc:3055] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:53.951726 21977 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:54.029645 17603 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:54.037009 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.039849 22166 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.047264 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:54.056604 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:54.057327 17602 raft_consensus.cc:3060] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.960071 22004 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:19:54.025247 22276 raft_consensus.cc:740] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:54.070909 17596 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:54.059077 21744 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.041927 22157 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.080090 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:54.080294 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:54.080499 22157 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.081485 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:54.082247 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:54.082962 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 4efb13f5c64447d2bbcbef8bc568f882: Illegal state: Replica abf46e430b7e4ad4919ca2a717f37e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:54.083173 22157 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.083657 17445 raft_consensus.cc:2393] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 11: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:54.042657 22101 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:54.086374 22101 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:54.068893 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:54.073469 21961 raft_consensus.cc:2749] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:54.077853 22307 log.cc:927] Time spent T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.368s	user 0.000s	sys 0.003s
I20260709 13:19:54.078656 21977 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.081012 17448 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:54.077476 21784 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:54.091198 17447 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:54.092446 17600 raft_consensus.cc:2393] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 11: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:54.081022 17599 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 8.
I20260709 13:19:54.102202 17454 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 15.
W20260709 13:19:54.112207 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 44035.1us
I20260709 13:19:54.115161 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.117009 17451 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:54.117841 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:54.118590 17454 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:19:54.119621 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:54.121827 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:54.122432 17450 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.124771 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:54.126837 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:54.127146 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:54.127779 18201 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:19:54.122572 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:54.121522 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:54.129783 18167 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:54.056018 22221 consensus_queue.cc:1048] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:19:54.131016 17448 raft_consensus.cc:2393] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 14: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:54.134508 17447 raft_consensus.cc:2393] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 11: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:54.103070 22311 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.140347 18194 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:54.072242 22291 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:54.142462 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:54.142647 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:54.171948 17446 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:54.101172 21744 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.178625 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:54.179456 21744 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.131520 22302 raft_consensus.cc:2804] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:54.182348 22302 raft_consensus.cc:697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:54.183395 22302 consensus_queue.cc:237] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:54.078696 22276 consensus_queue.cc:260] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.186642 17602 raft_consensus.cc:2468] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 15.
I20260709 13:19:54.187083 22276 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:54.190172 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 55799.5us
I20260709 13:19:54.191190 22127 consensus_queue.cc:1059] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:54.192236 22127 consensus_queue.cc:1059] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:54.193172 22127 raft_consensus.cc:3055] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:54.193557 22127 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:54.196014 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 48333.6us
W20260709 13:19:54.196915 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 214383us
I20260709 13:19:54.242460 22280 raft_consensus.cc:3055] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:54.196252 22291 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:54.243424 22127 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:54.194823 22289 log.cc:927] Time spent T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.176s	user 0.000s	sys 0.009s
I20260709 13:19:54.171809 21977 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.143100 22311 raft_consensus.cc:493] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.115906 21784 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.193964 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:54.255505 17450 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:54.264793 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.258423 22280 raft_consensus.cc:740] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:54.282078 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:54.283946 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 90037.6us
I20260709 13:19:54.284392 17525 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:54.285795 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.271760 22144 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.270303 22311 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.288996 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:54.288255 17420 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.289758 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:54.291016 17529 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:54.275992 21744 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.298835 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:54.277264 22279 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.274741 21961 consensus_queue.cc:1059] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:19:54.289583 22273 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.293191 22032 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.313063 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.295866 22127 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.315940 22280 consensus_queue.cc:260] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.317251 22280 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.311408 22284 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.311053 22032 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:54.319116 22032 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.318711 22284 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:54.329097 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.286732 22323 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:19:54.337397 22291 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:54.338905 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.339426 22329 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.339927 22329 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.340940 21784 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.310171 22326 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:54.343189 22315 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:19:54.327831 22264 consensus_queue.cc:1059] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:19:54.344467 22329 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:54.327891 22286 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.345037 22329 raft_consensus.cc:3055] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:54.318713 17569 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.295668 22144 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.350520 17528 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:19:54.345487 22329 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:54.353964 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:54.354698 17527 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:54.359192 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.348273 21744 raft_consensus.cc:3055] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:54.352957 22120 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:54.365599 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.368875 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:54.368917 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:54.370069 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.370549 22264 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:54.371066 22264 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:54.371454 22264 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.372596 22032 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.366339 21744 raft_consensus.cc:740] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:54.374338 22328 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:54.374817 22328 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:54.375206 22328 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.375370 17419 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:54.375046 21744 consensus_queue.cc:260] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.376734 21744 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.377786 22145 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:54.366127 21961 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:54.379264 22145 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:54.379098 21961 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.379710 22145 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.380107 22145 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.381664 21961 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.382944 22299 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.383023 22284 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.370597 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:54.394775 17524 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:54.389325 22145 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.354768 22015 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:54.396934 22015 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.392342 22144 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:54.371464 17420 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.397660 22015 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:54.393532 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.399312 22030 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:54.399567 22097 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.402037 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.404263 17420 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.406530 22157 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:54.411480 22328 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.412683 22273 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.413642 22328 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:54.413818 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 123842us
I20260709 13:19:54.414824 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:54.415663 17569 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.416337 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:54.417111 22333 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.417906 17569 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.420280 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.392802 22120 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.436630 22273 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.417757 22286 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.418219 22269 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:54.436141 17420 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:54.444729 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 68519.4us
I20260709 13:19:54.418908 22110 raft_consensus.cc:3055] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:54.418686 22030 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:54.446789 22030 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.447274 22030 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.448575 18166 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:54.449498 22301 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.449898 22301 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.450657 22301 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.451467 22101 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:54.452207 22145 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.442245 22329 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.457734 22329 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.435902 21961 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.399611 22299 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:54.441514 22120 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.467209 22032 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.479705 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:54.484163 17520 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:54.439369 22264 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:54.488881 22264 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:54.489719 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.490361 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:54.458977 22110 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:54.491978 22110 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.492398 22302 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.493124 22110 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.497502 17524 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:19:54.498304 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 80452.3us
I20260709 13:19:54.492498 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:54.499085 17447 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 9.
I20260709 13:19:54.482342 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:54.501400 17569 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.462278 21961 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:54.502485 21961 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.463195 21977 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.482968 22299 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:54.506659 21977 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.508082 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.509341 17569 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.510423 22101 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:54.511086 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.511188 22101 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.514252 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:54.518239 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 52348.3us
I20260709 13:19:54.520094 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:54.521263 17352 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 102) took 5679 ms. Trace:
I20260709 13:19:54.521458 22286 raft_consensus.cc:2764] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:54.532245 22015 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:54.532965 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 75051us
I20260709 13:19:54.524333 22301 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:54.458006 22311 raft_consensus.cc:515] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:54.458238 22145 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:54.528258 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.522383 18167 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:54.537988 17420 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.535051 17419 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:54.551249 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.552377 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.553648 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.417809 22333 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:19:54.540613 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:54.534853 17568 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:54.557333 17569 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.554518 22302 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:54.559157 22274 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:54.559326 22268 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:54.556738 22032 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:54.562407 22268 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.555469 22328 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.561787 22274 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:54.563771 22274 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.562811 22032 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:54.565202 22032 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.565829 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:54.561877 22097 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:19:54.566468 17447 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.562907 22268 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.561724 22302 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.570660 22302 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.563675 17419 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:54.575512 22301 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.576159 21961 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.577126 22286 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.577194 21784 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:54.602913 21784 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.603447 21784 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.603365 22030 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:54.577904 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 55853.6us
I20260709 13:19:54.610620 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.611104 22286 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:54.578485 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:54.612746 17528 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:54.581247 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.613462 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:54.614120 17447 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:54.614550 22286 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:54.583436 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.615363 17521 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.581856 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.587845 22097 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:54.619201 22097 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.619328 17524 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 9.
I20260709 13:19:54.588486 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.619621 22097 raft_consensus.cc:3060] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.589048 22274 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.592523 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:54.594419 22311 leader_election.cc:290] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.596792 22032 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.599419 22120 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.600208 22015 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:54.534328 17352 rpcz_store.cc:276] 0709 13:19:48.850980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.882160 (+ 31180us) service_pool.cc:224] Handling call
0709 13:19:54.521169 (+5639009us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:53.404103 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:53.430926 (+ 26823us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:53.430979 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:19:53.430995 (+    16us) tablet.cc:662] Decoding operations
0709 13:19:53.432394 (+  1399us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:53.432513 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:53.432562 (+    49us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:19:53.433620 (+  1058us) tablet.cc:701] Row locks acquired
0709 13:19:53.433667 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:19:53.433850 (+   183us) write_op.cc:270] Start()
0709 13:19:53.466493 (+ 32643us) write_op.cc:276] Timestamp: P: 1783603193433781 usec, L: 0
0709 13:19:53.473835 (+  7342us) op_driver.cc:348] REPLICATION: starting
0709 13:19:53.492114 (+ 18279us) log.cc:844] Serialized 3664 byte log entry
0709 13:19:53.944564 (+452450us) op_driver.cc:464] REPLICATION: finished
0709 13:19:54.194265 (+249701us) write_op.cc:301] APPLY: starting
0709 13:19:54.194366 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:54.343317 (+148951us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:54.343428 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:54.477105 (+133677us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:54.477483 (+   378us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:19:54.477556 (+    73us) write_op.cc:312] APPLY: finished
0709 13:19:54.477946 (+   390us) log.cc:844] Serialized 89 byte log entry
0709 13:19:54.478932 (+   986us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:54.479062 (+   130us) write_op.cc:454] Released schema lock
0709 13:19:54.479134 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:54.480296 (+  1162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:54.480326 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":327002,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":229925,"apply.run_cpu_time_us":15983,"apply.run_wall_time_us":286004,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41765,"num_ops":9,"prepare.queue_time_us":158295,"prepare.run_cpu_time_us":34745,"prepare.run_wall_time_us":204224,"raft.queue_time_us":227136,"raft.run_cpu_time_us":63750,"raft.run_wall_time_us":153388,"replication_time_us":468751,"thread_start_us":374043,"threads_started":4,"wal-append.queue_time_us":146603}]]}
W20260709 13:19:54.600651 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 43671us
I20260709 13:19:54.600445 22268 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:54.616464 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 62896.9us
I20260709 13:19:54.619966 17523 raft_consensus.cc:2393] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:54.617125 17419 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:54.615082 22286 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:54.625285 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.588397 22302 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:54.637306 17448 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.605808 22030 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:54.645944 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.626272 21744 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:54.654229 17521 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:19:54.636919 22329 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:54.657021 17419 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:54.657313 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:54.644344 22286 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.644385 22145 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.664034 22145 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:54.653370 21977 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:54.664634 22145 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.661077 22335 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:54.658236 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:54.670672 22335 raft_consensus.cc:697] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:54.671279 22274 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.672080 22274 raft_consensus.cc:2764] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:19:54.671715 22335 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.673200 17349 catalog_manager.cc:5697] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 6 to 9, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 9 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:54.675174 22032 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.675174 17349 catalog_manager.cc:5697] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 7 to 8, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 8 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:54.683154 22268 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:54.677616 17349 catalog_manager.cc:5697] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 8 to 9, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 9 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:54.655037 21744 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:54.693679 17448 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
I20260709 13:19:54.695009 18167 leader_election.cc:304] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
W20260709 13:19:54.699761 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 53915.2us
I20260709 13:19:54.700502 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.706099 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.706885 17521 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 14: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:54.707700 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.708703 17529 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 11: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:54.696924 22127 raft_consensus.cc:2764] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:19:54.710341 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 56475us
I20260709 13:19:54.713090 17420 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.693370 21744 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.707216 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:54.709022 22264 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:54.719359 22336 log.cc:927] Time spent T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:54.724023 22097 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.727826 22275 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:54.709127 22330 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.729001 22330 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.729327 22330 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.699553 22311 raft_consensus.cc:2804] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:54.736609 22311 raft_consensus.cc:697] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:54.737794 22311 consensus_queue.cc:237] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:54.738991 22302 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:54.683199 21784 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:54.746276 22333 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:54.746978 22333 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:54.747504 22333 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.751034 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.751559 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:54.752246 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:54.752966 17603 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:54.753607 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:54.714148 17349 catalog_manager.cc:5697] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:54.754482 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:54.754732 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:54.755347 17594 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:54.755610 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:54.756174 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:54.755789 17349 catalog_manager.cc:5697] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 3 to 12, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 12 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:54.756480 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:54.756773 17602 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:54.702435 22101 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:19:54.758371 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.759176 17595 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:19:54.759496 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.760494 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:54.761051 17448 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.761309 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:54.762313 17600 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 15: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:54.772078 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:54.774657 18201 raft_consensus.cc:1240] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:54.776361 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:54.777129 17602 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:54.777312 17595 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 14: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:54.766475 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:54.777920 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.778087 17600 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.778555 17525 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.781273 17602 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:19:54.783260 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 70286.8us
I20260709 13:19:54.785351 17448 raft_consensus.cc:2468] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:19:54.785668 17602 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:54.786825 18167 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.787683 18194 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:54.788266 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.790596 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
W20260709 13:19:54.793759 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.793869 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777822978f904e159194479932f1936f" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:54.792191 17349 catalog_manager.cc:5697] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 8 to 9, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 9 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.796721 17446 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:54.802856 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:54.804600 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:54.809798 17495 connection.cc:256] RPC call timeout handler was delayed by -1.1411534219998885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 13:19:54.810429 17495 connection.cc:256] RPC call timeout handler was delayed by -1.140253421999887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 13:19:54.794813 17596 raft_consensus.cc:3060] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.816531 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.823027 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:54.834285 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:54.791473 22275 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:54.844069 17569 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:54.807855 22293 raft_consensus.cc:2804] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:54.846544 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:54.829329 22101 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.874552 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:54.877437 17526 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:54.881028 17525 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:19:54.829418 22328 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:54.851348 22212 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:19:54.858881 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:54.862383 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 71952.6us
W20260709 13:19:54.881866 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 76863.4us
I20260709 13:19:54.884016 17569 leader_election.cc:304] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:54.851812 17349 catalog_manager.cc:5697] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 8 to 11, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 11 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } }
I20260709 13:19:54.885284 17419 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:54.850911 22268 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:54.843063 17600 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:19:54.851228 21784 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.903565 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:54.896010 17349 catalog_manager.cc:5697] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 8 to 9, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 9 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:54.883271 21961 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:54.906293 17596 raft_consensus.cc:2468] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
I20260709 13:19:54.915578 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:54.916618 18194 raft_consensus.cc:2368] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10.
I20260709 13:19:54.882053 22293 raft_consensus.cc:697] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:54.892608 17568 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:54.889302 22329 raft_consensus.cc:2764] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:19:54.912139 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:54.889909 22110 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.889324 22326 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.909962 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:54.926040 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:54.922924 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:54.922966 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:54.909463 22127 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:54.927688 17454 raft_consensus.cc:3060] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.928903 17452 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:54.920001 22268 raft_consensus.cc:697] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:54.891522 22120 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:54.919279 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 60486.5us
I20260709 13:19:54.918759 21687 raft_consensus.cc:2764] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:19:54.939584 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 47029.2us
I20260709 13:19:54.923856 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:54.950012 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:54.930260 22264 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.948241 17453 raft_consensus.cc:2410] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:54.913661 22335 consensus_queue.cc:1059] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:19:54.980075 17445 raft_consensus.cc:2368] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10.
I20260709 13:19:54.981051 17596 raft_consensus.cc:1275] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:54.954962 17447 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:19:54.907135 22097 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:54.958189 17451 raft_consensus.cc:1240] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:54.958922 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:54.970314 18167 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:54.972203 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 56820.7us
I20260709 13:19:54.983654 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:19:54.984329 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.976548 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.975961 17349 catalog_manager.cc:5697] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 11 to 12, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 12 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:54.977032 17454 raft_consensus.cc:2468] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:19:54.918854 22032 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:54.985634 17420 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:54.960753 21821 raft_consensus.cc:2804] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:54.989006 22279 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:54.991194 22328 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:54.980504 21784 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:19:54.957748 22326 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:54.999061 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.999228 22330 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.000275 17446 raft_consensus.cc:2468] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:19:55.001104 22120 raft_consensus.cc:3055] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:55.002679 22333 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.004768 17527 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 15: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:19:55.015966 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 57174.7us
I20260709 13:19:55.021950 22301 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:55.024231 17597 raft_consensus.cc:2368] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12.
I20260709 13:19:55.024027 22301 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:55.025156 22330 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:55.023931 22328 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:55.029047 22268 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:55.030145 21821 raft_consensus.cc:697] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:55.030599 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:55.031337 17599 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:55.031059 21821 consensus_queue.cc:237] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.033314 17569 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.034369 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:55.035773 17349 catalog_manager.cc:5697] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 8 to 9, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 9 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.012718 22032 raft_consensus.cc:697] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:55.037391 17448 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:54.980944 22264 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.038827 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.022257 22346 raft_consensus.cc:2804] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:55.016252 22279 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:55.019055 22273 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:55.091001 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:55.039757 22301 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:55.102756 22345 log.cc:927] Time spent T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:19:55.018270 22120 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:55.104408 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:55.105593 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 59626.3us
I20260709 13:19:55.134430 17569 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.138648 17452 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:55.115013 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 95909.8us
W20260709 13:19:55.129055 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 108613us
I20260709 13:19:55.147330 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:55.130508 22274 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:55.150916 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:55.092044 22330 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.091751 22279 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.023169 22286 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:55.201366 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:55.167176 22273 raft_consensus.cc:697] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:55.164175 22346 raft_consensus.cc:697] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:55.167465 22276 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.178194 17349 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 7 to 8, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 8 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:55.040246 22004 consensus_queue.cc:1059] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
W20260709 13:19:55.211809 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 171157us
I20260709 13:19:55.179057 22110 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:55.019641 22293 consensus_queue.cc:237] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:55.104055 22097 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:19:55.231375 17349 catalog_manager.cc:5697] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.256669 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:55.204180 22127 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:19:55.265579 17595 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:19:55.269841 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 101580us
I20260709 13:19:55.270421 17349 catalog_manager.cc:5697] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:55.292192 17569 leader_election.cc:400] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Vote denied by peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) with higher term. Message: Invalid argument: T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10.
I20260709 13:19:55.292681 17569 leader_election.cc:403] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:55.293668 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.215319 22330 consensus_queue.cc:1059] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:19:55.246279 22276 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:55.262832 22145 consensus_meta.cc:287] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.000s
I20260709 13:19:55.220149 22120 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.323609 22120 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:55.325434 21744 consensus_meta.cc:287] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.000s
I20260709 13:19:55.326426 22333 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:55.330917 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 129649us
I20260709 13:19:55.331722 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:55.335382 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:55.228777 22032 consensus_queue.cc:237] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.309993 22030 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.311081 22101 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313) with higher term. Message: Invalid argument: T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10.
I20260709 13:19:55.313485 22276 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:55.344084 17527 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:55.336017 17349 catalog_manager.cc:5697] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:55.339991 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:55.342000 22333 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:55.357369 22333 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:55.357789 22333 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:55.357892 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:55.363809 22357 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:55.364935 22357 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:55.365278 22357 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:55.341918 22004 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.336616 22361 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.325865 21744 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.375062 17521 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:55.320497 22145 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.351094 22276 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:55.369715 22127 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:55.375586 22326 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:55.343284 22346 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:55.397636 22127 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:55.337844 22273 consensus_queue.cc:237] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:55.402082 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 62197.5us
I20260709 13:19:55.378638 22361 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.406080 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:55.407553 22361 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:55.409243 22363 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:55.409693 22363 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:55.410058 22363 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:55.410239 22286 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:55.410879 22286 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:55.411324 22286 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:55.412146 22286 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.415382 22145 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:55.415902 22280 consensus_queue.cc:1059] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:55.382853 21961 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:19:55.416115 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:55.394778 22264 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:55.376873 22004 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.425994 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:55.428128 22004 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:55.428818 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:55.402983 22127 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:55.422284 22301 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.430619 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.404652 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:55.431272 17600 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.403331 21744 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:55.431047 22301 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:55.433220 22301 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:55.433295 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.431559 17527 raft_consensus.cc:2393] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:55.397154 22357 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.445680 22357 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.454734 17521 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:55.462195 17600 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:19:55.481483 17596 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:55.482115 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:55.483067 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:55.484139 17595 raft_consensus.cc:2393] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:55.485245 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:55.467039 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:55.486131 17597 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:55.456629 17419 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:55.486709 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.487682 17600 raft_consensus.cc:2393] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:55.488862 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.489037 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.490499 17599 raft_consensus.cc:2393] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:55.490491 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.491282 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.491999 17600 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:19:55.492372 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 78385.5us
I20260709 13:19:55.486908 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.492944 17448 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:55.493301 17595 raft_consensus.cc:2393] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:55.499727 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.499780 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.502511 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:55.503198 17448 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
I20260709 13:19:55.493778 21784 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:55.510702 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:55.502065 22369 raft_consensus.cc:3055] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:55.521358 22369 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:55.521534 22346 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:55.521526 22366 consensus_queue.cc:1059] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:55.522264 22346 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:55.522579 22369 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:55.523959 22369 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.524955 22346 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:55.529488 17448 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:55.530100 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:55.535290 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:55.551263 17454 raft_consensus.cc:1275] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:55.551784 17569 leader_election.cc:400] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 9 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 9. Current term is 10.
I20260709 13:19:55.552448 22276 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.552790 17569 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:55.553761 22368 raft_consensus.cc:2804] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:55.554440 22368 raft_consensus.cc:697] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:55.555542 22368 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.518901 21784 raft_consensus.cc:697] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
W20260709 13:19:55.563639 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.571445 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.560039 22373 raft_consensus.cc:3055] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:55.575291 22373 raft_consensus.cc:740] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:55.576426 22373 consensus_queue.cc:260] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:55.577203 22333 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.589273 17569 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:55.592885 22360 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:19:55.587688 22371 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:55.593502 22360 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.594079 22360 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:55.577710 22373 raft_consensus.cc:3060] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.607775 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:55.608561 17454 raft_consensus.cc:2393] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 14: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:55.611312 17446 raft_consensus.cc:1240] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:55.612857 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:55.613580 17446 raft_consensus.cc:2393] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 15: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:55.614228 18201 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:55.615607 17446 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:55.616760 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:55.590993 22329 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:55.571537 22127 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.616194 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:55.634657 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:55.590996 22286 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.636023 17450 raft_consensus.cc:2410] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:55.615657 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:55.637564 17451 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:55.636597 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:55.639912 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:55.647172 17448 raft_consensus.cc:2393] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 15: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:55.578341 22365 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:19:55.594538 22144 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:19:55.617065 21977 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:55.650269 17449 raft_consensus.cc:2410] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:55.651234 17448 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:55.651859 17447 raft_consensus.cc:1240] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:19:55.639925 22279 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.656035 22279 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:55.617120 21821 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:55.652448 17420 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.671891 22157 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.673535 17602 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:55.674685 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:55.647799 21784 consensus_queue.cc:237] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.636936 22328 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:55.677410 22328 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.679332 22127 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:55.679448 22328 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:55.638350 22329 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.680445 22329 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.680616 22268 raft_consensus.cc:3055] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:55.681100 22268 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:55.686378 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.688479 17602 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:55.693624 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:55.693847 17420 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.648357 22274 raft_consensus.cc:3055] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:55.700377 18201 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:55.702136 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:55.703068 17597 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:55.704382 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.705216 17599 raft_consensus.cc:2393] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:55.666075 22276 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:55.643581 22269 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:19:55.681916 22268 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.708282 22274 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:55.683086 21977 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.754195 17603 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:55.755582 17420 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.753953 22004 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.757194 22110 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.700946 22363 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.766427 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:55.771274 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:55.772423 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:55.773149 17524 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:55.774688 17524 raft_consensus.cc:1240] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:55.774823 17420 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.775782 17523 raft_consensus.cc:1240] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:55.778439 17520 raft_consensus.cc:1240] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:55.758368 22333 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:55.762372 22268 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.781543 17528 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:55.780676 17524 raft_consensus.cc:1275] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:55.780354 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.776232 22221 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:55.759486 22275 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:19:55.789640 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.793989 21977 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:55.777588 22302 consensus_queue.cc:1048] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:19:55.781522 22273 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.800125 22221 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:55.807871 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:55.810141 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:55.802717 22221 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:19:55.811118 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 281081us
I20260709 13:19:55.812670 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:55.768569 22110 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.817246 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.817764 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:55.819254 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:55.819397 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:55.819890 17602 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 12.
I20260709 13:19:55.781872 22274 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:55.790952 22145 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.823392 17599 raft_consensus.cc:1275] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:55.820776 22157 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.834810 22381 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.837054 17495 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:55.838922 22363 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:55.814213 22326 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.821493 22273 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.849434 17524 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:55.852919 22381 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:55.858009 17454 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:19:55.860097 22110 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:55.853078 22274 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:55.841885 22329 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.870729 17594 raft_consensus.cc:2393] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:55.872849 22329 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:55.873481 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:55.896672 18167 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:55.885171 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 65505.7us
I20260709 13:19:55.899767 17420 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.900601 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:55.905608 18167 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.904899 17568 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.913295 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:55.913480 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:55.913657 17568 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.903074 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:55.918169 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:55.918792 17495 leader_election.cc:400] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12.
I20260709 13:19:55.919359 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:55.919989 17450 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.923038 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:55.881292 22360 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:55.926920 22368 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:55.926978 22144 consensus_queue.cc:1059] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:55.927695 22392 log.cc:927] Time spent T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:19:55.929454 21977 consensus_queue.cc:1059] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:55.930169 21821 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:55.954044 22360 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:55.930820 22362 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:55.954867 22362 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:19:55.955009 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 43e1920c304743e78e8b777b3b7ea7f3: Illegal state: Replica ddfe9cca0741489b994f8b0178c54fe7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:55.955310 22362 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.918614 22101 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.912012 22363 consensus_queue.cc:1059] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:19:55.957257 22363 raft_consensus.cc:3055] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:55.957639 22363 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:55.931417 22269 consensus_queue.cc:1059] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:55.933687 17450 raft_consensus.cc:2468] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:55.934352 17523 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:55.924582 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 52471.7us
I20260709 13:19:55.935958 17420 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:55.904009 22381 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:55.912388 22221 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:55.944846 22390 consensus_queue.cc:1059] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:19:55.951364 22370 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.895345 22369 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:55.952647 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:55.930636 22364 consensus_queue.cc:1048] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:55.922989 22097 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:55.958716 22269 raft_consensus.cc:3055] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:19:56.020505 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 67948.9us
W20260709 13:19:56.021909 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 92825us
I20260709 13:19:55.942767 21784 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:19:55.992139 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45095.6us
W20260709 13:19:56.029847 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 68522us
I20260709 13:19:56.031278 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:56.031808 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 95980.4us
I20260709 13:19:56.035072 17568 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:56.036113 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 90869.6us
I20260709 13:19:56.038839 17454 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:56.039630 18166 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:56.041116 22221 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:56.042572 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:56.043351 17450 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:55.958492 22363 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.026506 22366 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.050957 22276 raft_consensus.cc:3055] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:56.051147 22390 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:56.051698 22276 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:56.052198 22390 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:56.053258 22390 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.054157 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:56.054462 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:55.963725 22376 consensus_queue.cc:1048] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:19:56.058214 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:56.059909 17495 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:56.030741 22269 raft_consensus.cc:740] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:56.062918 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:56.034533 22328 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:56.065359 17450 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 17.
I20260709 13:19:56.029901 22381 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:56.071033 17523 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:19:56.071560 17523 pending_rounds.cc:85] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 8
I20260709 13:19:56.071887 17523 pending_rounds.cc:107] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:19:56.072216 17523 raft_consensus.cc:2889] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:56.060366 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:56.068107 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:56.074672 22390 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:56.075433 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:56.077323 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:56.077246 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:56.053052 22276 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.083832 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:56.075271 22390 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:19:56.063552 22097 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.092983 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:56.066869 22280 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:56.068835 22127 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:56.090828 22279 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:56.101200 22286 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.048846 22120 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:19:56.056540 22221 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:19:56.083091 22273 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:19:56.122117 17450 raft_consensus.cc:1275] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:56.126361 22276 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.126510 22269 consensus_queue.cc:260] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:56.129617 22402 log.cc:927] Time spent T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:19:56.130208 17599 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:56.106492 22378 consensus_queue.cc:1059] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:19:56.132387 22378 raft_consensus.cc:3055] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:56.132766 22378 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:56.133208 22393 log.cc:927] Time spent T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:19:56.135040 22391 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:56.116976 22348 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.066773 22299 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:19:56.117604 17603 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:56.115610 22333 consensus_queue.cc:1059] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:19:56.086512 22157 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:56.084249 22363 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:56.136983 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 59740.4us
I20260709 13:19:56.144304 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:56.136346 22381 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.143000 22157 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.149220 22157 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.110491 22369 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:56.136284 22348 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:56.154805 22348 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:56.151499 22376 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:19:56.160346 17601 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:56.141739 22110 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:56.162461 22110 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.164435 22110 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:56.164786 21821 raft_consensus.cc:3055] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:56.165201 21821 raft_consensus.cc:740] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:56.166536 22221 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:56.166679 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:56.167016 22221 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:56.167831 22221 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:56.168411 22373 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:56.168632 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:56.168968 22373 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:56.173677 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:56.174620 17599 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 14.
I20260709 13:19:56.175875 17529 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:56.174638 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:56.182336 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 132640us
I20260709 13:19:56.182761 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:56.184850 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.186345 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 47368us
I20260709 13:19:56.187613 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:56.192006 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:56.198302 22333 consensus_queue.cc:1059] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:56.199512 22326 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:56.199975 22366 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.198302 22198 consensus_queue.cc:1048] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:19:56.200536 22366 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:56.201750 22264 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:56.203495 22366 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:56.203841 22361 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.204411 22361 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.186448 22268 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:19:56.206459 22361 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:56.165936 21821 consensus_queue.cc:260] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.166576 22360 raft_consensus.cc:3055] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:56.205843 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:56.209919 17599 raft_consensus.cc:2393] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 10: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:56.180366 22280 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:56.179826 22275 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:56.133615 22378 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.228511 17450 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:56.229146 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:56.250402 17452 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:56.229871 17569 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:56.230415 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:56.251922 17569 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:56.262189 17598 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:56.265045 17597 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:56.265913 17600 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:56.205639 22157 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.272125 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:56.273653 17595 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:19:56.302965 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.309101 17450 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:56.269960 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:56.378762 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:56.213282 22360 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:56.271157 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:56.384210 17450 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:56.384984 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:56.386869 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:56.169924 22373 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.400828 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:56.426031 17452 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:56.427203 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:56.431341 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 171493us
I20260709 13:19:56.192461 22370 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.188s
I20260709 13:19:56.270203 22015 raft_consensus.cc:2804] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:56.433269 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:56.468381 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:56.422446 21821 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:56.425246 22333 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:56.456447 22378 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.515358 17528 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:19:56.490728 22362 consensus_meta.cc:287] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
I20260709 13:19:56.480279 22015 raft_consensus.cc:697] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:56.463266 22127 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.514798 22328 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.484828 21784 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 13:19:56.568810 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 87806.3us
I20260709 13:19:56.570484 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:19:56.564451 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 294848us
I20260709 13:19:56.575868 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:56.560904 22120 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.564113 22274 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.517408 22333 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:56.575721 22395 log.cc:927] Time spent T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:19:56.562743 22280 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.529728 22362 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:56.568766 22275 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:56.512939 22360 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.579720 22398 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:56.571609 22328 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.623941 18201 raft_consensus.cc:1240] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:56.582566 22404 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.579957 22127 consensus_queue.cc:1059] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:19:56.586836 22120 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.644189 22409 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:19:56.646169 22417 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:19:56.646927 22416 log.cc:927] Time spent T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:19:56.649374 22333 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:56.650164 22407 log.cc:927] Time spent T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:19:56.590677 22274 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.691605 22427 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.654776 22127 consensus_queue.cc:1059] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:56.654883 22286 consensus_queue.cc:1059] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:56.696247 22274 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:56.696517 22286 raft_consensus.cc:3055] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:56.696961 22286 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:56.697100 22120 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:56.655939 22279 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:56.632340 22157 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:56.656657 22362 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:56.606909 22015 consensus_queue.cc:237] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:56.658210 22276 consensus_meta.cc:287] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.531s	user 0.005s	sys 0.005s
I20260709 13:19:56.658689 22328 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:56.629748 21961 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:19:56.663962 22363 consensus_meta.cc:287] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
W20260709 13:19:56.664870 22405 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.284s	user 0.001s	sys 0.001s
I20260709 13:19:56.666607 22275 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.630894 22398 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:56.714345 22415 log.cc:927] Time spent T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.057s	user 0.003s	sys 0.000s
I20260709 13:19:56.714721 22398 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.668323 17568 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:19:56.671820 17569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.717998 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 49763.2us
I20260709 13:19:56.718711 22329 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.674455 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:56.677874 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:56.685585 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:56.720197 17601 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:56.688603 17451 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:56.721257 22360 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.689956 17599 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:56.631453 22404 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:56.723331 22424 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:19:56.724668 22404 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:56.725049 22269 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:56.695727 22412 log.cc:927] Time spent T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:19:56.726116 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:56.696385 22414 log.cc:927] Time spent T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.128s	user 0.000s	sys 0.002s
I20260709 13:19:56.726748 17601 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.656126 22369 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.698472 22279 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:19:56.739126 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 64785.8us
I20260709 13:19:56.739766 17448 raft_consensus.cc:1240] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:56.675709 21784 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:19:56.703761 22428 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.706079 22390 raft_consensus.cc:3055] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:56.706099 22432 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:56.731109 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:56.731959 17523 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:19:56.732705 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:56.737759 17527 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:56.743314 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:56.758193 17451 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:19:56.761665 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.762539 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:56.760054 17526 raft_consensus.cc:2410] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:56.759635 17523 pending_rounds.cc:85] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 9
I20260709 13:19:56.763950 17523 pending_rounds.cc:107] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:19:56.764178 17523 raft_consensus.cc:2889] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:56.765693 17601 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:56.772035 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:56.772907 17602 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:19:56.763458 17595 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:56.766492 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:56.775350 17598 raft_consensus.cc:2410] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:56.777770 17449 raft_consensus.cc:2368] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13.
I20260709 13:19:56.771004 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:56.780524 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:56.792191 17599 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:56.755868 22390 raft_consensus.cc:740] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:56.788223 17420 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:56.805365 17420 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:56.777495 22369 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:56.777709 22110 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.813603 17495 leader_election.cc:400] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13.
I20260709 13:19:56.819391 17603 raft_consensus.cc:1240] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:56.728735 22286 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.805126 22157 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:56.780323 22264 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:19:56.812475 22369 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:56.823549 22004 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:56.831243 21961 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:56.869377 22157 raft_consensus.cc:697] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:56.838799 22275 consensus_queue.cc:1059] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:19:56.870478 22361 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.888041 22366 raft_consensus.cc:3055] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:56.896584 22433 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:56.897099 22406 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:56.897511 22421 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 13:19:56.773844 22432 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:56.900529 22401 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.901897 22436 consensus_queue.cc:1059] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:19:56.758828 22428 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.926433 22157 consensus_queue.cc:237] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.927716 22428 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:56.929013 22441 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 13:19:56.929841 22438 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:56.931187 22401 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.933503 22401 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:56.936281 22273 raft_consensus.cc:3055] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:56.936745 22273 raft_consensus.cc:740] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:56.923076 22373 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:19:56.937614 22273 consensus_queue.cc:260] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:56.908047 18201 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:56.941962 22432 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:56.942214 22273 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.866724 22221 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:56.823392 22110 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.949447 22274 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:56.822950 22279 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:56.951608 22110 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:56.954483 17520 raft_consensus.cc:3060] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.879855 22004 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.955068 22004 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:56.919890 22361 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:56.876538 22369 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.903512 21961 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:56.968075 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 123008us
I20260709 13:19:56.917973 22366 raft_consensus.cc:740] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:19:56.978647 21961 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.988668 17520 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:56.989584 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:56.991413 17525 raft_consensus.cc:2410] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:57.014349 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.015394 17525 raft_consensus.cc:2410] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:19:57.017591 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 220343us
I20260709 13:19:57.020913 17601 raft_consensus.cc:1240] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:56.993620 22269 consensus_queue.cc:1059] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:19:57.019475 22421 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.055238 22448 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:57.056003 17568 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:57.057384 22364 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.057308 22110 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:57.028995 22401 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:57.010747 22370 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:19:57.086262 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:57.096108 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:57.101866 17451 raft_consensus.cc:2410] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:57.073276 22015 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.088569 22391 log.cc:927] Time spent T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:57.033210 22032 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:19:57.102365 22378 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:57.034838 22366 consensus_queue.cc:260] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.090220 22421 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.095763 22401 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.191699 22398 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:57.095396 22364 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.195969 22269 raft_consensus.cc:3055] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:57.090859 22448 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.338167 22459 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:57.339216 22323 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:57.341446 22455 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
W20260709 13:19:57.313817 22360 consensus_meta.cc:287] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.006s
I20260709 13:19:57.204614 22274 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:57.171813 22015 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.338997 22449 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:57.374342 22366 raft_consensus.cc:3060] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.315061 22032 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.326979 22269 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:19:57.382576 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 285625us
I20260709 13:19:57.211880 22378 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.361806 22004 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:57.406975 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 307169us
I20260709 13:19:57.326365 22398 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.391875 22361 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:57.411026 17454 raft_consensus.cc:2393] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 15: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:57.393491 22274 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.437005 22448 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:57.438272 22015 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:57.396790 22449 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.441905 22449 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:57.444589 22423 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.444809 21977 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:57.445802 21977 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.445353 22423 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.451143 22004 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.452625 22364 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:57.451277 22423 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:57.448608 21977 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:57.464540 22457 log.cc:927] Time spent T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
I20260709 13:19:57.470057 22378 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.403398 22032 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.491955 17597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:19:57.492715 17597 raft_consensus.cc:606] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:57.493148 17597 raft_consensus.cc:614] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:57.489464 22369 consensus_meta.cc:287] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.004s
I20260709 13:19:57.501035 22421 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.499207 22471 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:57.502246 22471 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.503600 22274 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:57.503805 22221 consensus_meta.cc:287] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: Time spent flushing consensus metadata: real 0.560s	user 0.005s	sys 0.003s
I20260709 13:19:57.504458 22471 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:57.505491 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 70407.2us
I20260709 13:19:57.435316 22269 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.497749 22451 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
W20260709 13:19:57.510370 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 8e901a2e51634e18807d1c4292e3f285: Illegal state: Replica abf46e430b7e4ad4919ca2a717f37e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:57.497936 22369 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.514748 22032 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.510574 22451 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.517089 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:57.517581 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:57.518460 21961 consensus_meta.cc:287] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 13:19:57.518846 22451 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:57.518900 21961 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.521203 21961 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.523496 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.524163 17525 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:57.524389 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.526106 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:57.526626 18201 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:19:57.524830 17520 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:57.527907 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:57.528404 17523 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.530071 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.529222 22417 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:57.530799 22363 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:57.531013 22417 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.531334 22363 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.533689 17525 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:19:57.529603 22333 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.535420 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.536031 17527 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 11.
I20260709 13:19:57.536778 17599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c40484b7a540a9b32947573409178a"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:19:57.537240 17599 raft_consensus.cc:606] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:57.537532 17599 raft_consensus.cc:614] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:57.538661 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.542315 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.543429 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.544201 17522 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 14: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:57.544625 21687 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.539361 22333 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.545128 21687 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.546643 22333 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.547129 21687 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:57.543165 17526 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
W20260709 13:19:57.548053 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet abb20677645b433e839a2f21c9cc2ef3: Illegal state: Replica 0480cf54c3cc424ab94b963ef2ff5bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:57.548146 17527 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:57.532851 22127 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:57.550908 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.551981 22363 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.554384 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:57.556175 17523 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:57.534822 22369 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.535113 22451 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:57.561363 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.558677 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:57.564080 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.551311 22127 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.571623 22398 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:57.572626 22417 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.571717 22127 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.572825 21687 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:57.573316 17523 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:57.542743 21961 raft_consensus.cc:493] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:57.564663 17524 raft_consensus.cc:2468] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:19:57.579300 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 13:19:57.587291 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 4022f7d9b64e45d18be29fda16f3ecde: Illegal state: Replica abf46e430b7e4ad4919ca2a717f37e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:19:57.590600 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.573932 22451 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.595252 17525 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:19:57.595779 17525 pending_rounds.cc:85] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 7
I20260709 13:19:57.596061 17525 pending_rounds.cc:107] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:19:57.596271 17525 raft_consensus.cc:2889] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:57.596487 21961 raft_consensus.cc:515] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.596937 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.599749 22451 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:57.600785 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:57.601356 17526 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:57.602437 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:57.602667 17569 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:57.603466 22451 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:57.605238 21961 leader_election.cc:290] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:57.606359 22326 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:57.610529 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:57.611138 22326 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.611443 17451 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:19:57.613240 22326 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.616171 17452 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:57.617565 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:57.619834 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:57.620069 17419 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:57.620636 17450 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:19:57.625614 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:57.628307 17526 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 15.
I20260709 13:19:57.634814 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:57.635522 17446 raft_consensus.cc:2393] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:57.635586 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.629884 17568 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:57.639691 17419 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:57.643855 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.579792 21687 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:57.650772 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:57.652979 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.655206 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:57.665644 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.639767 17568 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:57.667318 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:57.635977 22032 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:57.667963 17521 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.642258 22476 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:57.637948 22221 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:57.643042 21961 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.670113 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:57.661636 21687 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:57.674518 22477 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:19:57.675608 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:57.680581 22472 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:57.681314 22472 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:57.683188 22469 log.cc:927] Time spent T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.239s	user 0.003s	sys 0.000s
I20260709 13:19:57.683550 22472 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:57.683939 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:57.684784 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:57.685900 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:57.686339 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:57.686982 22466 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:57.683602 17448 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:57.689034 22323 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:57.689569 22323 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.690954 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:57.691645 22323 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:57.692211 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.689055 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:57.692997 17452 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:19:57.692564 21687 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.667903 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:57.654837 22326 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:57.695724 21687 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:57.696034 22474 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:57.696621 22474 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.697074 22474 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:57.701139 21961 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.674404 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.702328 17526 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:57.703563 21961 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.704295 21961 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:57.704937 21961 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.653335 22406 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:19:57.707890 22221 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:57.708106 22366 raft_consensus.cc:493] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:57.708401 22221 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:57.708822 22366 raft_consensus.cc:515] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.710969 22366 leader_election.cc:290] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:19:57.712764 22445 log.cc:927] Time spent T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.786s	user 0.013s	sys 0.000s
I20260709 13:19:57.696359 22326 raft_consensus.cc:697] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:57.718166 22326 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.673660 17446 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
W20260709 13:19:57.725509 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 57679.5us
I20260709 13:19:57.724728 17419 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:57.735066 17445 raft_consensus.cc:2468] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 13.
I20260709 13:19:57.737092 17568 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:57.741302 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.745648 17568 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:57.672379 22451 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:57.672971 22476 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.747983 17521 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:57.730420 22366 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.721685 22274 raft_consensus.cc:493] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:57.730674 22406 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:57.751534 18167 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:19:57.736312 22032 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:57.750959 17419 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:57.764914 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:57.768191 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:57.769378 17521 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 14: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:57.766310 22274 raft_consensus.cc:515] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.785279 21977 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.748679 22398 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:57.756640 22472 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:57.749519 22451 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:57.751235 22476 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:57.765676 22032 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.763027 22286 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.783124 22466 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.787887 22409 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:57.786996 21687 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.792369 22302 raft_consensus.cc:2804] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:57.765394 22268 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:19:57.763546 22366 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.818374 21687 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:57.826586 22479 log.cc:927] Time spent T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:19:57.828205 22390 consensus_queue.cc:260] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.829289 22390 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.830086 22302 raft_consensus.cc:697] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:19:57.831120 22302 consensus_queue.cc:237] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.797161 21977 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.804347 22032 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.801527 22451 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.838156 22409 raft_consensus.cc:697] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:57.842263 22328 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.769129 22406 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:57.845938 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.848186 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:57.847772 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 83965.5us
W20260709 13:19:57.853974 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.855484 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:57.859789 22482 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:57.862457 22381 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:57.864112 17522 raft_consensus.cc:2410] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:57.812667 22466 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.849534 21977 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:57.829879 22221 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:57.863389 22381 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.878679 21687 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:57.866473 22328 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.927273 22366 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.918246 22474 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:57.946992 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 88355.2us
I20260709 13:19:57.959699 22381 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:57.961024 22466 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:57.962405 22406 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:57.962734 22221 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:57.966699 22487 log.cc:927] Time spent T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:19:57.911379 22409 consensus_queue.cc:237] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:57.973520 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:57.975034 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:19:57.977890 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.948943 22274 leader_election.cc:290] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:57.986748 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:57.991578 17525 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:19:57.982859 22326 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:58.003888 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.006136 22474 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.007010 22326 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.009094 22328 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.009492 22326 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.013327 22032 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:58.019893 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:58.022823 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 122027us
I20260709 13:19:58.018761 22366 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:58.039875 22401 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.045025 22366 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.049252 21961 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:58.113343 22381 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.264983 22286 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.267835 22286 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.276434 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.278261 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.280340 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.280479 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.269205 22373 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:58.283915 17524 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:58.285176 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.286216 17528 raft_consensus.cc:2393] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 12: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:58.300987 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1936) took 2033 ms. Trace:
I20260709 13:19:58.281214 22326 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.278772 22032 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.309300 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:58.310005 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.311499 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.311726 17601 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:58.311110 17524 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.310333 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.283998 22373 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.314981 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.269599 22381 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.297331 22423 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.321772 22275 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:58.322402 22423 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.323385 22127 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:58.323946 22127 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.324342 22286 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.325521 17596 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:19:58.317502 22264 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.312619 22466 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.316075 22326 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.282285 22476 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:19:58.315286 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:58.315713 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:58.318167 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.301440 17600 rpcz_store.cc:276] 0709 13:19:56.267817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.267950 (+   133us) service_pool.cc:224] Handling call
0709 13:19:56.268361 (+   411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:56.383905 (+115544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.383937 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:56.399436 (+ 15499us) log.cc:844] Serialized 52 byte log entry
0709 13:19:56.753132 (+353696us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:57.950525 (+1197393us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b18002b73e0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a76455 00007f5ab955e3c7 00007f5ab5b709a7 00007f5ab5b800bf 00007f5ab5b80038
0709 13:19:58.027123 (+ 76598us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.282848 (+255725us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.297169 (+ 14321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.297251 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.300761 (+  3510us) raft_consensus.cc:1685] finished
0709 13:19:58.300784 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.300927 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117503,"prepare.queue_time_us":144196,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":45517,"raft.run_cpu_time_us":3681,"raft.run_wall_time_us":40542,"spinlock_wait_cycles":3154816,"thread_start_us":587065,"threads_started":3,"wal-append.queue_time_us":355124,"wal-append.run_cpu_time_us":2705,"wal-append.run_wall_time_us":1128182}
I20260709 13:19:58.318975 22120 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.298372 22145 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:58.338850 17597 raft_consensus.cc:2368] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15.
I20260709 13:19:58.339221 17599 raft_consensus.cc:2368] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13.
W20260709 13:19:58.341543 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.340065 17594 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:58.345450 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.347527 17600 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:19:58.349229 22120 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.351853 22120 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.352914 22145 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.336745 22326 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.331342 22264 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.360991 22264 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.339748 22373 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.332377 22466 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:58.365418 22466 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:58.339906 22366 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.326000 22127 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.338596 22476 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.374202 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.375074 17594 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:58.380017 17524 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
W20260709 13:19:58.384673 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 695599us
I20260709 13:19:58.387259 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.384253 17419 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:58.388917 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:58.387483 22127 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.395164 22127 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:58.395516 22145 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.397380 22127 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:58.398425 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:58.399034 18201 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:19:58.400574 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:58.402681 17569 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:58.404050 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:58.398185 22366 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.410193 17594 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:58.412479 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.413234 17600 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:58.417178 22425 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:58.398720 22328 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:58.423009 22328 raft_consensus.cc:697] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:19:58.423732 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.424589 17528 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:19:58.424198 22328 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.425156 22366 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.427026 22381 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.427446 22366 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.430670 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.433367 17594 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:58.438413 17598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49566 (request call id 1948) took 1340 ms. Trace:
I20260709 13:19:58.336719 22451 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.411458 22449 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:58.442138 22451 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.442454 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.443059 17524 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:19:58.443552 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.443924 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.444738 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.444977 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.445343 17595 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:58.408584 22456 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:58.412068 22408 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.446362 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.447016 17599 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:19:58.446907 22408 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:58.446389 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.448223 17602 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:19:58.448333 22373 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.447029 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:58.448966 22408 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:58.388268 22347 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.449775 17524 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.449898 22347 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:58.450276 22398 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:58.451161 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:58.452268 22347 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.452538 22366 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:58.450407 17569 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:58.453009 22366 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.453416 22366 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.453972 17569 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:58.448911 22373 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.456332 22373 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.456657 17524 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
I20260709 13:19:58.457561 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:58.458201 22398 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:58.458601 22398 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.458930 22398 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.460042 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.457834 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:58.450007 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:58.463523 17446 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:58.464131 17568 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:58.464361 21977 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.465607 17602 raft_consensus.cc:3060] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.465662 22456 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:58.466184 22456 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.466527 22456 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:58.470430 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.410983 22127 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:58.452270 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:58.439013 17598 rpcz_store.cc:276] 0709 13:19:57.098406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.099701 (+  1295us) service_pool.cc:224] Handling call
0709 13:19:57.099991 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:57.385915 (+285924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.385944 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:57.385983 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:57.386016 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.438134 (+1052118us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b5400061b54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:58.438194 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.438347 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":657021696}
I20260709 13:19:58.472388 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:58.474987 17602 raft_consensus.cc:1275] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:58.476825 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.480311 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.488278 17495 leader_election.cc:400] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13.
I20260709 13:19:58.488777 17495 leader_election.cc:403] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:58.488735 17449 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:58.481316 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:58.489923 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.490186 17454 raft_consensus.cc:3060] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.492060 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:58.492797 17449 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.493237 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:58.492312 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.494082 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.493681 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.496953 22436 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:58.497382 22436 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.497766 22436 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:58.500322 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.485185 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.501554 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.501672 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:58.507171 17447 raft_consensus.cc:2393] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 13: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:19:58.507447 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.508082 17445 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:19:58.507974 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:58.493489 22373 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.506016 22280 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.511696 22280 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.511554 22373 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.512157 22280 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.513626 22373 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.501749 17569 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:58.514287 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.485751 22127 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.514858 22127 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.506800 22466 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.516003 22466 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.516844 17449 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:19:58.518388 22449 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.518911 22449 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.520983 22449 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.510181 17524 raft_consensus.cc:2410] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:58.511114 22286 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:58.509655 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:58.524935 22268 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.524654 22286 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.525678 22286 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.511191 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:58.527725 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:58.499976 22451 raft_consensus.cc:2804] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:58.525480 22268 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.532622 18201 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:19:58.535053 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.528759 17522 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.525934 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.539844 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:58.524976 22279 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:58.529263 22144 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:58.560137 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:19:58.563815 17454 raft_consensus.cc:2468] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
I20260709 13:19:58.568253 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.577302 17445 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:19:58.578715 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.531432 22373 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.535898 22264 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.579041 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:58.540092 22401 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:58.532174 22466 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.593845 17569 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:58.594239 17522 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:19:58.601459 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.602511 17522 raft_consensus.cc:2393] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:58.607478 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:19:58.606396 22451 raft_consensus.cc:697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:58.587553 22493 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:58.607796 22264 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.591634 17419 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:58.616123 22456 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.630528 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54548 (request call id 2726) took 1089 ms. Trace:
I20260709 13:19:58.639804 17527 rpcz_store.cc:276] 0709 13:19:57.538318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.538438 (+   120us) service_pool.cc:224] Handling call
0709 13:19:58.627307 (+1088869us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b540013a954. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:19:58.627468 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20351744}
I20260709 13:19:58.632642 22423 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.635807 21977 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:58.588253 22373 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.586488 22273 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:58.616132 22425 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.580163 22362 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:19:58.642316 22422 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.641719 22101 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.642236 22466 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:58.696883 22264 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.698241 22268 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.633888 22366 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.699983 22456 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.701150 22366 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.642004 22408 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.651010 22373 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.703753 22408 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.707317 22144 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:58.707787 22144 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.708341 22408 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.705284 22398 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.654347 22425 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.710534 22425 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.711023 22398 leader_election.cc:290] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.702013 22366 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:58.711948 22366 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:58.713191 22488 log.cc:927] Time spent T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.738s	user 0.012s	sys 0.000s
I20260709 13:19:58.655202 22273 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.717713 22273 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.692930 22451 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.684448 22422 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.718537 22366 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:58.718626 22422 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.719218 22366 raft_consensus.cc:493] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:58.719719 22366 raft_consensus.cc:515] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:58.728963 22366 leader_election.cc:290] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:58.732939 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca126b355348958188e14e8b1c7470" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:58.735814 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:58.733879 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36043ed9ab7c47e9882fa33c5c135545" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:58.734830 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:58.735005 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:58.747783 22485 log.cc:927] Time spent T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.825s	user 0.004s	sys 0.006s
I20260709 13:19:58.748108 22425 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.751782 22269 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.766855 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.773222 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:58.777100 22286 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.779712 22286 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.759331 22127 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:58.791157 22381 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13.
I20260709 13:19:58.774959 22280 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.800387 22127 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:58.803023 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:19:58.811744 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 303867us
I20260709 13:19:58.815325 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.815979 17526 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:19:58.772508 22422 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.812899 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:58.820760 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.789844 22373 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:58.823208 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 215814us
I20260709 13:19:58.830425 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.830892 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.830471 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.852478 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.853441 17529 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
I20260709 13:19:58.854286 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:58.854481 17569 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:58.855163 17527 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.855943 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.856292 17450 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:58.856722 17445 raft_consensus.cc:2368] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15.
I20260709 13:19:58.828197 22280 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.821671 22409 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:19:58.858457 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 275946us
I20260709 13:19:58.859511 18167 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:58.860359 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.862296 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:58.862537 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.862747 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.863323 17454 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:58.863459 17452 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:58.865018 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.860293 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.866568 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.824283 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:58.868337 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:58.870105 17495 leader_election.cc:400] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15.
I20260709 13:19:58.870353 17495 leader_election.cc:403] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:58.860954 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 279309us
I20260709 13:19:58.874683 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:58.875298 17603 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:58.827144 22425 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:58.875975 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:58.883543 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "545b345ea8d04e8daea29d4a4f6477a9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.876247 17445 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:58.913396 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:58.912638 17568 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:58.832427 22127 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.930917 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.931622 17445 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:19:58.833570 22390 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.934762 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.828403 22286 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:19:58.939728 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.828789 22436 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.948370 22436 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:58.948189 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:19:58.923868 22264 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:58.920951 22398 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.940402 17452 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:58.956821 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.920184 22268 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.910655 22279 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.993525 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.974045 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:58.918236 22355 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:58.920737 22456 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.919467 22097 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:58.984160 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:58.988308 17522 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:58.996897 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:58.998148 17522 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:58.983489 17419 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:59.000361 17568 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:19:58.911393 22366 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:19:59.075318 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:59.065009 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:19:58.969559 22437 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:59.077454 17447 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
W20260709 13:19:59.137650 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 138177us
I20260709 13:19:58.936156 22425 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:58.936352 22127 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.066859 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:19:59.138983 22127 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.139293 18198 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.917716 22409 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:58.993625 22279 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.146421 22279 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.146692 22127 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:59.148972 22127 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:59.149641 22127 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:59.150143 22127 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:59.152474 22127 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:59.153023 22127 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:59.153540 22127 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:58.931600 22362 consensus_queue.cc:1048] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.132s
I20260709 13:19:59.011976 22004 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:59.170497 22004 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.171046 22004 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.949154 22381 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15.
I20260709 13:19:59.176604 18198 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:19:59.165077 22279 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:59.186753 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:59.188112 17453 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:59.014317 22264 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:58.971866 22390 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:59.089144 22329 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:59.068778 22110 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.197600 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:59.198015 17524 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:59.277158 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:19:59.278674 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 276517us
I20260709 13:19:59.298744 17454 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:19:59.298657 17453 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:19:59.027544 22456 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:59.288748 17527 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:19:59.294354 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:59.003130 22268 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:59.303354 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c159f64326b74a248a65dc1dae5c79a0" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:19:59.069275 22482 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:19:59.065122 22097 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:59.133126 22475 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:59.275424 22472 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:59.343371 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 44000us
I20260709 13:19:59.175829 22326 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 13:19:59.367596 17520 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:59.373241 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:59.301523 22329 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:19:59.316293 22280 raft_consensus.cc:2764] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:19:59.269471 22127 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:59.308141 22286 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:59.366166 22472 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.441113 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:19:59.307552 22145 consensus_queue.cc:1059] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:19:59.338943 22482 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:59.317548 22110 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:19:59.619951 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 217661us
I20260709 13:19:59.621850 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
W20260709 13:19:59.622753 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.380960 22329 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:59.487464 22526 log.cc:927] Time spent T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:19:59.495292 22507 log.cc:927] Time spent T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:19:59.500805 22505 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:19:59.502810 22279 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:19:59.510983 22523 log.cc:927] Time spent T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:19:59.528548 17449 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.384810 22422 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:59.615192 22373 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:59.617744 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:59.505920 22144 consensus_meta.cc:287] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.798s	user 0.009s	sys 0.000s
W20260709 13:19:59.618430 22368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.020s	sys 0.013s
I20260709 13:19:59.638235 22423 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:59.733220 22144 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:59.733672 22423 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:59.734944 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2725) took 2200 ms. Trace:
I20260709 13:19:59.735378 17520 rpcz_store.cc:276] 0709 13:19:57.534648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.534784 (+   136us) service_pool.cc:224] Handling call
0709 13:19:57.535039 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.375871 (+1840832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.734705 (+358834us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b5400414e54. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b66e01 00007f5ab5b6583e 00007f5abab2a419 00007f5ab40a1bd4 00007f5ab40a1b62 00007f5ab40a1a91 00007f5ab40a1a0c 00007f5ab40a0cc2 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:19:59.734885 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4213375872}
I20260709 13:19:59.647259 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:59.736186 22423 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:59.647950 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:59.642910 22110 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:59.648732 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:59.736893 17602 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.649256 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:59.737780 17594 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:59.738941 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:59.739564 17594 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.649641 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:19:59.740901 22522 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.296s	user 0.001s	sys 0.002s
I20260709 13:19:59.648041 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:59.742955 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:59.743644 17596 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.335394 22475 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:59.445092 22286 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:59.754741 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:59.690040 22425 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:59.648177 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:19:59.758004 17598 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.741068 17595 raft_consensus.cc:2393] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:19:59.659677 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:59.761026 17603 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 16.
W20260709 13:19:59.746948 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 129321us
I20260709 13:19:59.747287 17602 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
W20260709 13:19:59.762398 17495 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.242.65:36303 timed out after 1.501s (SENT) [suppressed 18 similar messages]
I20260709 13:19:59.445431 22472 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:59.751593 17419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.000s	sys 0.040s
I20260709 13:19:59.688913 22517 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:59.735777 22144 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:59.772959 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:19:59.777407 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:59.783270 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:59.784441 17520 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:19:59.755450 17597 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.736313 17601 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:59.764847 17419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.000s	sys 0.040s
W20260709 13:19:59.790374 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 651678us
I20260709 13:19:59.715233 22401 raft_consensus.cc:493] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:19:59.778465 17568 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:19:59.792084 17568 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:19:59.792735 17567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.000s	sys 0.017s
W20260709 13:19:59.793087 17567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.000s	sys 0.017s
I20260709 13:19:59.798218 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:59.800009 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:59.807471 17595 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:19:59.807920 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:19:59.620055 22264 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
W20260709 13:19:59.765654 22269 consensus_meta.cc:287] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.013s	user 0.007s	sys 0.007s
I20260709 13:19:59.855916 17594 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:59.858403 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 2233) took 1423 ms. Trace:
W20260709 13:19:59.791121 21977 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.009s	sys 0.005s
I20260709 13:19:59.859169 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:59.859794 17521 rpcz_store.cc:276] 0709 13:19:58.391387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.391528 (+   141us) service_pool.cc:224] Handling call
0709 13:19:58.391944 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.392337 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.392376 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:58.392910 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:19:58.790881 (+397971us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:58.790939 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.791194 (+   255us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.814206 (+1023012us) raft_consensus.cc:1685] finished
0709 13:19:59.814225 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.814336 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6929,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3172,"thread_start_us":370369,"threads_started":1,"wal-append.queue_time_us":700539}
I20260709 13:19:59.756233 22347 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:19:59.757036 22509 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:59.772006 22425 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:19:59.876605 21977 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.009s	sys 0.005s
I20260709 13:19:59.893025 22425 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:59.858991 22520 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:59.856177 22401 raft_consensus.cc:515] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:59.894853 22347 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:19:59.896975 22401 leader_election.cc:290] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:59.897353 22347 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:59.883786 17600 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
W20260709 13:19:59.876500 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 65569.9us
I20260709 13:19:59.818225 22423 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:59.858225 22368 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:19:59.890873 22482 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:19:59.902429 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:59.911389 17449 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:59.903249 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:59.904125 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:59.879794 17596 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:19:59.913246 17520 raft_consensus.cc:2393] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 12: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:19:59.914777 17598 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
W20260709 13:19:59.916528 17569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.021s	sys 0.031s
W20260709 13:19:59.916961 17569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.021s	sys 0.032s
W20260709 13:19:59.897998 22518 log.cc:927] Time spent T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:19:59.917930 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 969728us
W20260709 13:19:59.923772 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 282573us
I20260709 13:19:59.924628 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:19:59.897367 22456 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:59.894878 22475 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:19:59.890911 22509 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.936837 17601 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:19:59.792893 22517 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:19:59.908941 22423 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:59.906973 22274 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.002s	sys 0.039s
W20260709 13:19:59.908355 22328 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.010s	sys 0.031s
I20260709 13:19:59.909801 22368 consensus_queue.cc:1243] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:59.907564 22268 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:19:59.950361 22520 raft_consensus.cc:697] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:19:59.966207 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:19:59.963675 22004 consensus_meta.cc:287] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.004s
I20260709 13:19:59.973018 18194 raft_consensus.cc:1240] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:59.969007 22328 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.011s	sys 0.031s
W20260709 13:19:59.961365 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 60491.9us
I20260709 13:19:59.963302 22425 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:00.142639 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:19:59.970482 22423 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:59.963922 22509 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:00.149601 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 179037us
I20260709 13:19:59.980019 22482 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:20:00.211069 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.227702 17600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 2111) took 1747 ms. Trace:
I20260709 13:20:00.232409 17600 rpcz_store.cc:276] 0709 13:19:58.442858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.493427 (+ 50569us) service_pool.cc:224] Handling call
0709 13:20:00.189783 (+1696356us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400329454. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:20:00.189941 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3192461056}
I20260709 13:20:00.145522 22004 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:00.244621 22539 log.cc:927] Time spent T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.264s	user 0.000s	sys 0.000s
W20260709 13:20:00.288666 17495 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.011s	sys 0.006s
W20260709 13:20:00.289201 17495 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.011s	sys 0.006s
W20260709 13:20:00.289575 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 527165us
W20260709 13:20:00.292173 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 499995us
I20260709 13:20:00.242700 22286 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.272368 17597 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:00.299405 17529 pending_rounds.cc:85] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 8
I20260709 13:20:00.300160 17529 pending_rounds.cc:107] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:20:00.300504 17529 raft_consensus.cc:2889] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:00.241106 22520 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.306182 17447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47864 (request call id 567) took 1130 ms. Trace:
W20260709 13:20:00.276531 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 57754.1us
I20260709 13:20:00.310166 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
W20260709 13:20:00.294059 22524 log.cc:927] Time spent T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:20:00.274521 22406 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:00.316352 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:00.318501 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:00.320101 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:00.306600 17447 rpcz_store.cc:276] 0709 13:19:59.175905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.178942 (+  3037us) service_pool.cc:224] Handling call
0709 13:19:59.179345 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.434554 (+255209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.434586 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.435350 (+   764us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.754857 (+319507us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:59.754897 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.754967 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.305934 (+550967us) raft_consensus.cc:1685] finished
0709 13:20:00.305960 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.306124 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143968,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":31095,"thread_start_us":573768,"threads_started":2,"wal-append.queue_time_us":513548}
I20260709 13:20:00.321004 17527 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:00.322111 22510 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:00.335330 22535 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:00.323011 22517 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:00.336691 22499 log.cc:927] Time spent T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.206s	user 0.018s	sys 0.006s
I20260709 13:20:00.336858 22373 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:00.337286 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:20:00.339344 22529 log.cc:927] Time spent T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.447s	user 0.011s	sys 0.001s
I20260709 13:20:00.339170 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:00.340801 17495 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:00.341292 22381 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:00.341758 22381 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.342235 22381 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.350198 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:00.352088 22515 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.352790 22515 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.355427 22515 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:00.357120 22409 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.366621 17451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2479) took 1828 ms. Trace:
I20260709 13:20:00.319937 22286 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:00.332015 17526 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:20:00.367060 17451 rpcz_store.cc:276] 0709 13:19:58.539537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.539923 (+   386us) service_pool.cc:224] Handling call
0709 13:19:58.540343 (+   420us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:19:58.566488 (+ 26145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.566516 (+    28us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:19:58.589185 (+ 22669us) log.cc:844] Serialized 104 byte log entry
0709 13:19:59.007487 (+418302us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:59.132821 (+125334us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.643809 (+510988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.643889 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.736907 (+ 93018us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b18002fcec0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a793f3 00007f5ab2a7b7c1 00007f5ab2a7b779 00007f5ab2a7b709 00007f5ab2a7b6d1 00007f5ab2a7a9cd 000000000038f354 000000000038f199 00007f5ab2a5c83a
0709 13:20:00.328860 (+591953us) raft_consensus.cc:1685] finished
0709 13:20:00.366393 (+ 37533us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.366562 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52439,"prepare.queue_time_us":299821,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":190012,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":29978,"spinlock_wait_cycles":11806080,"thread_start_us":839555,"threads_started":2,"wal-append.queue_time_us":1120736}
I20260709 13:20:00.330632 17520 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 10.
I20260709 13:20:00.335246 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:00.337404 22373 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:00.326944 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:00.327843 17523 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:00.367056 17522 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:00.368919 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:00.274847 22482 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:00.335640 22329 consensus_meta.cc:287] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.638s	user 0.005s	sys 0.005s
I20260709 13:20:00.455045 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:00.455967 17452 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:00.456456 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b44f8d5d5454fb7af9630783cd02def" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:00.455696 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:00.459061 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.460278 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.461440 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.462538 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.463619 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.464160 17448 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:00.464905 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.386097 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.466835 17449 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:20:00.366236 22536 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:00.465885 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:00.468871 17448 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.468729 22536 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.385432 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:00.382793 18166 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:00.472150 17454 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:00.472478 22212 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:00.472908 22212 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:00.473274 22212 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.381901 17521 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 14: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:20:00.386683 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.383153 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:20:00.478226 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 95501.6us
I20260709 13:20:00.381762 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:00.384052 22474 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:00.480988 22474 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.384783 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.483050 22474 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:00.485194 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:00.487403 22212 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:00.488067 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.489343 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.395869 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:00.385842 17603 raft_consensus.cc:1240] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:00.471510 22536 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.453750 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:00.466197 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 2742) took 2038 ms. Trace:
I20260709 13:20:00.489979 17602 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:00.501402 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.502017 17602 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:00.502794 22004 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.502921 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:20:00.455677 22540 log.cc:927] Time spent T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:20:00.503959 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.504916 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.505050 17454 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:20:00.381029 22436 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:00.382319 22145 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:00.506608 22145 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:00.506919 22538 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.648s	user 0.018s	sys 0.002s
I20260709 13:20:00.501778 22390 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.508708 22145 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.491025 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.499840 17523 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:00.500133 17453 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:00.495282 18198 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:20:00.492712 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:00.514150 17521 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.499121 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:00.497172 17452 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:00.389678 17597 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:00.490293 17596 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:00.496412 22482 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.499812 22373 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:00.520742 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.521380 17597 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:20:00.500313 17528 rpcz_store.cc:276] 0709 13:19:58.427999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.431965 (+  3966us) service_pool.cc:224] Handling call
0709 13:19:58.432273 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.432992 (+   719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.433020 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:58.433421 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:19:58.801063 (+367642us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b1800367f00. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abb941de1 00007f5abb94e5b1 00007f5ab2a5be07 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b 00007f5ab5705d23 00007f5ab57060d1 00007f5ab5b21a0f
0709 13:19:59.063717 (+262654us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:59.063763 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.063834 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.457024 (+1393190us) raft_consensus.cc:1685] finished
0709 13:20:00.457042 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.466131 (+  9089us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":387,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":27625344,"thread_start_us":262452,"threads_started":1,"wal-append.queue_time_us":1514659}
I20260709 13:20:00.505921 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:00.489761 22212 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.328894 22328 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 13:20:00.395516 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.523497 17602 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:20:00.380164 22274 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:20:00.545267 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 60145.7us
I20260709 13:20:00.395062 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.379773 22120 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:00.451615 22127 raft_consensus.cc:2804] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:00.454764 22359 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:00.496946 22513 log.cc:927] Time spent T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 1.321s	user 0.021s	sys 0.013s
I20260709 13:20:00.553644 17569 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:00.542537 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.333690 22406 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.581318 17597 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:20:00.543787 17598 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:20:00.582690 17598 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:00.576649 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:00.583546 17602 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:00.583843 17594 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.542116 22280 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:00.588842 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:00.596973 17569 leader_election.cc:304] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:00.554494 22541 raft_consensus.cc:2764] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:20:00.452857 22286 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:00.596462 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:00.585198 22127 raft_consensus.cc:697] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:00.599627 21977 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:00.580346 22120 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.626006 17453 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:20:00.607816 22517 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:00.509881 22329 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.596870 17521 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:20:00.623463 17569 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:00.624796 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 284037us
I20260709 13:20:00.604337 17594 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:00.525265 17600 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 15.
I20260709 13:20:00.632478 18166 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:00.529549 17448 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
I20260709 13:20:00.369704 22510 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.638525 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.579730 22274 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.644464 17596 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:20:00.630009 17601 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:00.629664 17495 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:00.658860 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:00.583159 22359 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.628384 22515 raft_consensus.cc:2749] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:00.649063 22486 raft_consensus.cc:2804] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:00.611657 22280 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.662779 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:00.641589 22145 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.671030 17569 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:00.653048 17599 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:00.685638 17569 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:00.654125 17446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55884 (request call id 2467) took 2177 ms. Trace:
I20260709 13:20:00.676436 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.650837 22535 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:00.689894 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:00.686403 17446 rpcz_store.cc:276] 0709 13:19:58.473146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.478285 (+  5139us) service_pool.cc:224] Handling call
0709 13:19:58.478801 (+   516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.479292 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.479330 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:58.510572 (+ 31242us) log.cc:844] Serialized 26 byte log entry
0709 13:19:58.833030 (+322458us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:58.833081 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.863215 (+ 30134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.496372 (+1633157us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:20:00.649830 (+153458us) raft_consensus.cc:1685] finished
0709 13:20:00.649853 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.650094 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5742,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7269,"spinlock_wait_cycles":56417664,"thread_start_us":266931,"threads_started":1,"wal-append.queue_time_us":456037}
I20260709 13:20:00.636144 22390 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:20:00.709359 17449 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:00.665992 22537 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:00.716039 17569 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:00.717195 17569 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:00.688746 22475 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:00.710387 22486 raft_consensus.cc:697] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:20:00.721035 17599 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:20:00.701918 22471 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:00.721688 22560 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:00.729664 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:00.686374 22550 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:20:00.693424 22145 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:20:00.731038 21977 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:00.724221 22368 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:00.742262 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:00.746342 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 83662.9us
I20260709 13:20:00.736560 22449 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:00.749009 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:00.692497 22127 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.758984 22359 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.762996 22280 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.763748 22280 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:00.764374 22280 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:20:00.764652 22556 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:00.766219 22406 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.767782 22515 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:00.772892 22423 consensus_meta.cc:287] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.001s
I20260709 13:20:00.773372 22423 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.781154 17569 leader_election.cc:304] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:00.763913 22555 log.cc:927] Time spent T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:20:00.747828 21977 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:00.765374 22280 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.807969 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:00.806334 22560 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:00.788163 22475 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:00.810174 22120 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.809435 21977 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.826936 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:00.814783 22144 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:00.830554 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 81620.4us
I20260709 13:20:00.832865 22381 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.833319 22286 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:20:00.833946 22563 log.cc:927] Time spent T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:20:00.834288 17525 raft_consensus.cc:2368] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 16. Current term is 17.
I20260709 13:20:00.829404 22510 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.827822 22101 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:00.835256 22381 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.835939 22517 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:00.839803 22423 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:00.830919 22274 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.818841 22560 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:00.843910 22472 consensus_meta.cc:287] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Time spent flushing consensus metadata: real 1.033s	user 0.009s	sys 0.002s
I20260709 13:20:00.844353 22472 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.845424 17603 raft_consensus.cc:2368] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13.
I20260709 13:20:00.851297 22472 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:00.851853 22548 raft_consensus.cc:3055] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:00.852798 22509 consensus_meta.cc:287] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Time spent flushing consensus metadata: real 0.679s	user 0.011s	sys 0.000s
I20260709 13:20:00.852737 22548 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:00.852301 22144 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:00.855329 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:00.810343 22486 consensus_queue.cc:237] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:00.856024 22548 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.862998 22144 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.838779 22329 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:00.839267 22390 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:00.871958 17603 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:00.874390 22127 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:00.876041 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.857226 22517 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:00.878355 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.877466 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.879231 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.879949 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:00.880550 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:00.853258 22509 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.888424 17598 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:20:00.889734 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:00.869956 22548 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:00.894768 17597 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 17: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:00.886695 22390 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.895238 22127 raft_consensus.cc:697] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:00.923130 22127 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.923450 22517 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.926709 18199 raft_consensus.cc:1240] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:00.927532 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:00.928289 17446 raft_consensus.cc:2368] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13.
I20260709 13:20:00.928985 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:00.929575 17446 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:20:00.929806 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.932104 17569 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:00.932827 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:00.933434 17451 raft_consensus.cc:3060] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.942080 22144 consensus_queue.cc:1059] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:00.943063 22144 consensus_queue.cc:1243] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer 2158c0f750fd4b21afe24135c52167b2 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:20:00.943636 22144 raft_consensus.cc:3055] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:00.944025 22144 raft_consensus.cc:740] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:00.944522 22145 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:00.944664 17453 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:00.940272 22486 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.945587 22144 consensus_queue.cc:260] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:00.946343 22486 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:00.947408 22144 raft_consensus.cc:3060] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.948333 22486 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.949934 22509 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:00.950426 22472 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:00.953032 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.953205 17599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 2124) took 1305 ms. Trace:
I20260709 13:20:00.948073 17446 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:00.931207 22390 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:00.960085 17599 rpcz_store.cc:276] 0709 13:19:59.648134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.648491 (+   357us) service_pool.cc:224] Handling call
0709 13:20:00.953047 (+1304556us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54000758d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5b6a2fa 00007f5abab2bb17 00007f5ab40a66d4 00007f5ab40a6662 00007f5ab40a6591 00007f5ab40a650c 00007f5ab40a57c2 00007f5ab3ea148c 00007f5ab3ea08c6 00007f5ab3ea026f
0709 13:20:00.953154 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105961344}
I20260709 13:20:00.960870 17569 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:00.965513 17569 leader_election.cc:400] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13.
I20260709 13:20:00.965910 17569 leader_election.cc:403] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:20:00.967967 22101 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for earlier term 12. Current term is 13.
I20260709 13:20:00.970956 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:00.930857 21977 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.971632 17451 raft_consensus.cc:2468] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 17.
I20260709 13:20:00.967528 22398 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:00.988343 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:00.991832 17569 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:00.992797 22449 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:00.994568 22475 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:00.995047 22097 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:00.991053 22368 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:20:00.995116 22475 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:20:00.998333 22559 log.cc:927] Time spent T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.265s	user 0.004s	sys 0.000s
I20260709 13:20:00.999790 22373 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:01.000193 22373 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:01.000991 22373 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:00.997653 22475 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.005595 21977 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:01.008579 22437 raft_consensus.cc:2804] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:01.010578 22437 raft_consensus.cc:697] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:01.010819 22328 consensus_queue.cc:1059] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:01.011523 22437 consensus_queue.cc:237] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.012140 22328 consensus_queue.cc:1059] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:01.012490 22528 raft_consensus.cc:3055] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:01.012917 22528 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:01.013003 22120 raft_consensus.cc:3055] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:01.013468 22120 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:01.010063 17419 leader_election.cc:400] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 16. Current term is 17.
I20260709 13:20:01.014165 17419 leader_election.cc:403] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:01.013809 22528 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.014266 22120 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.015128 22528 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.015522 22120 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.015741 22531 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 16. Current term is 17.
I20260709 13:20:01.025082 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:01.025673 17528 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.026552 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:01.027518 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:01.028640 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:20:01.030326 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 144219us
W20260709 13:20:01.031128 17495 connection.cc:256] RPC call timeout handler was delayed by -1.0489953510000305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 13:20:01.035640 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:20:01.036604 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:01.036980 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.039691 17420 leader_election.cc:304] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.040684 17495 leader_election.cc:400] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303) with higher term. Message: Invalid argument: T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15.
I20260709 13:20:01.041653 17495 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:01.044637 17420 leader_election.cc:304] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.052714 17495 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:01.060299 17420 leader_election.cc:304] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.060706 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:01.062337 17529 raft_consensus.cc:1240] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:01.062556 17420 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.062749 17495 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:01.064292 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:01.087239 17420 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.008322 22398 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:01.092840 17522 raft_consensus.cc:2410] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:01.099282 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:01.036504 22127 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:01.091832 17495 leader_election.cc:304] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:01.038856 22509 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.105335 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:01.105613 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.106238 17449 raft_consensus.cc:2376] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13. Re-sending same reply.
I20260709 13:20:01.059827 22286 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:01.061591 22274 raft_consensus.cc:2749] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:01.061451 22359 raft_consensus.cc:2749] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:01.104578 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.042331 22436 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:01.109614 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.102898 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.084771 22373 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.061817 22280 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:01.112532 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:01.139055 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:01.102262 22545 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.103904 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.142153 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.106220 22533 raft_consensus.cc:3055] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:01.091120 22560 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:01.118662 17418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.117959 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:01.120481 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.104460 22569 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:01.155012 17453 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:20:01.155521 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:01.156358 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:01.123786 22436 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.061962 22568 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:20:01.121686 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:20:01.130149 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.163789 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.091516 22406 raft_consensus.cc:2749] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:01.098331 22549 raft_consensus.cc:2749] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:01.118949 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:01.113410 17445 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:01.152221 17599 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:01.105827 22532 consensus_queue.cc:1059] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:20:01.169414 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:01.153934 17528 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:01.171965 17420 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.156302 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.091355 22572 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:01.148501 22533 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:01.157756 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:01.152035 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.112061 22127 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.175637 22436 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:01.149583 22286 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:01.112753 22509 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:01.188079 22579 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:20:01.188194 22509 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:01.188367 22127 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:01.161603 22381 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.170426 17524 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 15.
I20260709 13:20:01.184705 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:01.162598 22566 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:20:01.157747 17527 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:01.191239 17453 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 17: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:01.192934 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.193805 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.194095 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.194636 17595 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:20:01.198503 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.161878 22280 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:01.200899 17420 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.211510 22286 raft_consensus.cc:697] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:01.211869 22566 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:01.212350 22566 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:01.212803 22286 consensus_queue.cc:237] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.213465 22566 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.215317 22566 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.230965 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.233692 17420 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.197780 22560 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:01.235244 22560 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:01.235704 22560 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:01.235764 22580 log.cc:927] Time spent T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:01.236878 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:01.237496 17597 raft_consensus.cc:2376] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13. Re-sending same reply.
I20260709 13:20:01.199761 22032 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:01.247234 17419 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:01.202837 22280 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:01.229534 22532 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.241150 22274 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:01.288913 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet f16762b5a82d4310ad01b31fd99d5921: Illegal state: Replica ddfe9cca0741489b994f8b0178c54fe7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:01.289309 22274 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:01.289903 22274 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.290891 22545 raft_consensus.cc:3055] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:01.291311 22545 raft_consensus.cc:740] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:01.292090 22545 consensus_queue.cc:260] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:01.277740 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:20:01.254391 22559 log.cc:927] Time spent T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:20:01.241670 22273 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.252182 22335 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.284386 17529 raft_consensus.cc:1240] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:01.281685 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:01.287542 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:01.249004 22533 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.263583 22004 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:01.243352 22583 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:01.274164 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:01.294883 22381 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:01.294979 22390 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.264173 22280 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.189736 22398 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.279340 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:01.306761 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:01.312664 17521 raft_consensus.cc:2393] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 17: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:20:01.315027 17599 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:01.340870 17568 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.338013 22583 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:01.363504 22583 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:01.338105 22536 consensus_queue.cc:1175] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ddfe9cca0741489b994f8b0178c54fe7" responder_term: 15 status { last_received { term: 15 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:01.338407 22004 raft_consensus.cc:697] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:01.318619 22286 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:01.369359 22286 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:01.315112 22401 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.369761 22004 consensus_queue.cc:237] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.370898 22401 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.373342 22401 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:01.338573 22533 raft_consensus.cc:3060] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.376359 22390 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:01.341903 22545 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.384244 22566 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:01.386126 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.388787 22144 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:01.391917 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:01.390277 17523 raft_consensus.cc:2393] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:20:01.397799 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:01.398442 17594 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.399878 17595 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:01.369834 22286 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.414237 22101 raft_consensus.cc:493] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:01.415004 22101 raft_consensus.cc:515] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:01.417533 22101 leader_election.cc:290] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:01.419315 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.420385 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:01.428751 17598 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.432932 17594 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:01.421854 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.435525 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.423132 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:20:01.436568 17566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.424104 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.426071 17602 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:20:01.433712 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 457267us
W20260709 13:20:01.434208 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 180252us
I20260709 13:20:01.435489 17495 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:01.438692 17602 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:01.438755 17446 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:20:01.441385 17600 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:01.444919 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.417621 22286 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.453088 17598 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:01.450266 17419 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:01.456313 17603 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:01.431128 22097 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:01.432385 22144 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:01.478957 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:01.480383 17453 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.480409 17454 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:01.471361 22550 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:01.452502 22390 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:01.481594 17568 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.428459 22560 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.486794 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.488934 17520 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:20:01.491835 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 258189us
I20260709 13:20:01.495040 17420 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.485986 22550 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:01.501988 17520 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:01.502466 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:20:01.481597 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 55565.6us
I20260709 13:20:01.515008 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:01.518339 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.469691 22373 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:20:01.520677 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.517577 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:20:01.531816 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.521915 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.523265 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.535570 17520 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:01.536983 17522 raft_consensus.cc:1240] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:01.539930 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:01.472695 22381 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:20:01.474663 22572 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:20:01.567359 18167 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.507536 22550 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.520435 22430 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:01.594096 17529 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:20:01.594261 17453 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
W20260709 13:20:01.575817 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 80871.7us
I20260709 13:20:01.596777 17420 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:01.572224 17525 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:01.521132 22390 raft_consensus.cc:697] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:01.594714 17529 pending_rounds.cc:85] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 7
W20260709 13:20:01.601720 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.622859 17529 pending_rounds.cc:107] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:20:01.623332 17529 raft_consensus.cc:2889] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:01.591761 17602 raft_consensus.cc:2468] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11.
I20260709 13:20:01.588302 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:01.639681 17598 raft_consensus.cc:2376] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 11. Re-sending same reply.
W20260709 13:20:01.565572 22537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.018s	sys 0.033s
I20260709 13:20:01.509845 22144 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:01.541719 22212 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.499941 22097 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:01.545152 22406 consensus_queue.cc:1059] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:20:01.595854 22273 raft_consensus.cc:2749] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.653079 17453 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:01.530376 22532 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:20:01.597280 22362 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:01.680315 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a91336a4f94e5db0ce4fa334e9bd37" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.645370 22548 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:01.685105 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.690450 17420 leader_election.cc:400] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13.
I20260709 13:20:01.694550 17420 leader_election.cc:403] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:01.681892 22537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.018s	sys 0.034s
I20260709 13:20:01.651793 22326 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:20:01.718909 22548 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 12. Current term is 13.
I20260709 13:20:01.719796 22548 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:01.709401 22280 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:01.690541 22590 log.cc:927] Time spent T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:20:01.724226 17526 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:01.725581 22280 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:01.729813 22097 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:01.729765 22550 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:20:01.733520 22144 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:01.734230 17450 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:01.738605 17420 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.782452 22548 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.689428 22212 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:01.711714 22599 log.cc:927] Time spent T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:20:01.714509 22274 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:01.786725 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 48229.9us
I20260709 13:20:01.787459 22274 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:01.787765 17420 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.789271 22274 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:01.790458 22212 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:01.722410 22598 raft_consensus.cc:3055] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:01.790860 17420 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.791266 22598 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:01.745996 22335 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:01.758112 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:01.793246 17529 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:01.806581 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 206657us
I20260709 13:20:01.837497 22274 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:01.839169 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 48451us
I20260709 13:20:01.840359 17420 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.841349 22335 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:01.842806 17420 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.760025 22286 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:01.705222 22560 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:01.737142 22550 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:01.705811 22390 consensus_queue.cc:237] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.699856 22537 raft_consensus.cc:697] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:01.878396 22537 consensus_queue.cc:237] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.881868 22568 raft_consensus.cc:3055] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:01.882395 22568 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:01.883679 22568 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.885306 22568 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.888160 22335 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:01.889546 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 46853.5us
I20260709 13:20:01.900627 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:01.890962 17420 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.911441 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:01.911717 17529 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 16.
I20260709 13:20:01.912874 22274 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.913319 22611 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:01.913848 22302 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.915275 22598 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:01.922199 18167 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:01.959905 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:01.960098 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.960453 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:01.960798 17452 raft_consensus.cc:2468] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:01.960793 17446 raft_consensus.cc:2393] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:01.962239 17445 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:01.950224 22596 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:01.963699 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.963773 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.963968 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:20:01.964645 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet 7002e0c7a3624420a1737b1fb29d8142: Illegal state: Replica 0480cf54c3cc424ab94b963ef2ff5bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:01.967177 17450 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14. Ops: [12.7-13.8]
I20260709 13:20:01.967370 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:01.968884 17452 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:01.969331 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:01.969419 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.970534 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:01.978506 17451 raft_consensus.cc:2393] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:20:01.948285 22545 consensus_queue.cc:1059] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:20:01.977969 17448 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.972707 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:01.980118 17453 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:01.961398 22598 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:02.039059 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 468100us
I20260709 13:20:02.043411 21977 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:02.044828 22548 raft_consensus.cc:3055] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:02.045418 22548 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:02.053889 22548 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.062896 17597 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:02.064904 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:02.065778 17603 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 15.
I20260709 13:20:02.066994 22101 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:02.067998 22449 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:02.068100 22472 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:02.075387 22548 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.115900 17445 raft_consensus.cc:2410] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:20:01.642966 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:02.131821 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 90916.2us
I20260709 13:20:02.133433 17347 catalog_manager.cc:5697] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 8 to 11, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 11 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.139290 17347 catalog_manager.cc:5697] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 9 to 10, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 10 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.144249 22619 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:02.149353 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.162832 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.162703 22619 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.170280 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:02.170718 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:02.172953 17569 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:02.177495 17522 raft_consensus.cc:1275] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:02.192718 22127 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.193982 22127 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.197052 22127 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:02.207103 22619 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:02.214427 22617 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:02.214669 22329 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:02.204015 22425 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:02.215538 22329 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:02.216524 22425 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:02.218606 22398 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:02.219389 22398 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.219596 22610 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:02.220947 17448 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:02.217500 22329 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:02.254914 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 82217.2us
I20260709 13:20:02.253523 17419 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:02.257094 22598 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:02.251665 22398 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:02.263886 18167 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:02.263614 22598 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:02.263685 22471 consensus_queue.cc:1059] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:02.275871 22548 consensus_queue.cc:1059] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:20:02.279238 22536 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.280046 22536 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.288582 22548 raft_consensus.cc:3055] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:02.286638 22598 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:20:02.267982 22490 consensus_queue.cc:1048] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:20:02.294281 22370 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:02.296052 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.289846 22548 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:02.298674 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:02.300606 17445 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:20:02.295351 22370 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.302675 22370 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.302978 22548 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:02.307938 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.309784 22536 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:02.312827 22548 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.314195 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:02.319118 17448 raft_consensus.cc:2393] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:02.315886 22398 raft_consensus.cc:3055] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:20:02.316969 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 53318.3us
I20260709 13:20:02.286860 22425 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:02.326773 17445 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:02.328611 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:02.335640 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:02.337822 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:02.337956 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:02.338789 18194 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:02.339874 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:02.342445 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:02.343510 17451 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:02.344130 17446 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:02.344878 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:02.345741 17451 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:02.346352 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:02.347214 17447 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:02.342561 17449 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:02.360432 17448 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:02.366995 18194 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
W20260709 13:20:02.362880 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 69321.3us
I20260709 13:20:02.323100 22398 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:02.380086 22623 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:20:02.382328 17420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.385605 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:02.386842 17601 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:02.387825 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:02.388650 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:02.391201 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:02.401937 17600 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:02.411000 17529 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:02.411725 22398 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:02.411953 17347 catalog_manager.cc:5697] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 7 to 10, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 10 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.413596 22398 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:02.424990 22622 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:02.426277 22622 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.427484 17597 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:02.427253 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:02.434197 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:02.441319 22600 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:02.443899 22471 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:02.438244 22620 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:02.413820 17347 catalog_manager.cc:5697] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 7 to 11, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 11 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.456936 22620 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:02.457640 17525 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:02.460039 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:02.466435 22401 consensus_queue.cc:1059] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:20:02.467593 22401 raft_consensus.cc:3055] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:02.467999 22401 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:02.461740 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:02.452478 22425 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.471031 22425 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.473285 22425 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:02.474224 17453 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:02.449746 22623 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.476745 17449 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:02.477300 22623 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:02.457968 22370 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:02.479678 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:02.480868 18200 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:02.481528 22370 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:02.469194 22401 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:20:02.475916 17347 catalog_manager.cc:5697] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 7 to 11, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 11 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.456982 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:02.460443 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:02.492432 18199 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:02.492851 17449 raft_consensus.cc:1275] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:02.493853 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:02.498728 22401 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.507007 17528 raft_consensus.cc:1240] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:20:02.503608 17520 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:02.456200 22471 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.508255 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:02.511451 17600 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:02.512341 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:02.516973 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:02.538473 17347 catalog_manager.cc:5697] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 8 to 11, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 11 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:02.538523 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.553310 22620 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:02.553551 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:20:02.554852 17568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.556699 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 92577.5us
I20260709 13:20:02.559852 22471 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.560837 22335 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:20:02.563330 22629 log.cc:927] Time spent T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:20:02.572678 22622 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:20:02.575606 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 184767us
I20260709 13:20:02.590679 17526 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:20:02.591133 17526 pending_rounds.cc:85] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 9
I20260709 13:20:02.594012 17526 pending_rounds.cc:107] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:20:02.602662 17526 raft_consensus.cc:2889] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:02.593341 22617 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.608604 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:02.597484 22471 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:02.632479 17599 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:02.612262 22536 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.650588 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:02.673026 22472 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:02.670619 22004 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.685838 22536 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:02.667081 22617 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:02.692973 22632 log.cc:927] Time spent T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:02.693351 22536 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:02.695675 22004 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.696635 22329 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 13:20:02.699504 22637 log.cc:927] Time spent T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:20:02.700398 22004 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:02.706408 17600 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:20:02.701066 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:20:02.718123 17349 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40498 (request call id 191) took 29278 ms (client timeout 15000 ms). Trace:
I20260709 13:20:02.719008 17594 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:02.723500 22617 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:02.724260 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.724870 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.709118 22472 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.728698 22472 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:02.724406 17598 raft_consensus.cc:2368] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15.
I20260709 13:20:02.725939 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:02.734308 22596 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:02.736328 22475 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:02.741761 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:02.742493 17523 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 16.
I20260709 13:20:02.745329 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:02.751511 17419 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:02.752965 22548 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:02.753366 22548 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.753710 22548 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:02.761140 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:02.762804 17599 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 16.
I20260709 13:20:02.773645 18196 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 15.
I20260709 13:20:02.778949 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
W20260709 13:20:02.783988 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 191295us
W20260709 13:20:02.718693 17349 rpcz_store.cc:269] 0709 13:19:33.439297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.439809 (+   512us) service_pool.cc:224] Handling call
0709 13:20:02.717784 (+29277975us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:55.573490 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:55.663509 (+ 90019us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:55.663543 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:19:55.663561 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:55.670611 (+  7050us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:55.670696 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:55.670721 (+    25us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:19:55.671756 (+  1035us) tablet.cc:701] Row locks acquired
0709 13:19:55.671775 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:19:55.671924 (+   149us) write_op.cc:270] Start()
0709 13:19:55.672041 (+   117us) write_op.cc:276] Timestamp: P: 1783603195671875 usec, L: 0
0709 13:19:55.672058 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:19:55.672772 (+   714us) log.cc:844] Serialized 5582 byte log entry
0709 13:19:55.865153 (+192381us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab2a5c0ac 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b
0709 13:19:56.524430 (+659277us) op_driver.cc:464] REPLICATION: finished
0709 13:19:56.798126 (+273696us) write_op.cc:301] APPLY: starting
0709 13:19:56.807059 (+  8933us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:56.958189 (+151130us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:56.958219 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:57.480136 (+521917us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:57.480451 (+   315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:19:57.480506 (+    55us) write_op.cc:312] APPLY: finished
0709 13:19:57.480872 (+   366us) log.cc:844] Serialized 129 byte log entry
0709 13:19:57.512707 (+ 31835us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:57.526172 (+ 13465us) write_op.cc:454] Released schema lock
0709 13:19:57.533063 (+  6891us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:57.550047 (+ 16984us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:57.550087 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34566,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":246109,"apply.run_cpu_time_us":32005,"apply.run_wall_time_us":767540,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62675,"num_ops":14,"prepare.queue_time_us":95011,"prepare.run_cpu_time_us":39717,"prepare.run_wall_time_us":460906,"raft.queue_time_us":301035,"raft.run_cpu_time_us":25488,"raft.run_wall_time_us":223730,"replication_time_us":823185,"spinlock_wait_cycles":2507136,"thread_start_us":552208,"threads_started":5,"wal-append.queue_time_us":484651,"wal-append.run_cpu_time_us":37904,"wal-append.run_wall_time_us":2355247}]]}
I20260709 13:20:02.852756 22423 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.861408 22423 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.862473 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:02.863643 22548 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.866422 22548 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 17 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:02.871373 22423 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:02.878254 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.890733 17495 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:02.897276 17527 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:02.861402 22642 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:02.903908 22642 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.904619 22642 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.855892 22472 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:20:02.918828 22548 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:02.923254 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 129376us
I20260709 13:20:02.924387 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:02.925462 22620 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:02.930617 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:02.931545 17521 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:02.935725 22623 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:02.943127 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:02.944160 17598 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:02.945575 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:02.947968 22617 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:02.948745 22617 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:02.951606 22617 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:02.956239 17569 leader_election.cc:304] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:02.957523 17600 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:02.967782 22548 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:02.974745 22598 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:02.979460 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:02.983834 17596 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:02.985796 17445 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:20:02.992832 22548 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:02.997531 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.019604 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:03.037850 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:20:03.045214 22645 log.cc:927] Time spent T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.179s	user 0.003s	sys 0.000s
I20260709 13:20:03.048177 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.050312 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.056137 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.071206 22598 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.126250 22541 raft_consensus.cc:2749] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:03.131390 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.134773 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 143713us
I20260709 13:20:03.135985 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:03.155181 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.113260 22598 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:03.108635 22622 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:03.152408 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 196295us
I20260709 13:20:03.146314 22623 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:03.172560 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:03.186372 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 417699us
I20260709 13:20:03.160210 22536 raft_consensus.cc:493] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:03.232271 22145 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:03.233057 22145 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.235636 22335 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:20:03.236493 22640 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260709 13:20:03.236594 17569 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:03.236522 22335 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:03.239490 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 56112.5us
I20260709 13:20:03.240381 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:03.241066 22335 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:03.243052 22145 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:03.196511 22329 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:03.259613 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.261929 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.295358 17603 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.008s	sys 0.028s
W20260709 13:20:03.296692 17603 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.008s	sys 0.028s
I20260709 13:20:03.287508 22617 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:03.287240 22623 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:03.326151 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 84381.3us
I20260709 13:20:03.337070 17495 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:03.340013 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:03.288451 22536 raft_consensus.cc:515] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.343792 22536 leader_election.cc:290] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:20:03.347450 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 110946us
I20260709 13:20:03.351329 22620 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:03.352015 22622 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:03.354972 22145 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:03.335474 22548 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:03.311278 22642 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:03.380802 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.382477 22536 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.384907 22536 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.387363 22536 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:03.392364 17521 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 17.
I20260709 13:20:03.394151 17528 raft_consensus.cc:1240] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:20:03.405922 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.407428 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:20:03.408882 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 69018.3us
I20260709 13:20:03.422801 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:03.435495 22622 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:20:03.447877 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
W20260709 13:20:03.450733 22643 log.cc:927] Time spent T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:20:03.452579 22620 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:03.454211 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:03.455190 17450 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
W20260709 13:20:03.455432 22652 log.cc:927] Time spent T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:20:03.463188 17419 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:03.465495 22657 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:03.466167 22657 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:03.467170 22657 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.474587 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.475764 22423 consensus_queue.cc:1059] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:03.476644 22623 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.476926 22617 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:03.477396 22617 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:03.477280 22623 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.478909 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.480643 17420 leader_election.cc:400] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15.
I20260709 13:20:03.480978 17420 leader_election.cc:403] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:20:03.524612 22335 raft_consensus.cc:2749] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15.
W20260709 13:20:03.531831 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 113342us
I20260709 13:20:03.534417 17521 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:03.534744 22617 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.536098 22617 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.533643 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:03.543284 17523 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:03.548619 17453 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:03.551684 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
W20260709 13:20:03.552752 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.558209 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:03.559260 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:03.524889 22425 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.552362 17450 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:03.565689 17569 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:03.566717 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:03.569012 17446 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:03.573096 17452 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:03.570545 22475 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:03.578991 22425 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.573136 22598 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:03.580679 22642 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:03.593835 22623 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:03.588613 22329 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:20:03.580242 22398 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:20:03.610057 22425 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:03.644532 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 70410.1us
W20260709 13:20:03.646056 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 224358us
W20260709 13:20:03.642903 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 218156us
W20260709 13:20:03.651294 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 84410.8us
I20260709 13:20:03.652469 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:03.678164 22475 consensus_queue.cc:1048] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:03.680210 22678 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:03.683605 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 108624us
I20260709 13:20:03.685150 17569 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:03.688642 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 120563us
I20260709 13:20:03.694757 22476 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:03.697114 22475 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:03.706146 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 258362us
I20260709 13:20:03.707686 22656 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:03.715960 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:03.717482 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:03.718109 18196 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.719259 22623 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:03.709331 22548 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:20:03.727845 18196 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 16.
I20260709 13:20:03.730640 17420 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:20:03.731561 22548 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:03.732084 22548 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:03.732854 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.732993 22548 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:03.735947 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:03.737223 22623 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:03.737675 22623 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:03.738106 22623 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.737694 17495 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:03.747973 22620 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:03.749907 22101 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.762765 22666 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:03.763144 22620 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:03.763518 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:03.764525 22329 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.764952 22620 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:03.765075 22329 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.765949 22666 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:03.766426 22666 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:03.766806 22666 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.767550 22329 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:03.773044 22623 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.774509 17569 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:03.761492 22101 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:03.777527 22101 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:03.781076 22548 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.781764 22548 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.784582 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.793288 22548 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:03.799316 22677 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:03.800046 22677 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.800531 22677 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.802735 22623 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:03.808526 22475 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:03.812705 17569 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:03.814163 17569 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:03.814608 22401 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:03.815065 22401 raft_consensus.cc:493] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.815243 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:03.815524 22401 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:03.816164 22678 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:03.816851 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.816813 22678 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.817654 17526 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:20:03.818427 22425 raft_consensus.cc:2749] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:03.819204 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:03.818449 22398 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:03.820281 22476 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:03.820715 22476 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:03.820308 22398 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:03.821122 22476 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:03.821887 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:03.823696 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:03.825215 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:03.819455 22678 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:03.826685 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:03.827294 22398 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:03.828810 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c221353c2c64e8b96d73953eebea083" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:03.830076 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:03.819211 22425 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:03.832547 22425 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.832944 22425 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:03.834968 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.837138 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.838728 17526 raft_consensus.cc:2955] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:03.841048 22677 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.817438 22666 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.842738 22329 raft_consensus.cc:2955] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:03.853675 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:03.854336 17597 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.844310 22666 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:20:03.860504 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 97052.4us
I20260709 13:20:03.861701 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:03.842690 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.867641 17495 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:03.867187 17568 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:03.872339 22623 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:03.872891 22623 raft_consensus.cc:697] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:03.870810 22678 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:03.873536 22678 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.873821 22623 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.867012 22622 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:03.878304 22622 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:03.866648 22476 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.878753 22622 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.884392 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:03.873914 22678 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.904824 22425 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.905301 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:03.906189 22666 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:03.906299 22401 raft_consensus.cc:515] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.907928 22666 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:03.908198 17595 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:03.908496 22401 leader_election.cc:290] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:03.908936 22666 raft_consensus.cc:697] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:03.910058 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:03.912127 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:03.913866 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:03.915499 17446 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:03.917591 17448 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:03.904855 22678 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:03.920011 22678 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:03.921370 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:03.921456 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:03.922220 17602 raft_consensus.cc:2393] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 11: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:03.922339 17445 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:20:03.921995 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:03.883315 22476 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:03.926301 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:03.937405 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:03.938282 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:03.942569 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:03.946045 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:03.937626 17598 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:03.950135 17597 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 16.
I20260709 13:20:03.909968 22666 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:03.958786 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:03.955319 22425 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:03.926308 22689 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:03.966114 22689 raft_consensus.cc:697] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:03.967921 22689 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:03.977330 22694 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:20:03.986441 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:03.949504 22620 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:20:03.989382 22681 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.002923 22598 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:04.003571 22598 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.011364 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:04.012733 22145 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:04.013445 22145 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.015797 22145 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:04.016644 17448 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 11.
I20260709 13:20:04.017094 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:03.992201 22642 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:04.020916 17448 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:03.994594 22004 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:04.028743 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:04.031190 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:04.032595 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:04.033320 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:04.034911 18199 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:20:04.035454 17449 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:20:04.045615 17523 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:04.045209 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:04.073601 18200 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 16: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:20:04.005926 22598 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:20:04.079771 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 44765.9us
I20260709 13:20:04.023897 22145 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:20:04.094827 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 200015us
I20260709 13:20:04.095129 22145 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.029760 22677 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:04.094494 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:04.101297 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:04.077909 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:04.104197 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:04.104904 17454 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.111230 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:04.094183 22004 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.110463 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:04.094892 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:04.118443 18198 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.124048 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:04.126045 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:04.126251 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb13f5c64447d2bbcbef8bc568f882" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:04.127689 22622 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.000425 22681 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.132025 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:04.143704 17454 raft_consensus.cc:2468] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:20:04.144068 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.144507 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:04.145506 17420 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.043990 22642 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.074035 22548 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:20:04.104238 22617 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:20:04.158684 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 235025us
I20260709 13:20:04.162420 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:04.165643 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.143229 22666 raft_consensus.cc:493] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:04.151019 22598 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:04.147122 22329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52562 (request call id 17) took 1543 ms. Trace:
I20260709 13:20:04.157680 22472 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:04.169086 22622 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:04.164634 22617 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.168998 22689 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:20:04.197293 18198 raft_consensus.cc:2468] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:04.196915 22656 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:04.171305 22666 raft_consensus.cc:515] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:04.222432 22695 log.cc:927] Time spent T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:20:04.223204 22704 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:20:04.214951 22398 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:04.243199 22642 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:04.228137 22004 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:04.244589 22623 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:04.244997 22623 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:04.170271 22329 rpcz_store.cc:276] 0709 13:20:02.578894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.581234 (+  2340us) service_pool.cc:224] Handling call
0709 13:20:02.841589 (+260355us) log.cc:844] Serialized 506 byte log entry
0709 13:20:03.543684 (+702095us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b54004432a0. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5acf571 00007f5ab5adbdbe 00007f5ab5ae6930 00007f5ab5ae68d8 00007f5ab5ae6858 00007f5ab5ae6813 00007f5ab5ae5a9c 00007f5abb9d1626 00007f5abb9cbdd8 00007f5ab5b227cb 00007f5ab5b252c0
0709 13:20:04.122269 (+578585us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5448,"raft.queue_time_us":5570,"raft.run_cpu_time_us":886,"raft.run_wall_time_us":71502,"spinlock_wait_cycles":121557888,"thread_start_us":494952,"threads_started":1,"wal-append.queue_time_us":568800}
I20260709 13:20:04.181522 22472 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.281976 22472 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:04.217403 22622 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:20:04.282909 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:04.245872 22623 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:04.284593 22623 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.277755 22617 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:04.229004 22398 raft_consensus.cc:493] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:04.226807 22699 log.cc:927] Time spent T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:20:04.225980 22697 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:04.288300 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:04.293228 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:04.300083 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:04.287207 22398 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:04.312265 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 146697us
I20260709 13:20:04.313454 17569 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:04.314198 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 103452us
I20260709 13:20:04.325954 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:04.254380 22681 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:04.329458 17526 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:04.329852 17569 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.334923 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:20:04.342115 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 174714us
I20260709 13:20:04.345424 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:04.355341 22698 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:20:04.342262 22716 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:04.364488 22666 leader_election.cc:290] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:04.385802 17569 leader_election.cc:304] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.383014 17454 raft_consensus.cc:2955] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:20:04.389941 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 84870us
I20260709 13:20:04.367862 22097 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:04.364511 17528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:20:04.398221 17528 raft_consensus.cc:606] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:04.398715 17528 raft_consensus.cc:614] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:04.401221 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 255768us
I20260709 13:20:04.403303 17420 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.393811 22475 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:04.412585 17420 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.399386 22713 consensus_queue.cc:1059] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:20:04.418756 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.419999 17569 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.422049 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:04.424975 17420 leader_election.cc:304] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.425249 17595 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:04.427078 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:04.428141 22711 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:04.430498 17594 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:04.432003 17420 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.446143 22541 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:20:04.447642 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 56333.5us
I20260709 13:20:04.448403 22678 raft_consensus.cc:2804] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:04.452193 17529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:20:04.443224 22097 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:04.417567 22719 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:20:04.422259 22657 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:04.410295 22666 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:20:04.456138 17420 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.457360 17529 raft_consensus.cc:606] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:04.471632 22642 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:04.455402 22335 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:04.472055 17528 raft_consensus.cc:1240] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:04.457336 22711 raft_consensus.cc:2749] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:04.473104 22678 raft_consensus.cc:697] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:04.490187 22678 consensus_queue.cc:237] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.501992 17528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:20:04.502720 17528 raft_consensus.cc:606] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:04.503067 17528 raft_consensus.cc:614] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:04.515170 22145 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:04.530290 17420 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.534402 22598 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.541159 22423 consensus_queue.cc:1059] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:04.543893 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.544766 22598 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:04.548717 22475 raft_consensus.cc:3055] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:04.549219 22475 raft_consensus.cc:740] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:04.550154 22475 consensus_queue.cc:260] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.551240 22475 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.555500 17528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:20:04.556222 17528 raft_consensus.cc:606] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:04.556633 17528 raft_consensus.cc:614] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:04.557335 22717 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:04.556720 17350 catalog_manager.cc:5697] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:04.559195 17350 catalog_manager.cc:5697] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 8 to 10, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 10 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:04.557729 22717 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:04.561498 22717 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.562824 22717 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.567800 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:20:04.574123 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:04.583563 17350 catalog_manager.cc:5697] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:04.618184 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 92430.9us
W20260709 13:20:04.619109 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 73316.3us
I20260709 13:20:04.624169 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:04.631407 22715 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.631968 22715 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.635419 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:04.651505 17495 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:04.629945 22622 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:04.632089 22713 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:20:04.658267 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:04.658931 17520 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:20:04.659526 22734 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:04.660029 22734 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:04.660410 22734 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:04.661309 22649 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.661808 22649 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:04.663944 22649 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:04.668843 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:04.669818 17521 raft_consensus.cc:2410] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:04.670178 22536 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.670725 22536 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.672716 22536 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:04.649550 22715 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:04.675325 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 236636us
I20260709 13:20:04.676831 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:04.678056 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:04.678452 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f2604c78c341a88d17d653b9abcbda" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:04.627131 22398 raft_consensus.cc:515] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.680833 22734 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.682112 22398 leader_election.cc:290] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:04.682720 22620 raft_consensus.cc:3055] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:04.698297 22620 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:04.697801 17350 catalog_manager.cc:5697] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 10 to 12, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 12 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:04.683881 17569 consensus_peers.cc:597] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7398c91e7a884284a8b806d47551eaf7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.649170 22623 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:20:04.683761 18200 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:04.689606 17568 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:04.694226 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:04.704182 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.699251 22620 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.699663 17350 catalog_manager.cc:5697] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:04.705407 22620 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.706236 22398 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.710122 17569 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:04.709913 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 58526.6us
I20260709 13:20:04.718623 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:04.720289 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:04.705829 17350 catalog_manager.cc:5697] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 8 to 10, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 10 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:04.729126 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:04.729944 17450 raft_consensus.cc:2393] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:20:04.722501 22329 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.730612 22329 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.730971 22329 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.731832 22398 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:04.734848 22715 raft_consensus.cc:2804] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:04.735387 22715 raft_consensus.cc:697] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:04.735646 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:04.736280 22715 consensus_queue.cc:237] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:04.743638 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:04.744269 17448 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:20:04.744307 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:04.746198 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072fa9bcaa24490bd884d56ff245e5f" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:04.746990 17448 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.753877 17600 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:04.763859 18200 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:04.714779 22623 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:04.774355 17520 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:04.766201 17594 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.775827 17597 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:20:04.776230 17597 pending_rounds.cc:85] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting all ops after (but not including) 9
I20260709 13:20:04.776449 17597 pending_rounds.cc:107] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:20:04.776661 17597 raft_consensus.cc:2889] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:04.766490 17495 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:04.769207 17350 catalog_manager.cc:5697] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:04.773008 17601 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:04.773307 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:04.779844 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:04.780189 17599 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 16.
I20260709 13:20:04.782773 17602 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:20:04.740154 22689 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:04.786477 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:04.786867 17569 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.787128 17597 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 15.
I20260709 13:20:04.790009 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:04.790230 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:20:04.790674 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 394560us
I20260709 13:20:04.792025 17600 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:04.746069 22713 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:20:04.794828 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 45696.5us
I20260709 13:20:04.722635 22734 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:04.797933 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:04.805694 17454 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:04.807888 17350 catalog_manager.cc:5697] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 9 to 11, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 11 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:04.810195 17569 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.811211 17450 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:04.792917 22707 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:04.789808 22401 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:20:04.807708 22713 raft_consensus.cc:697] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:04.841552 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:04.855095 17452 raft_consensus.cc:1240] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:04.857201 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:04.853551 22717 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:04.808446 22598 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 13:20:04.872782 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 106410us
I20260709 13:20:04.873747 17495 leader_election.cc:304] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:04.853606 22707 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:04.845628 22721 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:20:04.885885 17448 raft_consensus.cc:2468] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
I20260709 13:20:04.884451 17420 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.890477 17454 raft_consensus.cc:1240] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:04.892517 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.894526 17420 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.864944 22713 consensus_queue.cc:237] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.915131 22657 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:04.915647 22657 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.915999 22657 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.925572 17420 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:04.900857 22738 raft_consensus.cc:2749] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:04.926299 22707 consensus_queue.cc:1059] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:20:04.938905 22657 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:04.939175 22742 consensus_queue.cc:1059] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:04.940763 22742 raft_consensus.cc:3055] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:04.940946 17594 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:04.941138 22742 raft_consensus.cc:740] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:04.941859 22617 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.943271 22657 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:04.903090 22681 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:04.926741 22145 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:04.950845 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:20:04.964258 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 75506.8us
I20260709 13:20:04.897656 22004 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:20:04.952517 22681 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:20:05.018318 17400 auto_rebalancer.cc:629] Failed to schedule move for tablet cb3ad3ce4b124497a737d40423bea33d: Illegal state: Replica abf46e430b7e4ad4919ca2a717f37e0e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:05.059118 22713 consensus_queue.cc:1059] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:05.060840 22741 raft_consensus.cc:3055] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:05.061375 22741 raft_consensus.cc:740] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:20:05.059118 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 93666.5us
I20260709 13:20:05.087423 17603 raft_consensus.cc:1240] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:05.092839 22709 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:05.098997 22754 ts_tablet_manager.cc:933] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:05.041607 22681 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:05.123931 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 198473us
I20260709 13:20:05.127985 22744 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:20:05.128965 22743 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:05.062594 22741 consensus_queue.cc:260] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.103268 22707 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:20:05.139645 22329 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.091990 22622 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:20:05.121973 22398 raft_consensus.cc:3055] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:05.143754 22398 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:05.144562 22398 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.145347 22623 raft_consensus.cc:3055] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:05.009606 22742 consensus_queue.cc:260] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.148833 22741 raft_consensus.cc:3060] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.125218 17420 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:05.149525 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:05.154429 22707 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:05.145884 22398 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.145913 22623 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:05.163700 22707 consensus_queue.cc:1059] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:20:05.209247 22707 raft_consensus.cc:3055] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:05.209678 22707 raft_consensus.cc:740] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:05.210606 22707 consensus_queue.cc:260] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:05.211727 17598 raft_consensus.cc:1240] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:05.158282 22145 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:05.155501 22401 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.151443 22622 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:20:05.236613 17598 raft_consensus.cc:1240] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:20:05.212867 22709 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.241539 17445 raft_consensus.cc:1240] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:20:05.243067 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.214596 22707 raft_consensus.cc:3060] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.227833 22329 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:05.238412 22744 consensus_queue.cc:1059] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:20:05.245836 22713 consensus_queue.cc:1059] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:20:05.233314 22401 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.247100 22709 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.279458 17569 leader_election.cc:304] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:05.291567 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:05.313856 17448 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:05.315405 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:05.321265 17446 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:05.334555 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 55189.2us
I20260709 13:20:05.340317 18200 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:05.277710 22681 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.348407 22423 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:05.362120 22423 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.364289 22423 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:05.368093 22681 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:05.369463 22709 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:05.343360 22541 raft_consensus.cc:2804] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:05.376372 17446 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:20:05.388103 22754 tablet_copy_client.cc:323] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:20:05.388872 22541 raft_consensus.cc:697] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:20:05.370716 22748 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:20:05.392984 22401 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:05.383987 22617 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:05.394964 22617 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:05.411365 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 82418us
I20260709 13:20:05.424109 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:05.390173 22541 consensus_queue.cc:237] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.430054 17528 raft_consensus.cc:2393] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 16: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:20:05.421141 18167 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:05.431751 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:20:05.448331 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 101656us
I20260709 13:20:05.456840 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:05.457612 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:05.458822 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:05.444293 22737 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:05.462241 17527 raft_consensus.cc:1275] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:20:05.462774 17527 pending_rounds.cc:85] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 10
I20260709 13:20:05.463044 17527 pending_rounds.cc:107] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:20:05.463339 17527 raft_consensus.cc:2889] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:05.456171 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 110063us
I20260709 13:20:05.460690 22401 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:05.477399 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:05.484684 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:05.472162 22617 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:05.502939 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet 7398c91e7a884284a8b806d47551eaf7 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:20:05.503729 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet 7398c91e7a884284a8b806d47551eaf7 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-7398c91e7a884284a8b806d47551eaf7
I20260709 13:20:05.483852 22401 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.509188 22401 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:05.510260 22623 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.511102 22398 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:05.514529 17613 tablet_copy_source_session.cc:215] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:05.532473 22747 consensus_queue.cc:1059] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:05.538339 22747 consensus_queue.cc:1059] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:05.548338 17601 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:05.550825 22741 raft_consensus.cc:3055] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:05.551530 22741 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:05.552728 22741 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:05.556445 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 71807.3us
W20260709 13:20:05.576282 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 101002us
I20260709 13:20:05.581203 17599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:05.582852 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:05.590440 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:05.590823 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:05.594925 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:05.566039 22716 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:20:05.611958 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:05.586621 22401 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:05.614882 22401 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:20:05.581981 22398 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:05.619144 22335 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:05.645327 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 111943us
I20260709 13:20:05.650193 17454 raft_consensus.cc:1240] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:05.650357 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:05.650964 17495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:05.650195 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.656031 17594 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 16.
I20260709 13:20:05.659628 22744 consensus_queue.cc:1059] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:20:05.656204 22754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7398c91e7a884284a8b806d47551eaf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.667325 22623 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.633888 22398 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.683825 17420 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:05.685197 17420 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:05.686529 22598 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:05.688048 22598 raft_consensus.cc:697] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:05.686547 22711 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:05.689015 22598 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.689402 22398 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:05.684788 22622 consensus_queue.cc:1059] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:20:05.700572 22743 raft_consensus.cc:3055] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:05.701074 22743 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:05.704739 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:05.705148 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:05.701917 22743 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.707304 22741 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.707664 22743 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:05.721885 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:05.724864 22689 raft_consensus.cc:3055] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:05.725287 22689 raft_consensus.cc:740] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:05.726148 22689 consensus_queue.cc:260] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.727483 22689 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.729187 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:05.731552 22715 consensus_queue.cc:1048] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:05.762194 17569 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:05.764076 22732 raft_consensus.cc:993] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7: : Instructing follower 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:05.764473 22742 raft_consensus.cc:3060] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.764577 22732 raft_consensus.cc:1081] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Signalling peer 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:05.777518 17451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:55882
I20260709 13:20:05.761615 22681 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:05.780045 22681 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.782718 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:05.784307 17528 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:05.786794 17451 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:05.787223 17451 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.836701 17526 raft_consensus.cc:1275] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:20:05.837308 17526 pending_rounds.cc:85] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 7
I20260709 13:20:05.837622 17526 pending_rounds.cc:107] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:05.837939 17526 raft_consensus.cc:2889] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:05.832481 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 46091.3us
W20260709 13:20:05.847441 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 55498.5us
I20260709 13:20:05.848310 17569 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:05.859215 22719 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:05.859827 22719 raft_consensus.cc:697] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:05.860826 22719 consensus_queue.cc:237] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.791424 17419 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:05.616091 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:05.862480 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 71138.2us
I20260709 13:20:05.864485 22642 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.864988 22642 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:05.865432 22642 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.872807 22681 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:05.847337 22541 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:05.882273 17569 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:05.883697 17569 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:05.848228 22783 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:20:05.898450 22728 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:05.901678 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:05.907791 22728 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:05.893445 22642 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.909363 22401 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:05.915802 17569 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:05.897797 17451 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:05.934890 22743 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.939780 22398 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:05.934435 22728 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:05.951086 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:05.946813 22743 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:05.955395 22743 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:05.957767 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:05.958386 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:05.958704 18194 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 16.
I20260709 13:20:05.970329 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:05.959038 17596 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 16.
I20260709 13:20:05.971370 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:05.972184 17603 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:05.972298 22743 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:05.972754 22743 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.973102 22743 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:05.977209 17451 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:05.971149 22715 consensus_queue.cc:1048] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:05.979697 22642 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:05.981081 17568 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:05.982015 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:05.983845 22754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42548 (request call id 458) took 1098 ms. Trace:
I20260709 13:20:05.984249 22754 rpcz_store.cc:276] 0709 13:20:04.897209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.902568 (+  5359us) service_pool.cc:224] Handling call
0709 13:20:05.099514 (+196946us) ts_tablet_manager.cc:934] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
0709 13:20:05.600871 (+501357us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:20:05.859515 (+258644us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:05.859652 (+   137us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:20:05.983059 (+123407us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:20:05.983374 (+   315us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:05.983703 (+   329us) ts_tablet_manager.cc:989] Replica registered.
0709 13:20:05.983765 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":3432,"tablet-copy.queue_time_us":169123,"thread_start_us":370366,"threads_started":2}
I20260709 13:20:05.985041 22716 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:05.997115 17350 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 103) took 7047 ms. Trace:
I20260709 13:20:06.002152 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:06.002794 17525 raft_consensus.cc:3055] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:06.003120 17525 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:06.003888 17525 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.004809 17520 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:06.005064 17525 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.006353 22743 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:06.008394 17419 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:06.009176 22536 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:06.009610 22536 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:06.010483 22536 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.017500 17447 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:20:06.018971 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:06.019693 18196 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:06.023729 17347 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40508 (request call id 188) took 33167 ms (client timeout 15000 ms). Trace:
I20260709 13:20:06.017956 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:06.024887 17595 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:06.029390 18196 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 17.
I20260709 13:20:06.032562 17524 raft_consensus.cc:1275] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:20:06.032948 17524 pending_rounds.cc:85] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 7
I20260709 13:20:06.033174 17524 pending_rounds.cc:107] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:20:06.033399 17524 raft_consensus.cc:2889] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:06.034071 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:06.034757 17594 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:06.034994 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:06.035559 17600 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.036722 22728 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:06.033270 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:06.038535 22732 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:06.039017 22732 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:06.039829 22732 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:06.001498 17350 rpcz_store.cc:276] 0709 13:19:58.949858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.094815 (+144957us) service_pool.cc:224] Handling call
0709 13:20:05.997012 (+6902197us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:05.013209 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:05.013847 (+   638us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:05.013885 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:20:05.013908 (+    23us) tablet.cc:662] Decoding operations
0709 13:20:05.014881 (+   973us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:05.014961 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:05.014995 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:20:05.087447 (+ 72452us) tablet.cc:701] Row locks acquired
0709 13:20:05.091888 (+  4441us) write_op.cc:260] PREPARE: finished
0709 13:20:05.124122 (+ 32234us) write_op.cc:270] Start()
0709 13:20:05.148381 (+ 24259us) write_op.cc:276] Timestamp: P: 1783603205123281 usec, L: 0
0709 13:20:05.148411 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:20:05.150107 (+  1696us) log.cc:844] Serialized 3281 byte log entry
0709 13:20:05.393156 (+243049us) op_driver.cc:464] REPLICATION: finished
0709 13:20:05.547203 (+154047us) write_op.cc:301] APPLY: starting
0709 13:20:05.547287 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:05.603696 (+ 56409us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:05.603813 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:05.659644 (+ 55831us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:05.659888 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:20:05.659939 (+    51us) write_op.cc:312] APPLY: finished
0709 13:20:05.660211 (+   272us) log.cc:844] Serialized 81 byte log entry
0709 13:20:05.661111 (+   900us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:05.661240 (+   129us) write_op.cc:454] Released schema lock
0709 13:20:05.661299 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:05.661975 (+   676us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:05.662007 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1833442,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":153758,"apply.run_cpu_time_us":12733,"apply.run_wall_time_us":114751,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37583,"num_ops":8,"prepare.queue_time_us":148215,"prepare.run_cpu_time_us":4792,"prepare.run_wall_time_us":137220,"replication_time_us":230537,"thread_start_us":230519,"threads_started":2}]]}
I20260709 13:20:06.044709 17600 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:05.985808 22754 tablet_copy_client.cc:806] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
W20260709 13:20:06.024181 17347 rpcz_store.cc:269] 0709 13:19:32.855991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.856201 (+   210us) service_pool.cc:224] Handling call
0709 13:20:06.023659 (+33167458us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:03.309091 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:03.341546 (+ 32455us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:03.341616 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:20:03.341630 (+    14us) tablet.cc:662] Decoding operations
0709 13:20:03.342639 (+  1009us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:03.342742 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:03.342768 (+    26us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:20:03.343468 (+   700us) tablet.cc:701] Row locks acquired
0709 13:20:03.343508 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:20:03.343698 (+   190us) write_op.cc:270] Start()
0709 13:20:03.343837 (+   139us) write_op.cc:276] Timestamp: P: 1783603203343634 usec, L: 0
0709 13:20:03.343867 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:20:03.344620 (+   753us) log.cc:844] Serialized 2478 byte log entry
0709 13:20:03.459406 (+114786us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab2a5c0ac 00007f5abb8b6ab9 00007f5ab2a7869b 00007f5ab2a7693f 00007f5ab2a78c02 00007f5ab570020b
0709 13:20:03.720803 (+261397us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b4400022b4c. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab2901db1 00007f5ab299fc85 00007f5ab29a06a2 00007f5ab57121db 00007f5ab570daaf 00007f5ab570186e 00007f5ab5700bb6 00007f5ab57007d8 00007f5ab570a221 00007f5ab570a1d9 00007f5ab570a169
0709 13:20:03.791166 (+ 70363us) op_driver.cc:464] REPLICATION: finished
0709 13:20:04.027805 (+236639us) write_op.cc:301] APPLY: starting
0709 13:20:04.049072 (+ 21267us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:04.245711 (+196639us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:04.245759 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:04.278807 (+ 33048us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:04.279131 (+   324us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:20:04.279207 (+    76us) write_op.cc:312] APPLY: finished
0709 13:20:04.279541 (+   334us) log.cc:844] Serialized 65 byte log entry
0709 13:20:04.286904 (+  7363us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:04.287065 (+   161us) write_op.cc:454] Released schema lock
0709 13:20:04.287142 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:04.321919 (+ 34777us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:04.324162 (+  2243us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":573680,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":199220,"apply.run_cpu_time_us":11681,"apply.run_wall_time_us":303374,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29219,"num_ops":6,"prepare.queue_time_us":562512,"prepare.run_cpu_time_us":18328,"prepare.run_wall_time_us":368878,"raft.queue_time_us":264072,"raft.run_cpu_time_us":46228,"raft.run_wall_time_us":283405,"replication_time_us":447050,"spinlock_wait_cycles":16973312,"thread_start_us":493916,"threads_started":5,"wal-append.queue_time_us":363154}]]}
I20260709 13:20:06.047485 22728 consensus_queue.cc:1048] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:20:06.008363 22743 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:06.061497 17420 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:06.070086 22712 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:06.067947 22754 tablet_copy_client.cc:670] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:06.099699 22541 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.130664 17595 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 17.
I20260709 13:20:06.101166 22657 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:06.123165 22712 raft_consensus.cc:697] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:06.137542 22657 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.138527 22712 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.139883 22657 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:06.141489 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:06.142414 17520 raft_consensus.cc:2393] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 16: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:20:06.151697 17595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:06.152966 17595 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 16.
I20260709 13:20:06.198145 17520 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:06.198168 17348 catalog_manager.cc:5697] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.200841 17348 catalog_manager.cc:5697] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 4 to 9, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 9 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.202529 17348 catalog_manager.cc:5697] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.203866 17348 catalog_manager.cc:5697] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 10 to 13, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.153823 22541 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.210395 22753 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:06.215756 17348 catalog_manager.cc:5697] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 11 to 13, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.227458 17525 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:06.244282 17348 catalog_manager.cc:5697] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.256971 17348 catalog_manager.cc:5697] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 9 to 11, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 11 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.255079 22754 tablet_copy_client.cc:538] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:06.260624 17348 catalog_manager.cc:5697] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 11 to 14, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:06.273032 22790 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:06.281286 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:06.284925 22787 log.cc:927] Time spent T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:20:06.290584 22712 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:06.292421 22712 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.300982 17348 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.305020 22541 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:06.307253 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:06.308264 17520 raft_consensus.cc:2410] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:06.288609 22145 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:06.314625 22145 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:06.315044 22145 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:06.315248 22792 log.cc:927] Time spent T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:20:06.345469 17603 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:20:06.346882 22791 log.cc:927] Time spent T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:20:06.360060 17348 catalog_manager.cc:5697] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.361876 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:06.359440 22656 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:20:06.380187 22712 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:06.386901 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:06.387909 17526 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 15: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
W20260709 13:20:06.390966 22784 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.272s	user 0.003s	sys 0.001s
W20260709 13:20:06.394457 22780 log.cc:927] Time spent T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.322s	user 0.000s	sys 0.004s
I20260709 13:20:06.414515 22719 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.415096 22719 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.417488 22719 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:06.420377 17526 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:20:06.420846 17526 pending_rounds.cc:85] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Aborting all ops after (but not including) 7
I20260709 13:20:06.421108 17526 pending_rounds.cc:107] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:20:06.421371 17526 raft_consensus.cc:2889] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:06.429900 17601 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:20:06.430869 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 61487us
I20260709 13:20:06.434151 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:06.434911 17452 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:06.438949 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:06.444602 22622 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:06.448438 22754 tablet_bootstrap.cc:492] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:06.452551 17348 catalog_manager.cc:5697] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.454353 17348 catalog_manager.cc:5697] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 6 to 12, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 12 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.439848 17526 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:20:06.459287 17348 catalog_manager.cc:5697] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.479435 17348 catalog_manager.cc:5697] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 12 to 14, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 14 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.485947 17348 catalog_manager.cc:5697] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.489646 17600 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:06.493793 17568 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:06.491796 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:06.515410 17603 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 15.
I20260709 13:20:06.523481 22617 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:06.524066 22617 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.524477 22617 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:06.529801 17348 catalog_manager.cc:5697] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 9 to 12, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 12 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.500475 22472 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:20:06.557472 18194 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:06.558982 22622 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:06.560516 22145 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.568226 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:06.569005 17521 raft_consensus.cc:2393] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 16: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:20:06.565407 17348 catalog_manager.cc:5697] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 9 to 12, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 12 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
W20260709 13:20:06.578433 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 101335us
W20260709 13:20:06.578732 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 65226.8us
I20260709 13:20:06.579279 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:06.583879 22732 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.588068 22732 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.590691 17348 catalog_manager.cc:5697] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 11 to 12, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 12 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.602707 17525 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:06.607156 17348 catalog_manager.cc:5697] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 9 to 12, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 12 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.608239 22642 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:06.608883 17348 catalog_manager.cc:5697] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.615090 22732 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:06.600744 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:06.620009 17348 catalog_manager.cc:5697] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 9 to 12, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 12 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.621841 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:06.622673 17603 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 16.
I20260709 13:20:06.627110 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:06.626721 17348 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 8 to 11, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 11 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.599164 22802 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:06.630163 22622 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:06.630576 22736 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:06.633895 22617 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.643882 22622 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.646574 22622 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:06.620648 22145 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:06.651798 22617 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:06.653123 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:06.691632 17420 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:06.693516 17602 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:06.700103 17348 catalog_manager.cc:5697] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 12 to 15, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 15 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.702965 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:06.704304 17348 catalog_manager.cc:5697] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.703722 22753 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:20:06.703513 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:06.730829 17524 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:06.669595 22622 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.735193 17569 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:06.723688 22536 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:06.757083 22716 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:06.757715 22716 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.742925 22802 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:06.746359 22536 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:06.746544 22711 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:06.768162 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:06.768780 17524 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
I20260709 13:20:06.740811 22753 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:20:06.768954 22716 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:06.770555 17568 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:06.775146 22716 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:06.775606 22716 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:06.776016 22716 raft_consensus.cc:3060] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.770354 17348 catalog_manager.cc:5697] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 7 to 10, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 10 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:06.782420 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 58851.1us
I20260709 13:20:06.766124 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:06.765600 22656 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:06.785032 22598 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:06.790908 22622 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:06.796583 17447 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 16: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:20:06.797900 17602 raft_consensus.cc:1240] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:20:06.800618 17601 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 16.
I20260709 13:20:06.794145 22711 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.807415 22656 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.768689 22536 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:06.814977 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:06.813632 17348 catalog_manager.cc:5697] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.817348 17601 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:06.818367 17348 catalog_manager.cc:5697] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.820811 17348 catalog_manager.cc:5697] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 8 to 11, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 11 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.822923 17348 catalog_manager.cc:5697] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 4 to 12, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 12 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:06.830297 22656 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:06.832245 22711 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:06.837873 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:06.838739 17528 raft_consensus.cc:2368] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 16. Current term is 17.
I20260709 13:20:06.845249 17601 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 17.
I20260709 13:20:06.839838 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:06.846897 17419 leader_election.cc:400] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 16. Current term is 17.
I20260709 13:20:06.851743 17419 leader_election.cc:403] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:06.851743 17521 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:06.854981 17495 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:06.856839 17419 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:06.871695 22681 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:06.872231 22681 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:06.872627 22681 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.859174 22709 raft_consensus.cc:3060] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:06.861318 22622 raft_consensus.cc:2804] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:06.881645 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 82587.3us
I20260709 13:20:06.886543 22807 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.888864 22807 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.891140 22807 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:06.903527 22716 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.921092 22622 raft_consensus.cc:697] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:06.921952 22716 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:06.922210 22622 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.923141 22536 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.925450 22536 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:20:06.926427 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 45652.4us
I20260709 13:20:06.931583 22709 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943) with higher term. Message: Invalid argument: T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 16. Current term is 17.
I20260709 13:20:06.932850 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:06.935245 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:06.936048 17454 raft_consensus.cc:2393] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 16: Already voted for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in this term.
I20260709 13:20:06.937383 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:06.938213 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:06.939038 17520 raft_consensus.cc:2393] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 15: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:20:06.938958 17603 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 16.
I20260709 13:20:06.944597 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:06.945724 22807 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:06.948083 22807 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.948434 22807 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:06.957234 17521 raft_consensus.cc:2468] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
I20260709 13:20:06.959589 17568 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
W20260709 13:20:06.961612 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 74669.8us
I20260709 13:20:06.968393 22716 raft_consensus.cc:2804] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:06.969058 22716 raft_consensus.cc:697] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:06.970340 22716 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.972100 22681 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.976312 17420 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:06.980593 22536 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:06.976956 22709 consensus_queue.cc:1059] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:20:06.981171 22536 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:06.981667 22709 raft_consensus.cc:3055] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:06.982163 22709 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:06.982209 22536 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.983397 22709 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:06.985370 22709 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:06.996714 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:07.011410 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:07.003334 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:07.013887 17602 raft_consensus.cc:2393] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:07.016639 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:07.022454 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:07.022749 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:07.025072 17600 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 15.
I20260709 13:20:07.027362 17603 raft_consensus.cc:2368] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 16. Current term is 17.
I20260709 13:20:07.036386 22681 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:07.016288 22807 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.050387 17521 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:07.054090 17419 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:07.049595 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:07.054796 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:07.057262 17602 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:07.062474 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:07.063395 17598 raft_consensus.cc:2393] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in current term 14: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:07.041779 22807 leader_election.cc:290] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:07.066562 17454 raft_consensus.cc:2468] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 17.
I20260709 13:20:07.064409 22681 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:07.070861 22809 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.080094 17420 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:07.081835 22681 raft_consensus.cc:697] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:07.087946 17420 leader_election.cc:400] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 16 pre-election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 16. Current term is 17.
I20260709 13:20:07.084412 22809 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.089375 22681 consensus_queue.cc:237] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.089035 22753 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:07.152992 22809 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:07.162608 22753 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:07.149988 17602 raft_consensus.cc:2468] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 17.
I20260709 13:20:07.232604 22753 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.233386 17495 leader_election.cc:304] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:07.235000 22809 raft_consensus.cc:2804] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:07.235559 22809 raft_consensus.cc:697] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
W20260709 13:20:07.163347 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 74526.2us
I20260709 13:20:07.238514 22809 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.155920 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:07.253331 17601 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
W20260709 13:20:07.173297 22815 log.cc:927] Time spent T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.094s	user 0.005s	sys 0.000s
I20260709 13:20:07.254232 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:07.256345 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:07.260196 22622 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:07.260941 22622 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.261385 22622 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:07.289522 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 116672us
I20260709 13:20:07.299793 22598 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.300395 22598 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.318846 22598 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:07.321419 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:07.322947 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:07.324110 17520 raft_consensus.cc:2410] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0480cf54c3cc424ab94b963ef2ff5bf4 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:07.332127 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:07.343474 22622 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.359555 22622 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:07.367645 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:07.368372 17602 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:07.371212 17419 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:07.378815 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:07.391532 17602 raft_consensus.cc:2468] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 16.
I20260709 13:20:07.386283 22656 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:07.395330 17495 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:07.412915 17451 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:07.414697 17602 raft_consensus.cc:1240] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:07.399430 22807 raft_consensus.cc:2804] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:07.423481 17521 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:07.420436 22681 consensus_queue.cc:1059] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:20:07.427059 22807 raft_consensus.cc:697] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:07.452549 22807 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.459964 22753 raft_consensus.cc:3055] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:07.460449 22753 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:07.418857 22622 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:20:07.473809 22736 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:20:07.488797 17603 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:07.495013 17454 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:07.461485 22753 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.511855 22736 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 13:20:07.538331 22822 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.004s
I20260709 13:20:07.511785 22807 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:20:07.570214 17602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:07.570873 17602 raft_consensus.cc:606] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:07.578095 22754 tablet_bootstrap.cc:492] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.579252 22754 tablet_bootstrap.cc:492] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:07.580065 22754 ts_tablet_manager.cc:1403] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 1.132s	user 0.044s	sys 0.024s
W20260709 13:20:07.574447 22823 log.cc:927] Time spent T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
I20260709 13:20:07.607589 22753 raft_consensus.cc:3060] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:07.614048 17602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:07.614775 17602 raft_consensus.cc:606] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:07.615203 17602 raft_consensus.cc:614] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:07.633419 17602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:07.634039 17602 raft_consensus.cc:606] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:07.634384 17602 raft_consensus.cc:614] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:07.657150 17601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:07.657793 17601 raft_consensus.cc:606] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:07.658178 17601 raft_consensus.cc:614] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:07.673769 17602 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:07.675843 22622 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:07.701670 17602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bea493621f1e42c2b8689859233cc798"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:07.702530 17602 raft_consensus.cc:606] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:07.703048 22754 raft_consensus.cc:359] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:07.704499 22754 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:07.705183 22754 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:07.717445 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:07.718811 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:07.723896 22754 ts_tablet_manager.cc:1434] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.143s	user 0.008s	sys 0.000s
I20260709 13:20:07.727273 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-7398c91e7a884284a8b806d47551eaf7 received from {username='slave'} at 127.0.0.1:52572
I20260709 13:20:07.727787 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-7398c91e7a884284a8b806d47551eaf7 on tablet 7398c91e7a884284a8b806d47551eaf7 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:07.744017 17598 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:07.744627 17521 raft_consensus.cc:1240] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:07.748070 22811 consensus_queue.cc:1059] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:07.748858 22811 consensus_queue.cc:1243] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Peer ddfe9cca0741489b994f8b0178c54fe7 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:20:07.749420 22811 raft_consensus.cc:3055] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:07.752393 22681 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:07.756709 17454 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:20:07.757184 17454 pending_rounds.cc:85] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 10
I20260709 13:20:07.757452 17454 pending_rounds.cc:107] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:20:07.757735 17454 raft_consensus.cc:2889] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:07.749807 22811 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:07.761216 22811 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.767504 22807 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:07.782145 22811 raft_consensus.cc:3060] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:07.783106 17521 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:07.791028 22681 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:20:07.839815 22617 raft_consensus.cc:993] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: : Instructing follower 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:07.840386 22617 raft_consensus.cc:1081] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Signalling peer 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:07.842250 17451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bea493621f1e42c2b8689859233cc798"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:20:07.842864 17451 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:07.843263 17451 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.855652 22736 raft_consensus.cc:993] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: : Instructing follower 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:07.856269 22716 raft_consensus.cc:1081] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Signalling peer 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:07.860524 17454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:20:07.862629 17454 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:07.857997 17451 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.863035 17454 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:07.880056 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:07.880951 17528 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.884833 17451 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:07.888839 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:07.889654 17601 raft_consensus.cc:3055] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:07.890046 17601 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:07.905959 17454 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.908123 17601 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.911141 17601 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.916289 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:07.916909 17521 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:07.916194 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:07.915365 17454 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:07.917459 17600 raft_consensus.cc:3055] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:07.917753 17600 raft_consensus.cc:740] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:07.923920 18194 raft_consensus.cc:1217] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:20:07.931625 17601 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:07.933640 17420 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:07.938149 17601 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:07.937736 17600 consensus_queue.cc:260] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:07.993641 17600 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:08.005765 17600 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:20:08.015156 17420 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:07.947470 22681 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:07.989440 22622 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:20:08.018709 22753 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:08.045804 17521 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 9.
I20260709 13:20:08.110755 17528 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:08.078469 22681 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:08.123257 17451 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:20:08.123838 17451 pending_rounds.cc:85] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting all ops after (but not including) 9
I20260709 13:20:08.124130 17451 pending_rounds.cc:107] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:20:08.124456 17451 raft_consensus.cc:2889] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:08.134222 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 61869.5us
W20260709 13:20:08.135767 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 69353.4us
I20260709 13:20:08.133442 22622 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:20:08.146934 22753 raft_consensus.cc:697] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:08.168890 22681 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:08.171097 22753 consensus_queue.cc:237] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:08.305454 17554 heartbeater.cc:646] Failed to heartbeat to 127.15.242.126:39589 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.15.242.126:39589 timed out after 15.000s (SENT)
W20260709 13:20:08.336462 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 63492.7us
I20260709 13:20:08.356817 22835 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:08.361989 22835 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:08.364265 22835 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:08.371392 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:08.377328 17598 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 15: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:08.371392 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:08.382793 17452 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:08.392390 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:08.393544 22835 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:08.393985 22835 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:08.394454 22835 raft_consensus.cc:3060] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:08.406921 17347 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 13 to 16, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 16 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:08.408548 17347 catalog_manager.cc:5697] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 10 to 11, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 11 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:08.410110 17347 catalog_manager.cc:5697] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 12 to 13, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 13 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:08.412863 17347 catalog_manager.cc:5697] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:08.417071 22835 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:08.425446 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:08.434514 17347 catalog_manager.cc:5697] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 9 to 11, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 11 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:08.438800 22835 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:08.438913 17601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:08.439875 17601 raft_consensus.cc:2393] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 15: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:20:08.454545 17348 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40488 (request call id 193) took 15048 ms (client timeout 15000 ms). Trace:
I20260709 13:20:08.465441 17454 raft_consensus.cc:2468] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
W20260709 13:20:08.455034 17348 rpcz_store.cc:269] 0709 13:19:53.410695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.437069 (+ 26374us) service_pool.cc:224] Handling call
0709 13:19:53.728362 (+291293us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b540001b8d4. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5ab5ad0090 00007f5ab5b6ef3a 00007f5abb9251cc 00007f5abba2337e 00007f5ab9ee42a4 00007f5ab9ee4232 00007f5ab9ee4161 00007f5ab9ee40dc 00007f5ab9ee3392 00007f5ab3ea148c 00007f5ab3ea08c6
0709 13:20:08.454445 (+14726083us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:07.311498 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:07.312255 (+   757us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:07.312302 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:20:07.312329 (+    27us) tablet.cc:662] Decoding operations
0709 13:20:07.369425 (+ 57096us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:07.369512 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:07.369537 (+    25us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:20:07.442575 (+ 73038us) tablet.cc:701] Row locks acquired
0709 13:20:07.442608 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:20:07.442754 (+   146us) write_op.cc:270] Start()
0709 13:20:07.442881 (+   127us) write_op.cc:276] Timestamp: P: 1783603207442707 usec, L: 0
0709 13:20:07.442907 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:20:07.444960 (+  2053us) log.cc:844] Serialized 11393 byte log entry
0709 13:20:07.552344 (+107384us) op_driver.cc:464] REPLICATION: finished
0709 13:20:07.553591 (+  1247us) write_op.cc:301] APPLY: starting
0709 13:20:07.561436 (+  7845us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:07.983652 (+422216us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:07.983765 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:08.354061 (+370296us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:08.360470 (+  6409us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:20:08.360519 (+    49us) write_op.cc:312] APPLY: finished
0709 13:20:08.361030 (+   511us) log.cc:844] Serialized 252 byte log entry
0709 13:20:08.376669 (+ 15639us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:08.376939 (+   270us) write_op.cc:454] Released schema lock
0709 13:20:08.377006 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:08.377449 (+   443us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:08.377488 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":53,"spinlock_wait_cycles":4944640,"child_traces":[["op",{"apply.queue_time_us":984,"apply.run_cpu_time_us":42513,"apply.run_wall_time_us":823826,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125405,"num_ops":29,"prepare.queue_time_us":180632,"prepare.run_cpu_time_us":37326,"prepare.run_wall_time_us":175042,"raft.queue_time_us":5613,"raft.run_cpu_time_us":1084,"raft.run_wall_time_us":1084,"replication_time_us":109285,"spinlock_wait_cycles":39296,"thread_start_us":225155,"threads_started":4,"wal-append.queue_time_us":41488}]]}
I20260709 13:20:08.517594 17495 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:08.518880 22835 raft_consensus.cc:2804] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:08.519454 22835 raft_consensus.cc:697] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:08.520339 22835 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:08.715741 17347 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 104) took 2307 ms. Trace:
I20260709 13:20:08.719764 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:08.723642 18194 consensus_queue.cc:237] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:08.755261 17601 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:08.718113 17347 rpcz_store.cc:276] 0709 13:20:06.408028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.408198 (+   170us) service_pool.cc:224] Handling call
0709 13:20:08.715611 (+2307413us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:08.480340 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:08.481171 (+   831us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:08.481222 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:20:08.481239 (+    17us) tablet.cc:662] Decoding operations
0709 13:20:08.521710 (+ 40471us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:08.521782 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:08.521812 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:20:08.522757 (+   945us) tablet.cc:701] Row locks acquired
0709 13:20:08.522778 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:20:08.522931 (+   153us) write_op.cc:270] Start()
0709 13:20:08.523065 (+   134us) write_op.cc:276] Timestamp: P: 1783603208522879 usec, L: 0
0709 13:20:08.523088 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:20:08.526486 (+  3398us) log.cc:844] Serialized 2069 byte log entry
0709 13:20:08.587109 (+ 60623us) op_driver.cc:464] REPLICATION: finished
0709 13:20:08.588478 (+  1369us) write_op.cc:301] APPLY: starting
0709 13:20:08.588568 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:08.591799 (+  3231us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:08.591925 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:08.601734 (+  9809us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:08.601920 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:20:08.601973 (+    53us) write_op.cc:312] APPLY: finished
0709 13:20:08.602244 (+   271us) log.cc:844] Serialized 57 byte log entry
0709 13:20:08.602420 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:08.602538 (+   118us) write_op.cc:454] Released schema lock
0709 13:20:08.602582 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:08.603020 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:08.603052 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35020,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":1036,"apply.run_cpu_time_us":8159,"apply.run_wall_time_us":14477,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20910,"num_ops":5,"prepare.queue_time_us":41318,"prepare.run_cpu_time_us":4137,"prepare.run_wall_time_us":46526,"replication_time_us":63806,"spinlock_wait_cycles":1920,"thread_start_us":42711,"threads_started":1}]]}
W20260709 13:20:08.826370 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 67560.1us
I20260709 13:20:08.953919 17528 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:20:09.030591 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 93989.2us
W20260709 13:20:09.083923 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 51170.6us
W20260709 13:20:09.084136 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45237.2us
W20260709 13:20:09.131995 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 184323us
I20260709 13:20:09.175999 22847 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.176529 22847 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:09.229223 22847 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:09.240856 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 269285us
I20260709 13:20:09.241791 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:09.243172 17452 raft_consensus.cc:2410] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 13:20:09.243741 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 158811us
I20260709 13:20:09.261031 22717 raft_consensus.cc:1064] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:09.263048 17452 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:09.268936 22853 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:09.271198 17351 catalog_manager.cc:5697] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 8 to 11, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 11 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:09.283313 17351 catalog_manager.cc:5697] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 8 to 11, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 11 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:09.257802 22863 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:20:09.290071 22844 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:09.294445 17448 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:09.285374 17351 catalog_manager.cc:5697] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 11 to 12, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 12 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:09.330427 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 85269.5us
W20260709 13:20:09.353714 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 268330us
I20260709 13:20:09.361008 17598 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:09.415405 17598 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:20:09.474762 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 48837.8us
W20260709 13:20:09.472507 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 58558.9us
W20260709 13:20:09.474184 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 101434us
W20260709 13:20:09.480986 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 45460.3us
W20260709 13:20:09.496984 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 335752us
W20260709 13:20:09.515954 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 100012us
I20260709 13:20:09.509622 22865 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 13:20:09.537544 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 130615us
I20260709 13:20:09.474977 22717 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:09.540175 22884 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:20:09.548465 22862 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:20:09.564118 17603 raft_consensus.cc:1275] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:09.556486 22878 raft_consensus.cc:2955] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 8 to 10, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:09.583333 17528 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:20:09.584784 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:09.563899 17452 raft_consensus.cc:2955] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 8 to 10, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:09.601569 17567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.622506 22751 consensus_queue.cc:1048] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:09.649186 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2edee9f2356c4e878f2e11af63e46ab9 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:09.654337 17568 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:09.726353 17527 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:20:09.839800 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 92860.6us
I20260709 13:20:09.840713 17594 raft_consensus.cc:2955] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 8 to 10, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:09.850438 18194 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:09.862728 17448 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:09.872892 22889 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.873562 22889 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:09.878705 22892 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:09.880959 22868 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:20:09.881047 22861 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
W20260709 13:20:09.881758 22895 log.cc:927] Time spent T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:20:09.948437 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 165110us
I20260709 13:20:09.979208 22717 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 13:20:09.993148 22904 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:10.024972 17347 catalog_manager.cc:5697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 13 to 17, leader changed from 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 17 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:10.027091 17347 catalog_manager.cc:5697] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index -1 to 11, term changed from 11 to 17, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 17 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:10.034446 22865 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:20:10.046156 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 120914us
I20260709 13:20:10.037814 22847 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:10.054432 22865 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:10.082713 22905 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:20:10.089275 22889 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:10.096766 22868 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:10.119896 22865 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:10.142403 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:10.143855 22809 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:10.163867 22809 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:10.165068 17347 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 105) took 1318 ms. Trace:
W20260709 13:20:10.170500 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 70706.6us
I20260709 13:20:10.165503 17347 rpcz_store.cc:276] 0709 13:20:08.846940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.847116 (+   176us) service_pool.cc:224] Handling call
0709 13:20:10.164978 (+1317862us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:10.045774 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:10.097406 (+ 51632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:10.097442 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:20:10.097464 (+    22us) tablet.cc:662] Decoding operations
0709 13:20:10.097894 (+   430us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:10.097955 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:10.097980 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:20:10.098329 (+   349us) tablet.cc:701] Row locks acquired
0709 13:20:10.098347 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:20:10.098485 (+   138us) write_op.cc:270] Start()
0709 13:20:10.098596 (+   111us) write_op.cc:276] Timestamp: P: 1783603210098441 usec, L: 0
0709 13:20:10.098619 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:20:10.099190 (+   571us) log.cc:844] Serialized 982 byte log entry
0709 13:20:10.101233 (+  2043us) op_driver.cc:464] REPLICATION: finished
0709 13:20:10.101672 (+   439us) write_op.cc:301] APPLY: starting
0709 13:20:10.101754 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:10.103034 (+  1280us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:10.103130 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:10.104344 (+  1214us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:10.104491 (+   147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:20:10.104532 (+    41us) write_op.cc:312] APPLY: finished
0709 13:20:10.104726 (+   194us) log.cc:844] Serialized 33 byte log entry
0709 13:20:10.104872 (+   146us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:10.104950 (+    78us) write_op.cc:454] Released schema lock
0709 13:20:10.104988 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:10.105347 (+   359us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:10.105371 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87449,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":220,"apply.run_cpu_time_us":3623,"apply.run_wall_time_us":3624,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":152,"prepare.run_cpu_time_us":3144,"prepare.run_wall_time_us":58081,"replication_time_us":2482,"spinlock_wait_cycles":3840}]]}
I20260709 13:20:10.182191 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:10.245668 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:10.260541 22809 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:10.267055 18199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:10.269443 17495 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:10.271667 22809 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:10.273706 17352 catalog_manager.cc:5697] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 9 to 13, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.276530 17352 catalog_manager.cc:5697] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 9 to 11, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 11 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.293442 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:10.295635 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:10.296548 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:10.305364 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:10.306931 22889 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:10.300524 22902 raft_consensus.cc:2955] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:10.318524 17525 raft_consensus.cc:2955] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:10.312382 17495 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:10.330276 22916 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:10.334306 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:10.342463 17351 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40498 (request call id 192) took 17012 ms (client timeout 15000 ms). Trace:
I20260709 13:20:10.343816 18194 raft_consensus.cc:2955] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:10.347118 17352 catalog_manager.cc:5697] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 9 to 12, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 12 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:10.343145 17351 rpcz_store.cc:269] 0709 13:19:53.337414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.343224 (+  5810us) service_pool.cc:224] Handling call
0709 13:20:10.342377 (+16999153us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:09.618215 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:09.618820 (+   605us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:09.618853 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:20:09.618872 (+    19us) tablet.cc:662] Decoding operations
0709 13:20:09.619470 (+   598us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:09.619703 (+   233us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:09.619734 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:20:09.620095 (+   361us) tablet.cc:701] Row locks acquired
0709 13:20:09.620115 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:20:09.620256 (+   141us) write_op.cc:270] Start()
0709 13:20:09.620359 (+   103us) write_op.cc:276] Timestamp: P: 1783603209620208 usec, L: 0
0709 13:20:09.620386 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:20:09.621056 (+   670us) log.cc:844] Serialized 1317 byte log entry
0709 13:20:09.681418 (+ 60362us) op_driver.cc:464] REPLICATION: finished
0709 13:20:09.864503 (+183085us) write_op.cc:301] APPLY: starting
0709 13:20:09.864595 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:09.866638 (+  2043us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:09.866742 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:09.868991 (+  2249us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:09.869267 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:20:09.869336 (+    69us) write_op.cc:312] APPLY: finished
0709 13:20:09.869638 (+   302us) log.cc:844] Serialized 41 byte log entry
0709 13:20:09.921055 (+ 51417us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:09.921163 (+   108us) write_op.cc:454] Released schema lock
0709 13:20:09.921204 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:09.972581 (+ 51377us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:09.973229 (+   648us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17443,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":182782,"apply.run_cpu_time_us":6121,"apply.run_wall_time_us":83977,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16673,"num_ops":3,"prepare.queue_time_us":245167,"prepare.run_cpu_time_us":3144,"prepare.run_wall_time_us":3143,"replication_time_us":60863,"thread_start_us":351916,"threads_started":2}]]}
W20260709 13:20:10.358839 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 292342us
I20260709 13:20:10.349355 17352 catalog_manager.cc:5697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 10 to 14, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 14 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.416963 17448 raft_consensus.cc:2955] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:10.456281 17351 catalog_manager.cc:5697] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 8 to 10, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 10 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.536979 17597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:10.537644 17597 raft_consensus.cc:606] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:10.537477 17350 catalog_manager.cc:5697] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.539121 17350 catalog_manager.cc:5697] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 13 to 17, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 17 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.540462 17597 raft_consensus.cc:614] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:10.541437 17350 catalog_manager.cc:5697] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 11 to 13, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.544631 17603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:10.550634 17603 raft_consensus.cc:606] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:10.553551 17603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:10.554242 17603 raft_consensus.cc:606] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:10.554590 17603 raft_consensus.cc:614] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:10.557512 17603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dac17c6792414180963986e500f47356"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:10.558229 17603 raft_consensus.cc:606] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:10.558636 17603 raft_consensus.cc:614] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:10.560024 17352 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40508 (request call id 189) took 15572 ms (client timeout 15000 ms). Trace:
I20260709 13:20:10.562431 17603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c40484b7a540a9b32947573409178a"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:10.563136 17603 raft_consensus.cc:606] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:10.552769 17350 catalog_manager.cc:5697] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 11 to 14, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 14 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.564817 17350 catalog_manager.cc:5697] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 14 to 15, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 15 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.566229 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:10.569375 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:10.570696 17350 catalog_manager.cc:5697] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 11 to 14, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
W20260709 13:20:10.560712 17352 rpcz_store.cc:269] 0709 13:19:54.987196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.990154 (+  2958us) service_pool.cc:224] Handling call
0709 13:20:10.546712 (+15556558us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:10.395038 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:10.395591 (+   553us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:10.395641 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:20:10.395658 (+    17us) tablet.cc:662] Decoding operations
0709 13:20:10.396246 (+   588us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:10.396304 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:10.396337 (+    33us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:20:10.396735 (+   398us) tablet.cc:701] Row locks acquired
0709 13:20:10.396757 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:20:10.396899 (+   142us) write_op.cc:270] Start()
0709 13:20:10.397019 (+   120us) write_op.cc:276] Timestamp: P: 1783603210396853 usec, L: 0
0709 13:20:10.397045 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:20:10.398361 (+  1316us) log.cc:844] Serialized 1706 byte log entry
0709 13:20:10.406437 (+  8076us) op_driver.cc:464] REPLICATION: finished
0709 13:20:10.406890 (+   453us) write_op.cc:301] APPLY: starting
0709 13:20:10.406972 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:10.409484 (+  2512us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:10.409619 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:10.431732 (+ 22113us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:10.431918 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:20:10.431964 (+    46us) write_op.cc:312] APPLY: finished
0709 13:20:10.432214 (+   250us) log.cc:844] Serialized 49 byte log entry
0709 13:20:10.439468 (+  7254us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:10.439590 (+   122us) write_op.cc:454] Released schema lock
0709 13:20:10.439640 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:10.440008 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:10.440036 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":254,"apply.run_cpu_time_us":7196,"apply.run_wall_time_us":33065,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16728,"num_ops":4,"prepare.queue_time_us":871,"prepare.run_cpu_time_us":3066,"prepare.run_wall_time_us":3623,"replication_time_us":9233}]]}
I20260709 13:20:10.572547 17350 catalog_manager.cc:5697] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.577191 17350 catalog_manager.cc:5697] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.580538 17350 catalog_manager.cc:5697] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 11 to 14, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.582122 17350 catalog_manager.cc:5697] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 12 to 16, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 16 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.583611 17350 catalog_manager.cc:5697] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.585381 17350 catalog_manager.cc:5697] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 12 to 14, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.587531 17350 catalog_manager.cc:5697] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 10 to 12, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 12 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.589033 17350 catalog_manager.cc:5697] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 12 to 13, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.594496 17350 catalog_manager.cc:5697] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 13 to 16, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 16 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.596473 17350 catalog_manager.cc:5697] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } }
I20260709 13:20:10.598112 17350 catalog_manager.cc:5697] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 12 to 16, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 16 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.600083 17350 catalog_manager.cc:5697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.601399 17350 catalog_manager.cc:5697] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 11 to 12, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 12 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.603277 17350 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.604959 17350 catalog_manager.cc:5697] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.606910 17350 catalog_manager.cc:5697] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 12 to 13, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.609561 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet 2edee9f2356c4e878f2e11af63e46ab9 with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:37162
I20260709 13:20:10.608551 17350 catalog_manager.cc:5697] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.629805 17350 catalog_manager.cc:5697] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 12 to 14, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.637269 22925 tablet_replica.cc:333] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:10.633673 17350 catalog_manager.cc:5697] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 12 to 17, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 17 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.638586 17350 catalog_manager.cc:5697] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.649160 17350 catalog_manager.cc:5697] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 5 to 13, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.638516 22925 raft_consensus.cc:2243] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.654363 22925 raft_consensus.cc:2272] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.650799 17350 catalog_manager.cc:5697] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 13 to 15, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 15 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.655143 22902 raft_consensus.cc:993] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: : Instructing follower 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:10.656930 22902 raft_consensus.cc:1081] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Signalling peer 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:10.657073 17350 catalog_manager.cc:5697] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 9 to 12, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 12 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:10.663650 17448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1c40484b7a540a9b32947573409178a"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:20:10.671120 17448 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:10.677078 17448 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.674501 22925 ts_tablet_manager.cc:1916] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:10.725193 17448 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:10.743237 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:10.743942 17525 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.748322 17448 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:10.754117 17525 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:10.754937 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:10.755431 17419 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:10.755559 17603 raft_consensus.cc:3055] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:10.756781 17603 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:10.757546 17603 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:10.762820 17603 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.759851 22844 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:10.778005 22844 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:10.778939 22844 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:10.801714 17603 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 14.
I20260709 13:20:10.817916 22925 ts_tablet_manager.cc:1929] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 13:20:10.823848 22925 log.cc:1199] T 2edee9f2356c4e878f2e11af63e46ab9 P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/2edee9f2356c4e878f2e11af63e46ab9
I20260709 13:20:10.824416 22869 raft_consensus.cc:993] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: : Instructing follower ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:10.825925 22869 raft_consensus.cc:1081] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Signalling peer ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:10.827894 17521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:54548
I20260709 13:20:10.828496 17521 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:10.828851 17521 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.836863 17521 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:10.840184 17521 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:10.840824 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:10.841493 17603 raft_consensus.cc:3055] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:10.841862 17603 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:10.842231 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:10.842985 17451 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.842805 17603 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:10.844203 17603 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.840682 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet 2edee9f2356c4e878f2e11af63e46ab9 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:10.853606 17451 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:20:10.857599 17495 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:10.859277 22916 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:10.859889 22916 raft_consensus.cc:697] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:10.860831 22916 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:10.860858 17603 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:20:10.912158 17351 catalog_manager.cc:5697] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:10.969136 17350 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40498 (request call id 193) took 2607 ms. Trace:
I20260709 13:20:10.971233 17348 catalog_manager.cc:5697] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 11 to 14, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:10.969601 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet 2edee9f2356c4e878f2e11af63e46ab9 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:37162
I20260709 13:20:10.969841 17350 rpcz_store.cc:276] 0709 13:20:08.361989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.362227 (+   238us) service_pool.cc:224] Handling call
0709 13:20:10.969059 (+2606832us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:10.675704 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:10.676252 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:10.676293 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:20:10.676308 (+    15us) tablet.cc:662] Decoding operations
0709 13:20:10.682459 (+  6151us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:10.682512 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:10.682540 (+    28us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:20:10.685284 (+  2744us) tablet.cc:701] Row locks acquired
0709 13:20:10.685305 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:20:10.685448 (+   143us) write_op.cc:270] Start()
0709 13:20:10.685572 (+   124us) write_op.cc:276] Timestamp: P: 1783603210685405 usec, L: 0
0709 13:20:10.685591 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:20:10.687005 (+  1414us) log.cc:844] Serialized 11398 byte log entry
0709 13:20:10.690805 (+  3800us) op_driver.cc:464] REPLICATION: finished
0709 13:20:10.691736 (+   931us) write_op.cc:301] APPLY: starting
0709 13:20:10.691825 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:10.721616 (+ 29791us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:10.721717 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:10.821294 (+ 99577us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:10.821659 (+   365us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:20:10.821708 (+    49us) write_op.cc:312] APPLY: finished
0709 13:20:10.899322 (+ 77614us) log.cc:844] Serialized 252 byte log entry
0709 13:20:10.899496 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:10.899728 (+   232us) write_op.cc:454] Released schema lock
0709 13:20:10.899798 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:10.918094 (+ 18296us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:10.921234 (+  3140us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":60641,"reported_tablets":54,"spinlock_wait_cycles":23808,"child_traces":[["op",{"apply.queue_time_us":727,"apply.run_cpu_time_us":35866,"apply.run_wall_time_us":217484,"cfile_cache_hit":116,"cfile_cache_hit_bytes":121278,"num_ops":29,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":6696,"prepare.run_wall_time_us":11617,"replication_time_us":5074,"spinlock_wait_cycles":1920}]]}
I20260709 13:20:10.982191 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet 2edee9f2356c4e878f2e11af63e46ab9 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:10.986599 17348 catalog_manager.cc:5697] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 8 to 9, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 9 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.058441 17350 catalog_manager.cc:5697] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 14 to 15, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 15 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:11.060348 17350 catalog_manager.cc:5697] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 12 to 13, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 13 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.214977 17348 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40488 (request call id 194) took 2258 ms. Trace:
I20260709 13:20:11.215523 17348 rpcz_store.cc:276] 0709 13:20:08.960044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.966422 (+  6378us) service_pool.cc:224] Handling call
0709 13:20:11.214908 (+2248486us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:11.023170 (+     0us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b540001b728. stack: 00007f5ab2a47343 00007f5ab2a47240 00007f5ab23d61d4 00007f5abc114304 00007f5abc114299 00007f5abbf229e1 00007f5abbf2164c 00007f5ab95b0adc 00007f5ab959c0a6 00007f5ab959bd58 00007f5ab95a09f1 00007f5ab95a09a9 00007f5ab95a0939 00007f5ab95a0901 00007f5ab959fb2d 000000000038f354
0709 13:20:11.023257 (+    87us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:11.023782 (+   525us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:11.023818 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:20:11.023840 (+    22us) tablet.cc:662] Decoding operations
0709 13:20:11.024239 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:11.024289 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:11.024318 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:20:11.026358 (+  2040us) tablet.cc:701] Row locks acquired
0709 13:20:11.026379 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:20:11.026636 (+   257us) write_op.cc:270] Start()
0709 13:20:11.026906 (+   270us) write_op.cc:276] Timestamp: P: 1783603211026571 usec, L: 0
0709 13:20:11.026930 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:20:11.027727 (+   797us) log.cc:844] Serialized 929 byte log entry
0709 13:20:11.029816 (+  2089us) op_driver.cc:464] REPLICATION: finished
0709 13:20:11.030209 (+   393us) write_op.cc:301] APPLY: starting
0709 13:20:11.030305 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:11.031746 (+  1441us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:11.031772 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:11.033289 (+  1517us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:11.033491 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:20:11.033550 (+    59us) write_op.cc:312] APPLY: finished
0709 13:20:11.033798 (+   248us) log.cc:844] Serialized 33 byte log entry
0709 13:20:11.035391 (+  1593us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:11.035506 (+   115us) write_op.cc:454] Released schema lock
0709 13:20:11.035549 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:11.036017 (+   468us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:11.036050 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30764,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":174,"apply.run_cpu_time_us":4414,"apply.run_wall_time_us":5753,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":5699,"prepare.run_wall_time_us":12909,"replication_time_us":2752,"spinlock_wait_cycles":3059072}]]}
I20260709 13:20:11.283252 17348 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 13 to 14, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:11.366199 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 64257.8us
I20260709 13:20:11.405095 17523 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:11.414295 17597 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:11.464547 17597 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:11.477370 22916 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:20:11.491199 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 53659.4us
I20260709 13:20:11.495452 22842 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:20:11.517231 17603 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:11.570586 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:11.597301 22942 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:20:11.602730 17448 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:11.577817 22842 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:20:11.611249 18199 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:20:11.616226 22944 log.cc:927] Time spent T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.057s	user 0.004s	sys 0.000s
I20260709 13:20:11.630117 22930 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:20:11.682715 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 55877.9us
I20260709 13:20:11.687438 17448 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:11.708817 22398 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:11.715407 22902 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:11.746277 22398 raft_consensus.cc:2955] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:11.749553 17448 raft_consensus.cc:2955] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:11.768154 18199 raft_consensus.cc:2955] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:11.772260 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7398c91e7a884284a8b806d47551eaf7 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:11.845530 17352 catalog_manager.cc:5697] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 12 to 13, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 17 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:11.924475 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet 7398c91e7a884284a8b806d47551eaf7 with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:37162
I20260709 13:20:11.964422 22957 tablet_replica.cc:333] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:11.965601 22957 raft_consensus.cc:2243] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:11.966491 22957 raft_consensus.cc:2272] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:11.970003 22957 ts_tablet_manager.cc:1916] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:11.989776 22957 ts_tablet_manager.cc:1929] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 13:20:11.990324 22957 log.cc:1199] T 7398c91e7a884284a8b806d47551eaf7 P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/7398c91e7a884284a8b806d47551eaf7
I20260709 13:20:11.994294 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet 7398c91e7a884284a8b806d47551eaf7 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:12.965042 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:13.183116 17446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c6864e5b711423291c531e98224c311"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:20:13.184270 17446 raft_consensus.cc:606] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:13.191293 17446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:20:13.191942 17446 raft_consensus.cc:606] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:13.195891 17448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "347905859bee416fb447f19528527f52"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:20:13.196444 17448 raft_consensus.cc:606] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:13.199316 17448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:20:13.200099 17448 raft_consensus.cc:606] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:13.203274 17448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:20:13.203833 17448 raft_consensus.cc:606] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:13.210615 17594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:13.211285 17594 raft_consensus.cc:606] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:13.217754 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:13.219583 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:13.240424 22960 raft_consensus.cc:993] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: : Instructing follower ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:13.241011 22960 raft_consensus.cc:1081] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Signalling peer ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:13.250512 22941 raft_consensus.cc:993] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: : Instructing follower ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:13.251252 22941 raft_consensus.cc:1081] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Signalling peer ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:13.261345 17525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:54544
I20260709 13:20:13.262578 17525 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.263077 17525 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.265760 17521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:54544
I20260709 13:20:13.266387 17521 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.266724 17521 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.274678 22966 raft_consensus.cc:993] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: : Instructing follower ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:13.275481 22936 raft_consensus.cc:1081] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Signalling peer ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:13.277602 17523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:54544
I20260709 13:20:13.278179 17523 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.278524 17523 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.296489 17523 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.303367 17525 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.307608 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:13.308775 17448 raft_consensus.cc:3055] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:13.308991 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:13.309147 17448 raft_consensus.cc:740] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:13.309823 17597 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.310535 17448 consensus_queue.cc:260] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.312440 17448 raft_consensus.cc:3060] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.318162 17523 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:13.317903 17597 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:20:13.323243 17527 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:13.325882 17495 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:13.327217 22809 raft_consensus.cc:2804] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:13.327914 22809 raft_consensus.cc:697] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:13.329046 22809 consensus_queue.cc:237] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:13.344520 17495 consensus_peers.cc:597] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be6cfcb1338b4398b769f6956792bdd7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.348507 17594 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:13.349145 17446 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:13.350703 22965 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:13.352909 22965 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:13.362581 17521 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.370975 17448 raft_consensus.cc:2468] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:20:13.371387 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:13.373486 17452 raft_consensus.cc:3055] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:13.373803 17452 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:13.374403 17525 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:13.379851 17452 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.381903 17452 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.387879 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:13.388653 17597 raft_consensus.cc:3060] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.394578 17521 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:13.395809 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:13.396415 17594 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.398705 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:13.399441 17448 raft_consensus.cc:3055] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:13.399847 17448 raft_consensus.cc:740] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:13.400832 17448 consensus_queue.cc:260] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.402302 17448 raft_consensus.cc:3060] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.403044 22965 raft_consensus.cc:2955] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:13.410547 17448 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:20:13.411255 17452 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:20:13.414901 17495 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:13.416436 17495 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:13.412163 17602 raft_consensus.cc:2955] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:13.421263 22916 raft_consensus.cc:2804] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:13.428411 22809 raft_consensus.cc:2804] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:13.449272 17594 raft_consensus.cc:2468] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:20:13.450662 22809 raft_consensus.cc:697] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:13.452082 22809 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.459594 17597 raft_consensus.cc:2468] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:20:13.465288 17352 catalog_manager.cc:5697] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 12 to 13, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 13 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.466984 22967 raft_consensus.cc:993] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: : Instructing follower ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:13.478972 22967 raft_consensus.cc:1081] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Signalling peer ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:13.481709 17521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "347905859bee416fb447f19528527f52"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:54544
I20260709 13:20:13.482503 17521 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.482955 17521 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.496898 17521 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.534914 17521 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:13.518087 22916 raft_consensus.cc:697] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:13.542016 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:13.541685 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:13.542764 17452 raft_consensus.cc:3055] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:13.542812 17597 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.543255 17452 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:13.547952 22916 consensus_queue.cc:237] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.558831 17452 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.560372 17452 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.569347 17347 catalog_manager.cc:5697] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 17 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:13.539034 17446 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:13.598368 17452 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:20:13.600553 17445 raft_consensus.cc:2955] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:13.605012 22966 raft_consensus.cc:993] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: : Instructing follower ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:13.605531 22966 raft_consensus.cc:1081] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Signalling peer ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:13.607867 17525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c6864e5b711423291c531e98224c311"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:54544
I20260709 13:20:13.608422 17525 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.608745 17525 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.617956 17495 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:13.619495 22809 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:13.620141 22809 raft_consensus.cc:697] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:13.619596 22972 raft_consensus.cc:993] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: : Instructing follower ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:13.622704 22972 raft_consensus.cc:1081] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Signalling peer ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:13.621284 22809 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.634864 17597 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:20:13.635422 17527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:54548
I20260709 13:20:13.636039 17527 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.636410 17527 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.637377 17525 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:20:13.652855 17525 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:13.654860 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:13.656023 17597 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.739341 17597 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 17.
I20260709 13:20:13.739461 17527 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.746415 17527 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:13.741196 17495 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:20:13.749856 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 106636us
I20260709 13:20:13.760233 17598 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:13.761361 22974 raft_consensus.cc:2804] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:13.762063 22974 raft_consensus.cc:697] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:13.763201 22974 consensus_queue.cc:237] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:20:13.768817 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:13.769893 17597 raft_consensus.cc:3055] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:13.770435 17597 raft_consensus.cc:740] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:13.771672 17597 consensus_queue.cc:260] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.776295 17597 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.788779 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:13.790511 17452 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:20:13.789286 17420 consensus_peers.cc:597] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf597fe63db446f38a58bcbc792dd49b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.792542 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:13.793084 17446 raft_consensus.cc:3055] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:13.793406 17446 raft_consensus.cc:740] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:13.794714 17445 raft_consensus.cc:3060] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.801386 22967 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:13.814567 17446 consensus_queue.cc:260] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:20:13.816143 17446 raft_consensus.cc:3060] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.822005 17445 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:20:13.823525 22809 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:13.827133 17495 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:13.818799 17597 raft_consensus.cc:2468] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:20:13.832295 22809 raft_consensus.cc:2804] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:13.833905 22809 raft_consensus.cc:697] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:13.834829 22809 consensus_queue.cc:237] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:13.854786 17446 raft_consensus.cc:2468] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 17.
I20260709 13:20:13.855453 17521 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:13.882140 17597 raft_consensus.cc:1275] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:13.886894 22809 consensus_queue.cc:1048] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:13.887673 17597 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:13.895576 22975 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:13.897529 17446 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:13.894047 22941 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:20:13.912230 22974 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:20:13.967867 22995 ts_tablet_manager.cc:933] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:13.983651 17594 raft_consensus.cc:2955] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:13.991595 17448 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:13.999485 22973 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:20:13.981791 22842 raft_consensus.cc:2955] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:14.018450 17602 raft_consensus.cc:1275] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:14.033234 22965 consensus_queue.cc:1048] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:14.063465 22996 log.cc:927] Time spent T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:20:14.100735 17521 raft_consensus.cc:2955] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:14.106523 22995 tablet_copy_client.cc:323] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:20:14.110953 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet be6cfcb1338b4398b769f6956792bdd7 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:20:14.111644 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet be6cfcb1338b4398b769f6956792bdd7 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-be6cfcb1338b4398b769f6956792bdd7
I20260709 13:20:14.155285 23008 ts_tablet_manager.cc:933] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
I20260709 13:20:14.169641 17539 tablet_copy_source_session.cc:215] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:14.208544 22995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6cfcb1338b4398b769f6956792bdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:14.244021 17594 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:14.253331 17452 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:14.265411 23011 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:14.274328 23008 tablet_copy_client.cc:323] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.65:36303
I20260709 13:20:14.275372 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:14.278667 17463 tablet_copy_service.cc:140] P 0480cf54c3cc424ab94b963ef2ff5bf4: Received BeginTabletCopySession request for tablet cf597fe63db446f38a58bcbc792dd49b from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:47864)
I20260709 13:20:14.279361 17463 tablet_copy_service.cc:161] P 0480cf54c3cc424ab94b963ef2ff5bf4: Beginning new tablet copy session on tablet cf597fe63db446f38a58bcbc792dd49b from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:47864: session id = 2158c0f750fd4b21afe24135c52167b2-cf597fe63db446f38a58bcbc792dd49b
I20260709 13:20:14.282379 17347 catalog_manager.cc:5697] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 13 to 14, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:14.285789 17347 catalog_manager.cc:5697] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 13 to 14, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } }
I20260709 13:20:14.289048 17347 catalog_manager.cc:5697] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:14.294025 17450 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:14.310832 23007 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:20:14.282783 17452 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:14.354722 23007 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:14.345141 17463 tablet_copy_source_session.cc:215] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:14.364735 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf597fe63db446f38a58bcbc792dd49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:14.367758 17596 raft_consensus.cc:1275] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:14.374119 22995 tablet_copy_client.cc:806] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:14.396474 17352 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 13 to 14, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:14.402200 22809 consensus_queue.cc:1048] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:14.417935 22995 tablet_copy_client.cc:670] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:14.399451 17352 catalog_manager.cc:5697] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 16 to 17, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 17 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:14.438982 17596 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:14.437341 17352 catalog_manager.cc:5697] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 11 to 12, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 12 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:14.449297 22809 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:14.457828 22995 tablet_copy_client.cc:538] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:14.468272 17521 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:14.470546 22984 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:14.474416 17594 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:20:14.482367 17420 consensus_peers.cc:597] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14b4916b36c24c9bb0562a70795b8ed1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.485989 22842 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:20:14.503472 22995 tablet_bootstrap.cc:492] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:14.513957 17450 raft_consensus.cc:1275] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:14.583395 22976 consensus_queue.cc:1048] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:20:14.587440 22986 raft_consensus.cc:2955] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:14.531874 23008 tablet_copy_client.cc:806] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:14.621539 23008 tablet_copy_client.cc:670] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:14.786141 23008 tablet_copy_client.cc:538] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:14.799280 17521 raft_consensus.cc:2955] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:14.815052 17594 raft_consensus.cc:2955] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:14.901738 17348 catalog_manager.cc:5697] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:14.903620 17597 consensus_queue.cc:237] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:20:14.975770 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 50075.7us
I20260709 13:20:14.976351 23008 tablet_bootstrap.cc:492] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:15.058015 23029 ts_tablet_manager.cc:933] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
W20260709 13:20:15.102186 17569 consensus_peers.cc:597] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b3434da716f41f0bc0eb393a53152ed. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:15.127298 17450 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:20:15.152482 23029 tablet_copy_client.cc:323] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.65:36303
I20260709 13:20:15.161427 22989 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
W20260709 13:20:15.172920 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 59247.5us
I20260709 13:20:15.180785 17524 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:20:15.196691 22972 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:15.259454 17463 tablet_copy_service.cc:140] P 0480cf54c3cc424ab94b963ef2ff5bf4: Received BeginTabletCopySession request for tablet 14b4916b36c24c9bb0562a70795b8ed1 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:47864)
I20260709 13:20:15.260138 17463 tablet_copy_service.cc:161] P 0480cf54c3cc424ab94b963ef2ff5bf4: Beginning new tablet copy session on tablet 14b4916b36c24c9bb0562a70795b8ed1 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:47864: session id = 2158c0f750fd4b21afe24135c52167b2-14b4916b36c24c9bb0562a70795b8ed1
W20260709 13:20:15.281287 22995 log.cc:927] Time spent T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.065s	user 0.003s	sys 0.000s
W20260709 13:20:15.306921 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 112202us
I20260709 13:20:15.301930 17463 tablet_copy_source_session.cc:215] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:15.328092 23029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b4916b36c24c9bb0562a70795b8ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:15.365942 22989 raft_consensus.cc:2955] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:15.367992 17451 raft_consensus.cc:2955] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:15.432847 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:15.444628 17347 catalog_manager.cc:5697] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 7, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 9 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:15.475521 17527 raft_consensus.cc:2955] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:15.541268 22995 tablet_bootstrap.cc:492] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:15.513744 23029 tablet_copy_client.cc:806] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:15.543905 23029 tablet_copy_client.cc:670] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:15.558717 23029 tablet_copy_client.cc:538] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:15.561839 22995 tablet_bootstrap.cc:492] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:15.563251 22995 ts_tablet_manager.cc:1403] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 1.060s	user 0.058s	sys 0.016s
I20260709 13:20:15.569535 22995 raft_consensus.cc:359] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:15.592406 23040 ts_tablet_manager.cc:933] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:15.597532 22995 raft_consensus.cc:740] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:15.601394 22995 consensus_queue.cc:260] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:15.609254 23029 tablet_bootstrap.cc:492] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:15.611773 22995 ts_tablet_manager.cc:1434] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.002s
I20260709 13:20:15.615974 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-be6cfcb1338b4398b769f6956792bdd7 received from {username='slave'} at 127.0.0.1:35586
I20260709 13:20:15.616523 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-be6cfcb1338b4398b769f6956792bdd7 on tablet be6cfcb1338b4398b769f6956792bdd7 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:15.641763 23040 tablet_copy_client.cc:323] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:20:15.646490 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet 6b3434da716f41f0bc0eb393a53152ed from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:20:15.647131 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet 6b3434da716f41f0bc0eb393a53152ed from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-6b3434da716f41f0bc0eb393a53152ed
I20260709 13:20:15.652838 23008 tablet_bootstrap.cc:492] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:15.654250 23008 tablet_bootstrap.cc:492] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:15.656912 23008 ts_tablet_manager.cc:1403] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.681s	user 0.070s	sys 0.013s
I20260709 13:20:15.713117 17613 tablet_copy_source_session.cc:215] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:15.745316 23040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3434da716f41f0bc0eb393a53152ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:15.747439 23008 raft_consensus.cc:359] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:15.760965 23008 raft_consensus.cc:740] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:15.763449 23008 consensus_queue.cc:260] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:15.788623 23008 ts_tablet_manager.cc:1434] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.130s	user 0.005s	sys 0.002s
I20260709 13:20:15.789898 17446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:20:15.793327 17446 raft_consensus.cc:606] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:15.796162 17463 tablet_copy_service.cc:342] P 0480cf54c3cc424ab94b963ef2ff5bf4: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-cf597fe63db446f38a58bcbc792dd49b received from {username='slave'} at 127.0.0.1:47864
I20260709 13:20:15.796715 17463 tablet_copy_service.cc:434] P 0480cf54c3cc424ab94b963ef2ff5bf4: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-cf597fe63db446f38a58bcbc792dd49b on tablet cf597fe63db446f38a58bcbc792dd49b with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:15.823405 17597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:15.824048 17597 raft_consensus.cc:606] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:15.826848 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:15.828585 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:15.841615 23040 tablet_copy_client.cc:806] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:15.858777 23040 tablet_copy_client.cc:670] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:15.865845 23040 tablet_copy_client.cc:538] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:15.877650 23040 tablet_bootstrap.cc:492] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:15.883188 23031 raft_consensus.cc:993] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: : Instructing follower 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:15.883783 23031 raft_consensus.cc:1081] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Signalling peer 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:15.889438 17451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:20:15.890061 17451 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.890436 17451 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:15.890853 22987 raft_consensus.cc:993] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: : Instructing follower ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:15.891366 22987 raft_consensus.cc:1081] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Signalling peer ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:15.893158 17527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:54544
I20260709 13:20:15.893687 17527 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.894361 17527 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:15.901209 17451 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:15.903622 17527 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:15.920048 17451 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 18 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:15.921018 17527 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:15.914292 17446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:15.922242 17446 raft_consensus.cc:3055] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:15.922657 17446 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:15.927094 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:15.940594 17596 raft_consensus.cc:3055] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:15.940974 17596 raft_consensus.cc:740] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:15.941834 17446 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:15.950726 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:15.951439 18194 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:15.958056 17594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:15.958811 17594 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:15.968950 17446 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:15.972754 17596 consensus_queue.cc:260] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:15.984315 17596 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:15.986255 18194 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 18.
I20260709 13:20:15.996111 17446 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:20:16.005338 17594 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
I20260709 13:20:16.011281 17420 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2; no voters: 
I20260709 13:20:16.012367 23044 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:16.012612 18199 raft_consensus.cc:1217] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 13:20:16.013072 23044 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 18 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:16.014599 23044 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:16.058295 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 57329.2us
I20260709 13:20:16.059145 17495 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:16.060039 23047 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:16.060626 23047 raft_consensus.cc:697] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:16.061602 23047 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:16.121997 18199 raft_consensus.cc:1217] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:20:16.209777 23029 tablet_bootstrap.cc:492] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:16.211067 23029 tablet_bootstrap.cc:492] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:16.228152 17348 catalog_manager.cc:5697] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 17 to 18, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 18 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.242048 23029 ts_tablet_manager.cc:1403] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.633s	user 0.050s	sys 0.018s
I20260709 13:20:16.252687 17351 catalog_manager.cc:5697] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 13 to 14, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.283620 23029 raft_consensus.cc:359] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:16.284740 23029 raft_consensus.cc:740] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:16.288097 23029 consensus_queue.cc:260] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:20:16.295208 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 57064.5us
I20260709 13:20:16.306143 17596 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 18.
I20260709 13:20:16.322961 23029 ts_tablet_manager.cc:1434] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 13:20:16.328166 17463 tablet_copy_service.cc:342] P 0480cf54c3cc424ab94b963ef2ff5bf4: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-14b4916b36c24c9bb0562a70795b8ed1 received from {username='slave'} at 127.0.0.1:47864
I20260709 13:20:16.328629 17463 tablet_copy_service.cc:434] P 0480cf54c3cc424ab94b963ef2ff5bf4: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-14b4916b36c24c9bb0562a70795b8ed1 on tablet 14b4916b36c24c9bb0562a70795b8ed1 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:16.383914 23040 tablet_bootstrap.cc:492] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:16.386919 23040 tablet_bootstrap.cc:492] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:16.387866 23040 ts_tablet_manager.cc:1403] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.511s	user 0.039s	sys 0.019s
I20260709 13:20:16.391109 23040 raft_consensus.cc:359] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:16.392047 23040 raft_consensus.cc:740] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:16.393007 23040 consensus_queue.cc:260] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:16.397383 23040 ts_tablet_manager.cc:1434] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:20:16.403937 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-6b3434da716f41f0bc0eb393a53152ed received from {username='slave'} at 127.0.0.1:52572
I20260709 13:20:16.404458 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-6b3434da716f41f0bc0eb393a53152ed on tablet 6b3434da716f41f0bc0eb393a53152ed with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:16.466113 22986 raft_consensus.cc:1064] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:16.469103 22986 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:16.489411 18194 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:16.490911 17528 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:16.492493 17597 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:16.492534 22986 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:20:16.498807 22967 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:16.500262 22987 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:16.536680 17594 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:16.538256 22987 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:16.557873 23007 raft_consensus.cc:1064] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:16.560534 23007 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:16.587769 22987 raft_consensus.cc:2955] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:16.598682 18199 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:16.604266 22967 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:16.604880 18199 raft_consensus.cc:2955] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:16.588836 17596 raft_consensus.cc:2955] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:16.641546 18198 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:16.642870 17594 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:16.644430 23011 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:16.661346 17524 raft_consensus.cc:2955] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:16.671224 18194 raft_consensus.cc:1217] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:20:16.691272 17446 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:16.696790 17348 catalog_manager.cc:5697] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.701434 23047 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:16.703209 17594 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:16.708693 17451 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:16.722195 23049 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:16.722558 23047 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:16.726305 17451 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:16.742729 23007 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:20:16.781239 18199 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:16.792430 22967 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:16.820873 17528 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:16.830623 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:16.835686 23074 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:16.839882 18199 raft_consensus.cc:2955] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:16.839995 23045 raft_consensus.cc:2955] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:16.862794 17524 raft_consensus.cc:2955] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:16.890755 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 138701us
I20260709 13:20:16.950775 18199 raft_consensus.cc:1217] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:20:16.951526 17351 catalog_manager.cc:5697] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.018668 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf597fe63db446f38a58bcbc792dd49b with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:17.038116 23007 raft_consensus.cc:2955] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:17.063138 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 96687.1us
I20260709 13:20:17.137528 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet cf597fe63db446f38a58bcbc792dd49b with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:56906
W20260709 13:20:17.151831 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 222341us
I20260709 13:20:17.171566 18199 raft_consensus.cc:2955] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.194926 17600 raft_consensus.cc:2955] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.261322 17348 catalog_manager.cc:5697] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.269142 23031 raft_consensus.cc:1064] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:17.272176 23031 consensus_queue.cc:237] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:17.291879 17451 raft_consensus.cc:2955] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.293591 23094 tablet_replica.cc:333] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:20:17.315424 22967 raft_consensus.cc:1064] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:17.320806 22967 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:17.370443 18199 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:17.376854 22986 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:17.384682 18199 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:20:17.387168 17451 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:20:17.388236 17523 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:20:17.390187 23081 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:20:17.397693 23032 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:17.400242 23094 raft_consensus.cc:2243] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.401132 23094 raft_consensus.cc:2272] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.404954 23081 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:17.410959 17521 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:17.412703 17600 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:17.417593 23045 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:20:17.428201 23045 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:20:17.446262 23094 ts_tablet_manager.cc:1916] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:17.456732 23044 raft_consensus.cc:2955] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.463249 17521 consensus_queue.cc:237] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:17.477196 18194 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:17.482856 23011 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:17.488796 17450 raft_consensus.cc:1275] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:17.495374 23049 consensus_queue.cc:1048] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:17.498008 17600 raft_consensus.cc:2955] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.521081 23088 raft_consensus.cc:2955] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.532258 18196 raft_consensus.cc:2955] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.548049 18194 raft_consensus.cc:2955] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.566762 23053 raft_consensus.cc:2955] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.568504 17451 raft_consensus.cc:2955] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.582913 17452 raft_consensus.cc:2955] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.583221 17523 raft_consensus.cc:2955] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.610816 18194 raft_consensus.cc:2955] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.593632 17352 catalog_manager.cc:5697] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.630977 17521 raft_consensus.cc:2955] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.640638 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet be6cfcb1338b4398b769f6956792bdd7 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:17.655902 17351 catalog_manager.cc:5697] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index 7 to 8, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.669548 23094 ts_tablet_manager.cc:1929] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 13:20:17.670189 23094 log.cc:1199] T cf597fe63db446f38a58bcbc792dd49b P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/cf597fe63db446f38a58bcbc792dd49b
I20260709 13:20:17.672070 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet cf597fe63db446f38a58bcbc792dd49b (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:17.665272 17451 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:17.665134 17348 catalog_manager.cc:5697] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 17 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.730016 18194 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:17.734050 23044 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:20:17.747146 17600 consensus_queue.cc:237] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:17.753696 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet be6cfcb1338b4398b769f6956792bdd7 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:56906
I20260709 13:20:17.754550 17523 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:17.754779 23094 tablet_replica.cc:333] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:20:17.759285 23080 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:20:17.761806 23094 raft_consensus.cc:2243] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.777985 23074 raft_consensus.cc:2955] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.779762 23094 raft_consensus.cc:2272] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.782335 18194 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:17.789004 23053 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:20:17.789137 18194 raft_consensus.cc:2955] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.798688 17450 raft_consensus.cc:1275] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:17.815915 23094 ts_tablet_manager.cc:1916] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:17.819974 23031 consensus_queue.cc:1048] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:17.815435 17524 raft_consensus.cc:2955] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.836887 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 14b4916b36c24c9bb0562a70795b8ed1 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:17.852082 17352 catalog_manager.cc:5697] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 11 to 12, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.854485 23107 raft_consensus.cc:2955] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.859663 18196 raft_consensus.cc:2955] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.870754 17452 raft_consensus.cc:2955] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.897851 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet 14b4916b36c24c9bb0562a70795b8ed1 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:56906
I20260709 13:20:17.907908 17352 catalog_manager.cc:5697] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 8 to 9, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 9 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:17.918398 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:17.923269 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b3434da716f41f0bc0eb393a53152ed with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:17.946857 23094 ts_tablet_manager.cc:1929] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 13:20:17.947446 23094 log.cc:1199] T be6cfcb1338b4398b769f6956792bdd7 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/be6cfcb1338b4398b769f6956792bdd7
I20260709 13:20:17.948246 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b3434da716f41f0bc0eb393a53152ed with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37162
I20260709 13:20:17.949980 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet be6cfcb1338b4398b769f6956792bdd7 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:17.949981 23094 tablet_replica.cc:333] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:20:17.956200 23094 raft_consensus.cc:2243] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.957623 23094 raft_consensus.cc:2272] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.980736 23094 ts_tablet_manager.cc:1916] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:17.995839 23108 tablet_replica.cc:333] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:18.014120 23108 raft_consensus.cc:2243] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.015293 23108 raft_consensus.cc:2272] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.068252 23108 ts_tablet_manager.cc:1916] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:18.070451 23094 ts_tablet_manager.cc:1929] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:20:18.071158 23094 log.cc:1199] T 14b4916b36c24c9bb0562a70795b8ed1 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/14b4916b36c24c9bb0562a70795b8ed1
I20260709 13:20:18.078533 17451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:20:18.079208 17451 raft_consensus.cc:606] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:18.079782 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet 14b4916b36c24c9bb0562a70795b8ed1 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:18.080766 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:18.082541 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:18.120560 23108 ts_tablet_manager.cc:1929] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:20:18.121218 23108 log.cc:1199] T 6b3434da716f41f0bc0eb393a53152ed P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/6b3434da716f41f0bc0eb393a53152ed
I20260709 13:20:18.125142 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet 6b3434da716f41f0bc0eb393a53152ed (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:18.213658 23045 raft_consensus.cc:993] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4: : Instructing follower abf46e430b7e4ad4919ca2a717f37e0e to start an election
I20260709 13:20:18.214259 23045 raft_consensus.cc:1081] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Signalling peer abf46e430b7e4ad4919ca2a717f37e0e to start an election
I20260709 13:20:18.218092 17600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:49566
I20260709 13:20:18.218626 17600 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:18.218935 17600 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.229871 17600 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:18.232486 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:18.233106 17451 raft_consensus.cc:3055] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:18.233384 17451 raft_consensus.cc:740] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:18.234122 17451 consensus_queue.cc:260] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:18.235558 17451 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.268132 17600 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:18.269644 17451 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:20:18.274530 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:18.275080 17524 raft_consensus.cc:3060] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.270787 17569 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:18.278683 23031 raft_consensus.cc:2804] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:18.279242 23031 raft_consensus.cc:697] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:18.280215 23031 consensus_queue.cc:237] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:18.292824 17524 raft_consensus.cc:2468] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 10.
I20260709 13:20:18.329183 17351 catalog_manager.cc:5697] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 9 to 10, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 10 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:18.667833 17452 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:20:18.669441 23031 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:18.719497 17524 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:20:18.720983 23031 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:20:18.999632 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 93395.7us
I20260709 13:20:19.084913 17596 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:19.086297 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:19.129333 17569 consensus_peers.cc:597] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da520cc299d940b68e5655cd8094d48e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.135046 17452 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:19.136920 23053 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:19.140846 17523 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:19.146654 23075 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:19.242915 23075 raft_consensus.cc:2955] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.250655 17523 raft_consensus.cc:2955] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.260663 17451 raft_consensus.cc:2955] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.283249 17348 catalog_manager.cc:5697] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 7, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 12 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.312345 17446 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:19.360046 17598 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:20:19.370661 17420 consensus_peers.cc:597] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0843b162ea34017b0c1243e97245db9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.375594 17523 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:19.377097 23115 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:19.380879 23080 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:19.451331 23080 raft_consensus.cc:2955] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.474687 17521 raft_consensus.cc:2955] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.476253 17523 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:19.481509 17347 catalog_manager.cc:5697] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 17 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:19.498802 17598 raft_consensus.cc:2955] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:20:19.567077 17495 consensus_peers.cc:597] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2773182c45284396b8fd0513eb349cc4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.572208 17596 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:19.586182 23126 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:19.596527 17446 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:19.600497 23126 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:19.626184 17598 raft_consensus.cc:2955] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index -1 to 12, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.621328 23122 raft_consensus.cc:2955] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index -1 to 12, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.626361 17451 raft_consensus.cc:2955] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index -1 to 12, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.662480 17347 catalog_manager.cc:5697] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 12, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.684091 17452 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:19.714588 23139 ts_tablet_manager.cc:933] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:19.755288 23139 tablet_copy_client.cc:323] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:20:19.771713 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet da520cc299d940b68e5655cd8094d48e from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:20:19.772400 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet da520cc299d940b68e5655cd8094d48e from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-da520cc299d940b68e5655cd8094d48e
I20260709 13:20:19.787202 17598 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:19.787621 17523 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:20:19.788580 17420 consensus_peers.cc:597] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bea493621f1e42c2b8689859233cc798. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.789179 23115 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:19.792361 23080 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:19.792842 17613 tablet_copy_source_session.cc:215] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:19.818846 23139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da520cc299d940b68e5655cd8094d48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:19.845566 23123 raft_consensus.cc:2955] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.853632 17600 raft_consensus.cc:2955] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.858081 17527 raft_consensus.cc:2955] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.864046 23139 tablet_copy_client.cc:806] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:19.865278 23139 tablet_copy_client.cc:670] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:19.880234 17351 catalog_manager.cc:5697] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:19.891355 23139 tablet_copy_client.cc:538] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:19.904270 23139 tablet_bootstrap.cc:492] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:19.930984 23145 ts_tablet_manager.cc:933] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
I20260709 13:20:19.957228 23145 tablet_copy_client.cc:323] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.65:36303
I20260709 13:20:19.964579 17463 tablet_copy_service.cc:140] P 0480cf54c3cc424ab94b963ef2ff5bf4: Received BeginTabletCopySession request for tablet d0843b162ea34017b0c1243e97245db9 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:47864)
I20260709 13:20:19.965437 17463 tablet_copy_service.cc:161] P 0480cf54c3cc424ab94b963ef2ff5bf4: Beginning new tablet copy session on tablet d0843b162ea34017b0c1243e97245db9 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:47864: session id = 2158c0f750fd4b21afe24135c52167b2-d0843b162ea34017b0c1243e97245db9
I20260709 13:20:19.975018 17463 tablet_copy_source_session.cc:215] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:20.003305 23148 ts_tablet_manager.cc:933] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:20.017906 23145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0843b162ea34017b0c1243e97245db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.019121 23139 tablet_bootstrap.cc:492] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:20.020220 23139 tablet_bootstrap.cc:492] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:20.020978 23139 ts_tablet_manager.cc:1403] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.117s	user 0.024s	sys 0.014s
I20260709 13:20:20.023844 23148 tablet_copy_client.cc:323] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:20:20.025610 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet 2773182c45284396b8fd0513eb349cc4 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:20:20.026176 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet 2773182c45284396b8fd0513eb349cc4 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-2773182c45284396b8fd0513eb349cc4
I20260709 13:20:20.034174 17539 tablet_copy_source_session.cc:215] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:20.042595 23139 raft_consensus.cc:359] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:20.043622 23139 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:20.044417 23139 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:20.047072 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2773182c45284396b8fd0513eb349cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.047289 23139 ts_tablet_manager.cc:1434] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:20:20.065851 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-da520cc299d940b68e5655cd8094d48e received from {username='slave'} at 127.0.0.1:52572
I20260709 13:20:20.066396 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-da520cc299d940b68e5655cd8094d48e on tablet da520cc299d940b68e5655cd8094d48e with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:20.122802 23145 tablet_copy_client.cc:806] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:20.123544 23145 tablet_copy_client.cc:670] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:20.143510 23145 tablet_copy_client.cc:538] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:20.154978 18196 raft_consensus.cc:1217] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.6->[12.7-12.7]   Dedup: 12.7->[]
I20260709 13:20:20.162135 23148 tablet_copy_client.cc:806] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:20.162930 23148 tablet_copy_client.cc:670] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:20.178138 23148 tablet_copy_client.cc:538] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:20.184778 23145 tablet_bootstrap.cc:492] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:20.207213 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:20.232645 23148 tablet_bootstrap.cc:492] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:20.281993 23139 ts_tablet_manager.cc:933] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
I20260709 13:20:20.298393 23139 tablet_copy_client.cc:323] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.65:36303
I20260709 13:20:20.314743 17463 tablet_copy_service.cc:140] P 0480cf54c3cc424ab94b963ef2ff5bf4: Received BeginTabletCopySession request for tablet bea493621f1e42c2b8689859233cc798 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:47864)
I20260709 13:20:20.315367 17463 tablet_copy_service.cc:161] P 0480cf54c3cc424ab94b963ef2ff5bf4: Beginning new tablet copy session on tablet bea493621f1e42c2b8689859233cc798 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:47864: session id = 2158c0f750fd4b21afe24135c52167b2-bea493621f1e42c2b8689859233cc798
I20260709 13:20:20.334919 17463 tablet_copy_source_session.cc:215] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:20.338673 23139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea493621f1e42c2b8689859233cc798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.354758 17600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:20.355490 17600 raft_consensus.cc:606] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:20.362948 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:20.364765 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:20.380106 23145 tablet_bootstrap.cc:492] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:20.381186 23145 tablet_bootstrap.cc:492] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:20.381925 23145 ts_tablet_manager.cc:1403] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.197s	user 0.039s	sys 0.015s
I20260709 13:20:20.397810 23075 raft_consensus.cc:993] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: : Instructing follower 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:20.398504 23075 raft_consensus.cc:1081] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Signalling peer 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:20.409395 23139 tablet_copy_client.cc:806] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:20.414469 17451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:20:20.415036 23139 tablet_copy_client.cc:670] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:20.415107 17451 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:20.417958 17451 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.421368 23139 tablet_copy_client.cc:538] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:20.425606 17451 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:20.428486 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:20.429119 17527 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.440263 17527 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:20:20.441766 17419 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:20.442996 23115 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:20.443614 23115 raft_consensus.cc:697] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:20.444729 23115 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:20.429199 23145 raft_consensus.cc:359] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:20.460558 23145 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:20.461311 23145 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:20.471433 23139 tablet_bootstrap.cc:492] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:20.479579 17451 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:20.485414 18196 raft_consensus.cc:1217] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:20:20.491143 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:20.491882 17600 raft_consensus.cc:3055] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:20.492311 17600 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:20.481370 23145 ts_tablet_manager.cc:1434] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.000s
I20260709 13:20:20.509609 17463 tablet_copy_service.cc:342] P 0480cf54c3cc424ab94b963ef2ff5bf4: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-d0843b162ea34017b0c1243e97245db9 received from {username='slave'} at 127.0.0.1:47864
I20260709 13:20:20.510149 17463 tablet_copy_service.cc:434] P 0480cf54c3cc424ab94b963ef2ff5bf4: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-d0843b162ea34017b0c1243e97245db9 on tablet d0843b162ea34017b0c1243e97245db9 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:20.493386 17600 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:20.517784 17600 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.540285 17600 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:20:20.588667 23148 tablet_bootstrap.cc:492] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:20.589753 23148 tablet_bootstrap.cc:492] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:20.613831 17351 catalog_manager.cc:5697] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 12 to 13, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:20.635396 23148 ts_tablet_manager.cc:1403] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.403s	user 0.046s	sys 0.051s
I20260709 13:20:20.672231 23148 raft_consensus.cc:359] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:20.673380 23148 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:20.675588 23148 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:20.678650 23148 ts_tablet_manager.cc:1434] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.002s
I20260709 13:20:20.685472 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-2773182c45284396b8fd0513eb349cc4 received from {username='slave'} at 127.0.0.1:35586
I20260709 13:20:20.686146 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-2773182c45284396b8fd0513eb349cc4 on tablet 2773182c45284396b8fd0513eb349cc4 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:20.789714 23139 tablet_bootstrap.cc:492] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:20.809139 23139 tablet_bootstrap.cc:492] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:20.810166 23139 ts_tablet_manager.cc:1403] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.339s	user 0.049s	sys 0.018s
I20260709 13:20:20.814265 23139 raft_consensus.cc:359] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:20.815128 23139 raft_consensus.cc:740] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:20.815760 23139 consensus_queue.cc:260] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:20.826443 23139 ts_tablet_manager.cc:1434] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:20:20.828702 17463 tablet_copy_service.cc:342] P 0480cf54c3cc424ab94b963ef2ff5bf4: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-bea493621f1e42c2b8689859233cc798 received from {username='slave'} at 127.0.0.1:47864
I20260709 13:20:20.829255 17463 tablet_copy_service.cc:434] P 0480cf54c3cc424ab94b963ef2ff5bf4: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-bea493621f1e42c2b8689859233cc798 on tablet bea493621f1e42c2b8689859233cc798 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:20.878214 17451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55872
I20260709 13:20:20.878824 17451 raft_consensus.cc:606] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Received request to transfer leadership
I20260709 13:20:20.888049 17451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55872
I20260709 13:20:20.888725 17451 raft_consensus.cc:606] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Received request to transfer leadership
W20260709 13:20:20.889930 17339 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for da520cc299d940b68e5655cd8094d48e already in progress [suppressed 13 similar messages]
I20260709 13:20:20.893594 18194 raft_consensus.cc:1217] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.11->[14.12-14.12]   Dedup: 14.12->[]
I20260709 13:20:20.895143 18196 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEARNER]: Advancing to term 13
I20260709 13:20:20.918962 17451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55872
I20260709 13:20:20.920317 17451 raft_consensus.cc:606] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Received request to transfer leadership
I20260709 13:20:20.920778 18196 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:20.922708 23123 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:20:20.925927 17400 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:20:20.926416 17400 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for da520cc299d940b68e5655cd8094d48e already in progress
W20260709 13:20:20.926705 17400 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for da520cc299d940b68e5655cd8094d48e already in progress
I20260709 13:20:20.952472 17527 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:20.954195 23123 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:20.988639 17596 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:20.991391 23115 raft_consensus.cc:1064] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:20.996511 23156 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:20.999032 23115 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:21.019264 23154 raft_consensus.cc:1064] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:21.019287 18194 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:20:21.019999 23154 raft_consensus.cc:1068] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Unable to promote non-voter 2158c0f750fd4b21afe24135c52167b2: Service unavailable: leader transfer in progress
I20260709 13:20:21.022791 17596 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:21.024652 23115 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:21.028753 17523 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:21.031143 23156 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:21.034680 23154 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:20:21.205941 23166 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:20:21.214535 23167 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:20:21.281193 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 131173us
I20260709 13:20:21.367409 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:21.434739 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 116529us
I20260709 13:20:21.440289 18194 raft_consensus.cc:1217] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:20:21.482548 23123 raft_consensus.cc:2955] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:21.540459 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 47885.3us
W20260709 13:20:21.544286 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 54664.8us
W20260709 13:20:21.557751 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 215112us
W20260709 13:20:21.568055 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 370451us
W20260709 13:20:21.582379 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 105802us
I20260709 13:20:21.536955 18198 raft_consensus.cc:2955] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:21.607132 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 49671.5us
W20260709 13:20:21.703377 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 148638us
W20260709 13:20:21.714313 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 103667us
I20260709 13:20:21.702296 23115 raft_consensus.cc:993] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: : Instructing follower abf46e430b7e4ad4919ca2a717f37e0e to start an election
W20260709 13:20:21.774272 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 58971.1us
I20260709 13:20:21.778990 23180 raft_consensus.cc:1081] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Signalling peer abf46e430b7e4ad4919ca2a717f37e0e to start an election
I20260709 13:20:21.799739 17527 raft_consensus.cc:2955] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:21.886744 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 302382us
I20260709 13:20:21.914736 23208 raft_consensus.cc:1064] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:21.928992 23208 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:22.060768 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 54232.1us
I20260709 13:20:22.072847 17347 catalog_manager.cc:5697] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:22.084756 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 311393us
I20260709 13:20:22.087009 23206 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:22.087600 23206 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:22.091084 23206 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:22.092536 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:22.109210 18198 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:22.112465 23217 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:22.105273 23171 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:22.115106 23171 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:22.117720 17603 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:22.120365 23171 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:22.122982 23181 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:22.125376 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:22.126998 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:22.141077 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:22.143103 23227 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:22.147225 17445 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:22.154276 17597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:49566
I20260709 13:20:22.154846 17597 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.155203 17597 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.162448 17597 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:22.164561 17597 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:22.167711 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:22.174696 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:22.175347 17523 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.184365 17523 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:20:22.192147 17597 raft_consensus.cc:2955] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:22.217796 17568 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:22.220530 23227 raft_consensus.cc:2804] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:22.221985 23227 raft_consensus.cc:697] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:22.223178 23227 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:22.248463 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:22.278684 17596 raft_consensus.cc:1240] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Rejecting Update request from peer 0480cf54c3cc424ab94b963ef2ff5bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:22.281957 17420 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:22.270390 23208 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:20:22.302058 23174 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:22.314152 17445 raft_consensus.cc:3055] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:22.314599 17445 raft_consensus.cc:740] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:22.315395 17445 consensus_queue.cc:260] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:22.337320 17445 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:22.349185 23201 consensus_queue.cc:1175] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2158c0f750fd4b21afe24135c52167b2" responder_term: 13 status { last_received { term: 13 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 13 index: 8 } }
I20260709 13:20:22.399549 17445 raft_consensus.cc:2468] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
W20260709 13:20:22.498136 23235 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:20:22.498600 23237 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:20:22.690239 17352 catalog_manager.cc:5697] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 13 to 14, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 14 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.679692 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:22.709923 23234 log.cc:927] Time spent T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e: Append to log took a long time: real 0.350s	user 0.003s	sys 0.001s
I20260709 13:20:22.766547 17521 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:22.849628 23217 raft_consensus.cc:2955] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:22.910909 17445 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:22.916496 17351 catalog_manager.cc:5697] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:22.941223 23174 raft_consensus.cc:1064] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:22.944211 23174 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:22.955829 18198 raft_consensus.cc:2955] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:22.972973 17596 raft_consensus.cc:2955] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:22.974787 17450 raft_consensus.cc:2955] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:22.995095 23189 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:23.035884 17417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.040323 17445 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:23.058720 23171 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:23.061795 18198 raft_consensus.cc:3060] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Advancing to term 14
I20260709 13:20:23.086498 18198 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:20:23.148908 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 67576.3us
W20260709 13:20:23.238813 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 88314.3us
I20260709 13:20:23.255127 17525 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:23.256589 18198 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:23.258196 18196 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:23.263471 17525 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:23.264379 23226 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:23.266328 23201 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:23.268627 23201 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:23.270409 23206 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:23.343847 23075 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:23.361438 17521 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:23.378855 18198 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:20:23.392556 23122 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
W20260709 13:20:23.419102 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 48971.4us
I20260709 13:20:23.425015 23126 raft_consensus.cc:2955] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Committing config change with OpId 14.14: config changed from index 13 to 14, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:23.428270 18194 raft_consensus.cc:2955] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.14: config changed from index 13 to 14, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:23.442287 17597 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:20:23.453329 23249 log.cc:927] Time spent T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:20:23.480793 17600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:23.481693 17600 raft_consensus.cc:606] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:23.482625 23201 raft_consensus.cc:2955] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:23.490338 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:23.496801 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:23.502391 17600 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:20:23.523799 17352 catalog_manager.cc:5697] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 13 to 14, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:23.567327 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 57592.7us
I20260709 13:20:23.570844 23208 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:23.572429 18194 raft_consensus.cc:2955] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:23.612753 23222 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:20:23.639950 23075 raft_consensus.cc:993] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e: : Instructing follower 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
W20260709 13:20:23.645475 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 70154.3us
I20260709 13:20:23.651161 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2773182c45284396b8fd0513eb349cc4 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:23.663669 23075 raft_consensus.cc:1081] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Signalling peer 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:23.710647 17446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:20:23.711443 17446 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:23.711826 17446 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:23.710752 23256 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:23.714879 23256 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:23.719815 18194 raft_consensus.cc:2955] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:23.727057 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:23.731968 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:23.736541 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d0843b162ea34017b0c1243e97245db9 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:23.717783 23228 raft_consensus.cc:2955] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:23.765936 17600 raft_consensus.cc:2955] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.14: config changed from index 13 to 14, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:23.771206 17568 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:23.778981 23256 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:20:23.797956 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45620us
I20260709 13:20:23.799389 23265 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:23.806424 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 53175.5us
I20260709 13:20:23.813834 17446 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:23.856719 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:20:23.867936 23261 log.cc:927] Time spent T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:20:23.869707 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 59998us
I20260709 13:20:23.904875 17446 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:20:23.939191 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 104701us
W20260709 13:20:23.997076 23273 log.cc:927] Time spent T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:20:23.992044 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:24.003026 17528 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.024811 17523 raft_consensus.cc:2955] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:24.043839 17528 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
I20260709 13:20:24.034196 17525 raft_consensus.cc:2955] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:24.078325 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 119094us
I20260709 13:20:24.099189 17452 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:24.101714 17419 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:24.104770 23179 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:24.105400 23179 raft_consensus.cc:697] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:24.112924 23179 consensus_queue.cc:237] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:24.144773 23227 raft_consensus.cc:1064] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:24.145171 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
W20260709 13:20:24.213670 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 115067us
I20260709 13:20:24.215648 17436 tablet_service.cc:1558] Processing DeleteTablet for tablet 2773182c45284396b8fd0513eb349cc4 with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:55872
I20260709 13:20:24.185384 23189 consensus_queue.cc:1059] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:20:24.320557 17603 raft_consensus.cc:3055] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:24.321125 17603 raft_consensus.cc:740] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:24.346774 17525 raft_consensus.cc:1240] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Rejecting Update request from peer abf46e430b7e4ad4919ca2a717f37e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:24.337143 17603 consensus_queue.cc:260] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:24.349995 23227 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:24.350845 17603 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.370949 17603 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 12.
W20260709 13:20:24.376084 23257 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:20:24.343555 23296 tablet_replica.cc:333] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:24.381690 23296 raft_consensus.cc:2243] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:24.388525 23296 raft_consensus.cc:2272] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:24.404510 17521 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:24.407848 23296 ts_tablet_manager.cc:1916] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:24.408854 23227 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:24.413543 17352 catalog_manager.cc:5697] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:24.415197 17352 catalog_manager.cc:5697] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 17 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:24.436008 18196 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:24.439160 17451 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:20:24.456666 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 69961us
W20260709 13:20:24.474215 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 253913us
I20260709 13:20:24.479717 23189 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:20:24.590332 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:24.601297 23268 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:20:24.611752 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 49349.2us
I20260709 13:20:24.643533 17603 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:24.649410 17603 raft_consensus.cc:2955] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:24.688241 17523 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:24.704507 23222 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:24.732060 23274 raft_consensus.cc:2955] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 7 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:24.755568 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 126034us
I20260709 13:20:24.745898 18196 raft_consensus.cc:2955] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 7 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:24.722635 23291 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:20:24.766068 17454 raft_consensus.cc:2955] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 7 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:24.780614 23296 ts_tablet_manager.cc:1929] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.13
I20260709 13:20:24.781342 23296 log.cc:1199] T 2773182c45284396b8fd0513eb349cc4 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/2773182c45284396b8fd0513eb349cc4
I20260709 13:20:24.783625 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet 2773182c45284396b8fd0513eb349cc4 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:24.834532 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet d0843b162ea34017b0c1243e97245db9 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:56906
W20260709 13:20:24.900951 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 199883us
I20260709 13:20:24.899014 17347 catalog_manager.cc:5697] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 11 to 12, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 12 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:24.935418 17348 catalog_manager.cc:5697] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 7 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:24.976362 17523 raft_consensus.cc:2955] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 7 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:25.096168 23305 tablet_replica.cc:333] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:20:25.097558 23305 raft_consensus.cc:2243] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:25.110697 23305 raft_consensus.cc:2272] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:25.139539 17454 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:25.168167 23305 ts_tablet_manager.cc:1916] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:25.205098 17603 consensus_queue.cc:237] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:25.247488 18194 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:25.248942 18198 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:25.273162 17521 raft_consensus.cc:1275] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:25.273600 23171 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:25.278165 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 66712.9us
I20260709 13:20:25.282863 23305 ts_tablet_manager.cc:1929] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 13:20:25.283396 23305 log.cc:1199] T d0843b162ea34017b0c1243e97245db9 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/d0843b162ea34017b0c1243e97245db9
I20260709 13:20:25.285056 18196 raft_consensus.cc:2955] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:25.283332 23268 raft_consensus.cc:2955] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:25.301918 23284 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:20:25.349679 17598 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:25.356184 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet d0843b162ea34017b0c1243e97245db9 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
W20260709 13:20:25.373383 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 99344.7us
I20260709 13:20:25.385376 23288 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:20:25.531148 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 124695us
W20260709 13:20:25.537495 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 150071us
I20260709 13:20:25.790203 23314 consensus_queue.cc:1048] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:25.814496 23291 raft_consensus.cc:2955] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:25.832297 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bea493621f1e42c2b8689859233cc798 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:25.840003 18197 raft_consensus.cc:2955] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:25.863178 17527 raft_consensus.cc:2955] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:25.869895 17351 catalog_manager.cc:5697] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 10 to 11, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 14 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:25.917268 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet da520cc299d940b68e5655cd8094d48e with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:25.921725 17347 catalog_manager.cc:5697] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 11 to 12, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:25.980679 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 61831.1us
I20260709 13:20:25.999135 17596 raft_consensus.cc:2955] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:26.030505 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 80890.1us
I20260709 13:20:26.062623 17436 tablet_service.cc:1558] Processing DeleteTablet for tablet da520cc299d940b68e5655cd8094d48e with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55872
I20260709 13:20:26.131508 23323 tablet_replica.cc:333] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:26.140758 23323 raft_consensus.cc:2243] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:26.145988 23323 raft_consensus.cc:2272] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:26.152213 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet bea493621f1e42c2b8689859233cc798 with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:37162
I20260709 13:20:26.157280 23323 ts_tablet_manager.cc:1916] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:26.172425 23324 tablet_replica.cc:333] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:26.178570 23324 raft_consensus.cc:2243] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:26.180325 23324 raft_consensus.cc:2272] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:26.191021 23324 ts_tablet_manager.cc:1916] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:26.208165 23323 ts_tablet_manager.cc:1929] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 13:20:26.208761 23323 log.cc:1199] T da520cc299d940b68e5655cd8094d48e P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/da520cc299d940b68e5655cd8094d48e
I20260709 13:20:26.210528 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet da520cc299d940b68e5655cd8094d48e (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:26.260792 23324 ts_tablet_manager.cc:1929] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:20:26.262722 23324 log.cc:1199] T bea493621f1e42c2b8689859233cc798 P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/bea493621f1e42c2b8689859233cc798
I20260709 13:20:26.275336 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet bea493621f1e42c2b8689859233cc798 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:26.332890 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:26.449357 17448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:20:26.454509 17448 raft_consensus.cc:606] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 LEADER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:26.455957 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:26.457613 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:20:26.561897 17383 debug-util.cc:398] Leaking SignalData structure 0x7b08002396c0 after lost signal to thread 16332
W20260709 13:20:26.563217 17383 debug-util.cc:398] Leaking SignalData structure 0x7b0800044c40 after lost signal to thread 17386
W20260709 13:20:26.564544 17383 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee220 after lost signal to thread 17478
W20260709 13:20:26.565677 17383 debug-util.cc:398] Leaking SignalData structure 0x7b08000414a0 after lost signal to thread 17553
W20260709 13:20:26.566821 17383 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe1c0 after lost signal to thread 17627
W20260709 13:20:26.568069 17383 debug-util.cc:398] Leaking SignalData structure 0x7b0800131440 after lost signal to thread 18225
I20260709 13:20:26.759171 23284 raft_consensus.cc:993] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: : Instructing follower ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:26.759727 23284 raft_consensus.cc:1081] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 LEADER]: Signalling peer ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:26.763916 17525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:54544
I20260709 13:20:26.764469 17525 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:26.764798 17525 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:26.771981 17525 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:26.774923 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:26.775528 17454 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:26.775833 17454 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:26.776574 17454 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:26.777619 17454 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:26.779577 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:26.780171 18197 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:26.785106 17454 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 18.
I20260709 13:20:26.787773 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:26.788656 23309 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:26.789129 23309 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:26.790536 18197 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 18.
I20260709 13:20:26.789968 23309 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:26.792769 17525 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 18 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:26.828845 17352 catalog_manager.cc:5697] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 17 to 18, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 18 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:26.886399 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 53520.9us
I20260709 13:20:27.322798 17448 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 18 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:27.324314 23333 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:27.336473 18194 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:27.338292 23333 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:27.458575 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:27.545909 17597 consensus_queue.cc:237] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:20:27.606869 17569 consensus_peers.cc:597] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1b89997d0ecd4f03a927078433a85a66. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:27.608438 17520 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:20:27.613535 23341 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:27.613994 17447 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:20:27.618672 23316 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:27.651919 23341 raft_consensus.cc:2955] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:27.661568 17527 raft_consensus.cc:2955] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:27.671698 17454 raft_consensus.cc:2955] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:27.688887 17520 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:27.705170 17351 catalog_manager.cc:5697] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 10 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:20:27.768174 17495 consensus_peers.cc:597] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 347905859bee416fb447f19528527f52. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:27.768456 17597 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:27.769938 17454 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:27.790253 23126 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:27.791230 23332 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:27.850368 23126 raft_consensus.cc:2955] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:27.857697 17448 raft_consensus.cc:2955] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:27.859520 17603 raft_consensus.cc:2955] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:27.883291 17347 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:27.906363 17520 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:27.975448 17603 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:20:27.982719 17495 consensus_peers.cc:597] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec32c18bcdaa4eca99f08bba98bb1e0e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:27.983810 23332 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:28.010993 17448 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:28.014559 23332 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:28.077998 23126 raft_consensus.cc:2955] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index -1 to 13, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:28.085422 17596 raft_consensus.cc:2955] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index -1 to 13, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:28.117612 17352 catalog_manager.cc:5697] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 13, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 15 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:28.117723 17447 raft_consensus.cc:2955] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index -1 to 13, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:28.119141 17603 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:20:28.290709 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 83237us
I20260709 13:20:28.377166 23357 ts_tablet_manager.cc:933] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:28.415037 17454 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:28.426903 23358 ts_tablet_manager.cc:933] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:28.438287 17520 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:28.445153 23358 tablet_copy_client.cc:323] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:20:28.454180 23365 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:28.465435 17569 consensus_peers.cc:597] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 253dd23b514c487eaca1aecfa9b6e629. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:28.473035 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet 347905859bee416fb447f19528527f52 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:20:28.467144 23357 tablet_copy_client.cc:323] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:20:28.473922 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet 347905859bee416fb447f19528527f52 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-347905859bee416fb447f19528527f52
W20260709 13:20:28.487730 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45653.8us
I20260709 13:20:28.492108 23364 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:20:28.519806 23369 ts_tablet_manager.cc:933] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:28.522620 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 78755.2us
I20260709 13:20:28.530519 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet 1b89997d0ecd4f03a927078433a85a66 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:20:28.533769 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet 1b89997d0ecd4f03a927078433a85a66 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-1b89997d0ecd4f03a927078433a85a66
I20260709 13:20:28.528095 17539 tablet_copy_source_session.cc:215] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:28.550580 23358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347905859bee416fb447f19528527f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:28.559600 23362 raft_consensus.cc:2955] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:28.563963 17454 raft_consensus.cc:2955] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:28.572039 17613 tablet_copy_source_session.cc:215] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:28.585920 23357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b89997d0ecd4f03a927078433a85a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:28.593469 17527 raft_consensus.cc:2955] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:28.626497 23358 tablet_copy_client.cc:806] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:28.627252 23358 tablet_copy_client.cc:670] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:28.628002 23369 tablet_copy_client.cc:323] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:20:28.633280 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet ec32c18bcdaa4eca99f08bba98bb1e0e from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:20:28.633816 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet ec32c18bcdaa4eca99f08bba98bb1e0e from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-ec32c18bcdaa4eca99f08bba98bb1e0e
I20260709 13:20:28.634706 17352 catalog_manager.cc:5697] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 12, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 16 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:28.648483 17539 tablet_copy_source_session.cc:215] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:28.650072 23358 tablet_copy_client.cc:538] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:28.651840 23369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec32c18bcdaa4eca99f08bba98bb1e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:28.664718 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:28.674353 23358 tablet_bootstrap.cc:492] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:28.739230 23357 tablet_copy_client.cc:806] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:28.739976 23357 tablet_copy_client.cc:670] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:28.744871 23357 tablet_copy_client.cc:538] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:28.776104 23357 tablet_bootstrap.cc:492] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:28.798058 23369 tablet_copy_client.cc:806] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:28.798817 23369 tablet_copy_client.cc:670] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:28.811452 23369 tablet_copy_client.cc:538] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:28.858305 23369 tablet_bootstrap.cc:492] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:29.076787 23378 ts_tablet_manager.cc:933] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:29.105134 23378 tablet_copy_client.cc:323] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:20:29.115458 23357 tablet_bootstrap.cc:492] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:29.127770 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet 253dd23b514c487eaca1aecfa9b6e629 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:20:29.134418 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet 253dd23b514c487eaca1aecfa9b6e629 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-253dd23b514c487eaca1aecfa9b6e629
I20260709 13:20:29.142864 23357 tablet_bootstrap.cc:492] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:29.145787 23357 ts_tablet_manager.cc:1403] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.370s	user 0.057s	sys 0.008s
I20260709 13:20:29.150341 23358 tablet_bootstrap.cc:492] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:29.151487 23358 tablet_bootstrap.cc:492] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:29.152364 23358 ts_tablet_manager.cc:1403] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.478s	user 0.045s	sys 0.029s
I20260709 13:20:29.144742 17613 tablet_copy_source_session.cc:215] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:29.153462 23357 raft_consensus.cc:359] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:29.160163 23357 raft_consensus.cc:740] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:29.161667 23357 consensus_queue.cc:260] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:29.162294 17520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:20:29.162683 23378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253dd23b514c487eaca1aecfa9b6e629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:29.167361 17520 raft_consensus.cc:606] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:29.168939 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:29.171085 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:29.163849 23358 raft_consensus.cc:359] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:29.180148 23358 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:29.184464 23358 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:29.193032 23369 tablet_bootstrap.cc:492] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:29.194097 23369 tablet_bootstrap.cc:492] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:29.194868 23369 ts_tablet_manager.cc:1403] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.353s	user 0.048s	sys 0.009s
I20260709 13:20:29.199640 23358 ts_tablet_manager.cc:1434] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:20:29.207710 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-347905859bee416fb447f19528527f52 received from {username='slave'} at 127.0.0.1:35586
I20260709 13:20:29.208223 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-347905859bee416fb447f19528527f52 on tablet 347905859bee416fb447f19528527f52 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:29.222563 23357 ts_tablet_manager.cc:1434] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.000s
I20260709 13:20:29.239831 23369 raft_consensus.cc:359] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:29.248508 23378 tablet_copy_client.cc:806] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:29.248795 23369 raft_consensus.cc:740] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:29.251479 23369 consensus_queue.cc:260] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:29.250692 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-1b89997d0ecd4f03a927078433a85a66 received from {username='slave'} at 127.0.0.1:52572
I20260709 13:20:29.253525 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-1b89997d0ecd4f03a927078433a85a66 on tablet 1b89997d0ecd4f03a927078433a85a66 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:29.254220 23369 ts_tablet_manager.cc:1434] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:20:29.258767 23378 tablet_copy_client.cc:670] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:29.260012 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-ec32c18bcdaa4eca99f08bba98bb1e0e received from {username='slave'} at 127.0.0.1:35586
I20260709 13:20:29.265985 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-ec32c18bcdaa4eca99f08bba98bb1e0e on tablet ec32c18bcdaa4eca99f08bba98bb1e0e with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:29.276916 18194 raft_consensus.cc:1217] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 13:20:29.298419 23378 tablet_copy_client.cc:538] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:29.324378 23378 tablet_bootstrap.cc:492] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:29.359709 18194 raft_consensus.cc:1217] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.12->[15.13-15.13]   Dedup: 15.13->[]
I20260709 13:20:29.423904 18197 raft_consensus.cc:1217] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:20:29.515434 23378 tablet_bootstrap.cc:492] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:29.527029 23378 tablet_bootstrap.cc:492] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:29.528002 23378 ts_tablet_manager.cc:1403] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.204s	user 0.033s	sys 0.023s
I20260709 13:20:29.532286 23378 raft_consensus.cc:359] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:29.533366 23378 raft_consensus.cc:740] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:29.534230 23378 consensus_queue.cc:260] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:29.537753 23378 ts_tablet_manager.cc:1434] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:20:29.553018 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-253dd23b514c487eaca1aecfa9b6e629 received from {username='slave'} at 127.0.0.1:52572
I20260709 13:20:29.553499 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-253dd23b514c487eaca1aecfa9b6e629 on tablet 253dd23b514c487eaca1aecfa9b6e629 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:29.604414 23382 raft_consensus.cc:993] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: : Instructing follower 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:29.604918 23382 raft_consensus.cc:1081] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Signalling peer 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:29.606688 17452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:55882
I20260709 13:20:29.607234 17452 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:29.607583 17452 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.619935 17452 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:29.624253 17452 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:29.624941 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:29.632853 17520 raft_consensus.cc:3055] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:29.633225 17520 raft_consensus.cc:740] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:29.634047 17520 consensus_queue.cc:260] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:29.635306 17520 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.625349 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:29.638206 17602 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.662568 17602 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 15.
I20260709 13:20:29.664208 17420 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:29.665247 23334 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:29.665835 23334 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:29.666905 23334 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:29.672804 17520 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 15.
I20260709 13:20:29.747342 17352 catalog_manager.cc:5697] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 14 to 15, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 15 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:29.920881 23364 raft_consensus.cc:1064] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:29.923717 23364 consensus_queue.cc:237] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:29.927706 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 72262us
I20260709 13:20:30.156960 23332 raft_consensus.cc:1064] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:30.163034 23343 raft_consensus.cc:1064] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:30.172129 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:30.197382 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 178432us
W20260709 13:20:30.251533 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 100984us
W20260709 13:20:30.336916 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 101795us
W20260709 13:20:30.417546 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 119322us
W20260709 13:20:30.460415 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 206225us
I20260709 13:20:30.483745 18197 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:30.486733 17454 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:30.492529 18197 raft_consensus.cc:1217] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:20:30.500111 17520 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:20:30.529102 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 384822us
I20260709 13:20:30.569341 17527 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:30.569269 23332 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:30.585207 23366 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:30.569937 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 45162.9us
I20260709 13:20:30.592360 23364 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:30.602501 23364 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:30.607750 23399 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:30.604012 23343 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:30.671455 17602 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:30.696827 18197 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:30.699015 23403 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:30.706423 17448 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:30.712307 23392 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:30.729308 17602 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:30.745937 23332 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:20:30.769065 23368 raft_consensus.cc:1027] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: attempt to promote peer 2158c0f750fd4b21afe24135c52167b2: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:20:30.973801 18194 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:20:30.975349 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 139245us
I20260709 13:20:30.844645 23405 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
W20260709 13:20:31.066759 23430 log.cc:927] Time spent T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
W20260709 13:20:31.143929 23431 log.cc:927] Time spent T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:20:31.150797 23429 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 13:20:31.158859 23433 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:20:31.160741 23432 log.cc:927] Time spent T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:20:31.165701 23428 log.cc:927] Time spent T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.400s	user 0.001s	sys 0.000s
W20260709 13:20:31.189813 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 96754.9us
W20260709 13:20:31.261655 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 277091us
I20260709 13:20:31.296448 23278 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:31.297251 23278 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:31.333712 23278 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:31.342058 23403 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:20:31.343497 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 80657.7us
W20260709 13:20:31.388784 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 283499us
I20260709 13:20:31.399441 17602 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:20:31.399781 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 79907.1us
I20260709 13:20:31.412642 23401 raft_consensus.cc:2955] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:31.496582 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 45571.8us
I20260709 13:20:31.496726 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:31.500718 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:20:31.504710 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 49304.1us
I20260709 13:20:31.507542 17450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" is_pre_election: true
I20260709 13:20:31.523494 17527 raft_consensus.cc:2955] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:31.539671 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:31.540506 23278 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:31.545329 17450 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:20:31.558327 17454 raft_consensus.cc:2955] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:31.561213 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 60116us
I20260709 13:20:31.592618 17347 catalog_manager.cc:5697] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:31.596797 23446 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:20:31.615530 23382 raft_consensus.cc:2955] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:31.617977 23454 raft_consensus.cc:1064] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:31.623471 23454 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:31.642765 18199 raft_consensus.cc:2955] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:31.654297 23403 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:20:31.684157 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 45888.3us
I20260709 13:20:31.698983 17454 raft_consensus.cc:2955] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:31.696724 17603 raft_consensus.cc:2955] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:31.738008 17448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a372191e02cc468bbc747310e2818f07"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:20:31.738750 17448 raft_consensus.cc:606] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:31.835814 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 13:20:31.836324 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 89097.8us
W20260709 13:20:31.836768 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 92465.4us
I20260709 13:20:31.837641 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:20:31.873569 23458 log.cc:927] Time spent T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:20:31.928653 18199 raft_consensus.cc:2955] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.053285 18197 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:20:32.058574 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 93338.4us
W20260709 13:20:32.103726 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 93136.2us
W20260709 13:20:32.113178 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 46966.8us
I20260709 13:20:32.151262 23445 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:20:32.196905 17454 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:32.208614 23445 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:32.232547 17454 raft_consensus.cc:2955] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:32.300805 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 48053.7us
I20260709 13:20:32.294399 23424 raft_consensus.cc:2955] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Committing config change with OpId 15.14: config changed from index 13 to 14, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.316416 23389 raft_consensus.cc:993] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: : Instructing follower ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:32.317046 23389 raft_consensus.cc:1081] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Signalling peer ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:32.321913 17520 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:32.321406 17602 raft_consensus.cc:2955] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.336516 17520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a372191e02cc468bbc747310e2818f07"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:54544
I20260709 13:20:32.337198 17520 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:32.338963 17520 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:32.318434 17347 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:32.370198 23411 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:32.365124 18200 raft_consensus.cc:2955] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.369320 17598 consensus_queue.cc:237] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:32.390548 17520 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:32.399209 17520 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:32.425279 18199 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:20:32.437202 17351 catalog_manager.cc:5697] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 13 to 14, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.441321 17448 raft_consensus.cc:1275] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:20:32.446302 23439 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:32.465484 23393 raft_consensus.cc:2955] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.470922 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:32.472365 18200 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:32.472273 23439 consensus_queue.cc:1048] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:32.477401 17520 raft_consensus.cc:2955] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.489842 17528 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:32.493695 17448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:32.495252 17448 raft_consensus.cc:3055] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:32.495546 17448 raft_consensus.cc:740] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:32.496407 17448 consensus_queue.cc:260] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:32.498461 17448 raft_consensus.cc:3060] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:32.504091 18199 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:32.505787 17598 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:32.513936 23478 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:32.524605 18200 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
I20260709 13:20:32.521916 17448 raft_consensus.cc:2468] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 9.
W20260709 13:20:32.532063 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 43883.9us
I20260709 13:20:32.533631 23439 raft_consensus.cc:2955] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.540874 17495 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:32.545588 23480 raft_consensus.cc:2804] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:32.547516 23392 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:32.548142 23480 raft_consensus.cc:697] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:32.549099 23480 consensus_queue.cc:237] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:32.557255 17448 raft_consensus.cc:2955] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.558040 17352 catalog_manager.cc:5697] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.558918 18199 raft_consensus.cc:2955] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.560489 17454 raft_consensus.cc:2955] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.568107 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1b89997d0ecd4f03a927078433a85a66 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:32.569931 23382 raft_consensus.cc:2955] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.572655 18197 raft_consensus.cc:2955] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.560286 18200 raft_consensus.cc:2955] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.608336 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 347905859bee416fb447f19528527f52 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:32.615900 17600 consensus_queue.cc:237] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:32.622840 17520 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:32.625507 23393 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:20:32.628484 18197 raft_consensus.cc:1275] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:32.631057 23454 consensus_queue.cc:1048] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:32.638952 23411 raft_consensus.cc:2955] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.640430 18199 raft_consensus.cc:2955] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.645552 17351 catalog_manager.cc:5697] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 8 to 9, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 9 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:32.655033 17348 catalog_manager.cc:5697] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 10 to 11, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 10 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.656222 17351 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 10 to 11, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:32.663173 17520 raft_consensus.cc:2955] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.606179 17598 raft_consensus.cc:2955] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:32.690990 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 253dd23b514c487eaca1aecfa9b6e629 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:32.692256 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b89997d0ecd4f03a927078433a85a66 with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:37162
I20260709 13:20:32.725162 17347 catalog_manager.cc:5697] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index 13 to 14, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 16 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:32.747665 17436 tablet_service.cc:1558] Processing DeleteTablet for tablet 347905859bee416fb447f19528527f52 with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55872
I20260709 13:20:32.758828 17520 consensus_queue.cc:237] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:32.766294 17440 tablet_service.cc:1558] Processing DeleteTablet for tablet 253dd23b514c487eaca1aecfa9b6e629 with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:55872
I20260709 13:20:32.879062 23485 tablet_replica.cc:333] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:32.883948 23487 tablet_replica.cc:333] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:32.885143 23487 raft_consensus.cc:2243] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.910059 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:32.955902 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 143656us
I20260709 13:20:33.047977 23487 raft_consensus.cc:2272] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.048884 18199 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:33.055089 17454 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:20:33.059718 18200 raft_consensus.cc:1275] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:20:33.094120 23451 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:33.098444 23447 consensus_queue.cc:1048] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:33.097712 23343 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:20:33.118685 23487 ts_tablet_manager.cc:1916] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:33.164438 23480 raft_consensus.cc:2955] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Committing config change with OpId 15.15: config changed from index 14 to 15, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:33.185343 17448 raft_consensus.cc:1275] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:33.197057 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ec32c18bcdaa4eca99f08bba98bb1e0e with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:33.217181 18197 raft_consensus.cc:2955] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Committing config change with OpId 15.15: config changed from index 14 to 15, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:33.226753 17351 catalog_manager.cc:5697] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 14 to 15, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 15 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:33.239418 23447 consensus_queue.cc:1048] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:33.302618 23485 raft_consensus.cc:2243] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.304014 23485 raft_consensus.cc:2272] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.310781 23485 ts_tablet_manager.cc:1916] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:33.386129 17446 raft_consensus.cc:2955] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Committing config change with OpId 15.15: config changed from index 14 to 15, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:33.477221 23487 ts_tablet_manager.cc:1929] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 13:20:33.478008 23487 log.cc:1199] T 347905859bee416fb447f19528527f52 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/347905859bee416fb447f19528527f52
I20260709 13:20:33.482892 23487 tablet_replica.cc:333] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:33.489202 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet 347905859bee416fb447f19528527f52 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:33.490252 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet ec32c18bcdaa4eca99f08bba98bb1e0e with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:56906
I20260709 13:20:33.496748 23487 raft_consensus.cc:2243] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.498199 23487 raft_consensus.cc:2272] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.521037 23487 ts_tablet_manager.cc:1916] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:33.551854 23503 tablet_replica.cc:333] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:20:33.553802 23503 raft_consensus.cc:2243] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.555316 23503 raft_consensus.cc:2272] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.558722 23503 ts_tablet_manager.cc:1916] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:33.580253 23503 ts_tablet_manager.cc:1929] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.14
I20260709 13:20:33.580808 23503 log.cc:1199] T ec32c18bcdaa4eca99f08bba98bb1e0e P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/ec32c18bcdaa4eca99f08bba98bb1e0e
I20260709 13:20:33.582902 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet ec32c18bcdaa4eca99f08bba98bb1e0e (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:33.601576 23485 ts_tablet_manager.cc:1929] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.10
I20260709 13:20:33.605206 23485 log.cc:1199] T 1b89997d0ecd4f03a927078433a85a66 P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/1b89997d0ecd4f03a927078433a85a66
I20260709 13:20:33.606324 23487 ts_tablet_manager.cc:1929] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 13:20:33.607026 23487 log.cc:1199] T 253dd23b514c487eaca1aecfa9b6e629 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/253dd23b514c487eaca1aecfa9b6e629
I20260709 13:20:33.608737 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet 253dd23b514c487eaca1aecfa9b6e629 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:33.610589 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet 1b89997d0ecd4f03a927078433a85a66 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:34.589279 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:34.880591 17527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:20:34.881326 17527 raft_consensus.cc:606] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:34.884443 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:34.886492 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:20:34.913268 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 52582.9us
I20260709 13:20:35.118122 17520 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:20:35.177562 17495 consensus_peers.cc:597] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7002e0c7a3624420a1737b1fb29d8142. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:35.187844 17598 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:35.189495 17454 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:35.191118 23480 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:35.192984 23480 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:35.223349 23505 raft_consensus.cc:2955] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:35.226012 17603 raft_consensus.cc:2955] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:35.307106 23480 raft_consensus.cc:993] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: : Instructing follower 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:35.310721 23480 raft_consensus.cc:1081] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 LEADER]: Signalling peer 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:35.325711 17445 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:35.338307 17351 catalog_manager.cc:5697] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 15 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:35.357139 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 49061.7us
W20260709 13:20:35.359323 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 47365.9us
I20260709 13:20:35.363613 17520 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:35.387748 23406 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:20:35.396755 17603 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:35.417969 17452 raft_consensus.cc:2955] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:35.422199 23517 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:35.423702 17454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:55882
I20260709 13:20:35.426275 17454 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:35.426683 17454 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:35.430817 17420 consensus_peers.cc:597] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8fad2b3d8f774d4ca47be967955fb28b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:35.464702 17454 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:35.475149 23523 raft_consensus.cc:2955] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:35.482374 17525 raft_consensus.cc:2955] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:35.493633 17454 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 19 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:35.494767 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:35.499087 17527 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:35.499399 17527 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:35.500186 17527 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:35.501263 17527 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.505020 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:35.505635 18200 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.512076 17527 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 19.
I20260709 13:20:35.513550 17419 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:35.514546 23406 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:35.515329 23406 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 19 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:35.516252 23406 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:35.513270 18200 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 19.
I20260709 13:20:35.525409 17603 raft_consensus.cc:2955] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:35.574316 17598 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:35.612892 17525 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:35.621659 17454 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:35.626152 23519 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:35.630568 23411 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:35.639637 17348 catalog_manager.cc:5697] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 16 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:20:35.646847 17569 consensus_peers.cc:597] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45a13c485c0a480f8ce9eb1282cb6d01. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:35.664251 23516 raft_consensus.cc:2955] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:35.672617 17454 raft_consensus.cc:2955] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:35.674889 17351 catalog_manager.cc:5697] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 18 to 19, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 19 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.673775 23531 ts_tablet_manager.cc:933] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:35.710067 23531 tablet_copy_client.cc:323] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:20:35.712489 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet 7002e0c7a3624420a1737b1fb29d8142 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:20:35.713137 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet 7002e0c7a3624420a1737b1fb29d8142 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-7002e0c7a3624420a1737b1fb29d8142
I20260709 13:20:35.719539 17351 catalog_manager.cc:5697] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 15 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.735738 17598 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:35.748520 17525 raft_consensus.cc:2955] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:35.729897 17539 tablet_copy_source_session.cc:215] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:35.758994 23531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7002e0c7a3624420a1737b1fb29d8142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:35.780687 23534 ts_tablet_manager.cc:933] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
W20260709 13:20:35.798547 17569 consensus_peers.cc:597] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f83c31b52fc7479896f1f02ab870dc3b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:35.806264 17446 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:35.808420 17525 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:35.813534 23507 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:35.814611 23519 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:35.838944 23534 tablet_copy_client.cc:323] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.65:36303
I20260709 13:20:35.871038 17463 tablet_copy_service.cc:140] P 0480cf54c3cc424ab94b963ef2ff5bf4: Received BeginTabletCopySession request for tablet 8fad2b3d8f774d4ca47be967955fb28b from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:47864)
I20260709 13:20:35.871747 17463 tablet_copy_service.cc:161] P 0480cf54c3cc424ab94b963ef2ff5bf4: Beginning new tablet copy session on tablet 8fad2b3d8f774d4ca47be967955fb28b from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:47864: session id = 2158c0f750fd4b21afe24135c52167b2-8fad2b3d8f774d4ca47be967955fb28b
I20260709 13:20:35.881296 17463 tablet_copy_source_session.cc:215] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:35.886289 23534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fad2b3d8f774d4ca47be967955fb28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:35.887495 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:35.891987 17446 raft_consensus.cc:2955] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:35.887944 23507 raft_consensus.cc:2955] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:35.914126 23531 tablet_copy_client.cc:806] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:35.915282 23531 tablet_copy_client.cc:670] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:35.921744 18197 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:35.923171 23506 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:35.958891 23531 tablet_copy_client.cc:538] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:35.979110 17351 catalog_manager.cc:5697] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 14 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:36.024814 23531 tablet_bootstrap.cc:492] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:36.128788 17520 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 19 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:36.130420 23517 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:20:36.146595 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 46020.1us
I20260709 13:20:36.208400 23534 tablet_copy_client.cc:806] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:36.209820 23534 tablet_copy_client.cc:670] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:36.218091 23534 tablet_copy_client.cc:538] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:36.226171 17525 raft_consensus.cc:2955] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:36.249161 23547 ts_tablet_manager.cc:933] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:36.303488 23549 ts_tablet_manager.cc:933] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:36.379895 23534 tablet_bootstrap.cc:492] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:36.407902 23547 tablet_copy_client.cc:323] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:20:36.409940 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet 45a13c485c0a480f8ce9eb1282cb6d01 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:20:36.411478 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet 45a13c485c0a480f8ce9eb1282cb6d01 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-45a13c485c0a480f8ce9eb1282cb6d01
I20260709 13:20:36.413606 23549 tablet_copy_client.cc:323] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:20:36.418457 17612 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet f83c31b52fc7479896f1f02ab870dc3b from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:20:36.419035 17612 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet f83c31b52fc7479896f1f02ab870dc3b from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-f83c31b52fc7479896f1f02ab870dc3b
I20260709 13:20:36.454313 17613 tablet_copy_source_session.cc:215] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:36.467187 17612 tablet_copy_source_session.cc:215] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:36.478730 23549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83c31b52fc7479896f1f02ab870dc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.482360 23547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a13c485c0a480f8ce9eb1282cb6d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.552996 23534 tablet_bootstrap.cc:492] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:36.560842 23534 tablet_bootstrap.cc:492] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:36.561699 23534 ts_tablet_manager.cc:1403] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.182s	user 0.045s	sys 0.003s
I20260709 13:20:36.579368 23534 raft_consensus.cc:359] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:36.582814 23534 raft_consensus.cc:740] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:36.584008 23534 consensus_queue.cc:260] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:36.590232 23534 ts_tablet_manager.cc:1434] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.006s
I20260709 13:20:36.592039 17463 tablet_copy_service.cc:342] P 0480cf54c3cc424ab94b963ef2ff5bf4: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-8fad2b3d8f774d4ca47be967955fb28b received from {username='slave'} at 127.0.0.1:47864
I20260709 13:20:36.592554 17463 tablet_copy_service.cc:434] P 0480cf54c3cc424ab94b963ef2ff5bf4: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-8fad2b3d8f774d4ca47be967955fb28b on tablet 8fad2b3d8f774d4ca47be967955fb28b with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:36.633535 23547 tablet_copy_client.cc:806] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:36.637068 23547 tablet_copy_client.cc:670] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:36.655635 23547 tablet_copy_client.cc:538] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:36.678184 23549 tablet_copy_client.cc:806] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:36.682771 23549 tablet_copy_client.cc:670] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:36.693905 23549 tablet_copy_client.cc:538] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:36.700062 18200 raft_consensus.cc:1217] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:20:36.737296 23549 tablet_bootstrap.cc:492] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:36.797397 23531 tablet_bootstrap.cc:492] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:36.799973 23531 tablet_bootstrap.cc:492] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:36.800909 23531 ts_tablet_manager.cc:1403] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.776s	user 0.060s	sys 0.019s
I20260709 13:20:36.811482 23547 tablet_bootstrap.cc:492] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:36.821075 23531 raft_consensus.cc:359] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:36.823673 23531 raft_consensus.cc:740] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:36.833827 23531 consensus_queue.cc:260] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:36.852847 23531 ts_tablet_manager.cc:1434] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:20:36.854723 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-7002e0c7a3624420a1737b1fb29d8142 received from {username='slave'} at 127.0.0.1:35586
I20260709 13:20:36.855233 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-7002e0c7a3624420a1737b1fb29d8142 on tablet 7002e0c7a3624420a1737b1fb29d8142 with peer 2158c0f750fd4b21afe24135c52167b2
W20260709 13:20:37.293232 23549 log.cc:927] Time spent T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.393s	user 0.002s	sys 0.000s
W20260709 13:20:37.296005 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 76763.6us
I20260709 13:20:37.323359 23549 tablet_bootstrap.cc:492] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:37.326113 23549 tablet_bootstrap.cc:492] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:37.329687 23549 ts_tablet_manager.cc:1403] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.593s	user 0.033s	sys 0.017s
I20260709 13:20:37.332839 23549 raft_consensus.cc:359] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:37.333714 23549 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:37.334406 23549 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:37.349969 23549 ts_tablet_manager.cc:1434] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:20:37.354864 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-f83c31b52fc7479896f1f02ab870dc3b received from {username='slave'} at 127.0.0.1:52572
I20260709 13:20:37.355311 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-f83c31b52fc7479896f1f02ab870dc3b on tablet f83c31b52fc7479896f1f02ab870dc3b with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:37.363826 23581 raft_consensus.cc:1064] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:37.366735 23581 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:37.445982 23547 log.cc:927] Time spent T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.531s	user 0.015s	sys 0.029s
I20260709 13:20:37.563166 18199 raft_consensus.cc:1217] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:20:37.589857 18199 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:37.591140 23572 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:37.595482 17522 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:37.601759 23581 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:37.640676 23543 raft_consensus.cc:2955] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:37.643625 17600 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:37.644784 18197 raft_consensus.cc:1217] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:20:37.645830 23523 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:37.648993 17522 raft_consensus.cc:2955] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:37.675294 23547 tablet_bootstrap.cc:492] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:37.676343 23547 tablet_bootstrap.cc:492] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:37.678112 23547 ts_tablet_manager.cc:1403] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.870s	user 0.052s	sys 0.052s
I20260709 13:20:37.680382 17600 raft_consensus.cc:2955] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:37.682781 23547 raft_consensus.cc:359] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:37.683677 23547 raft_consensus.cc:740] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:37.684551 23547 consensus_queue.cc:260] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:37.687963 23547 ts_tablet_manager.cc:1434] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:20:37.690953 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-45a13c485c0a480f8ce9eb1282cb6d01 received from {username='slave'} at 127.0.0.1:52572
I20260709 13:20:37.691427 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-45a13c485c0a480f8ce9eb1282cb6d01 on tablet 45a13c485c0a480f8ce9eb1282cb6d01 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:37.694380 17348 catalog_manager.cc:5697] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:37.679843 18197 raft_consensus.cc:2955] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:37.710201 23584 raft_consensus.cc:1064] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:37.713379 23584 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:37.760284 18197 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:37.760413 17596 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:37.762686 23580 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:37.774273 23580 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:37.774823 17446 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:37.782250 23546 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:20:37.835980 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:37.868582 23513 raft_consensus.cc:2955] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:37.876906 18197 raft_consensus.cc:2955] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:37.884667 17454 raft_consensus.cc:2955] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:37.928257 18199 raft_consensus.cc:1217] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 13:20:37.950918 17600 raft_consensus.cc:2955] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.012630 17347 catalog_manager.cc:5697] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.061743 17528 consensus_queue.cc:237] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:38.078289 17452 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:38.079152 18199 raft_consensus.cc:1275] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:38.080063 23580 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:38.083421 23542 consensus_queue.cc:1048] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:38.092494 23542 raft_consensus.cc:2955] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.105618 17454 raft_consensus.cc:2955] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.112905 23586 raft_consensus.cc:1064] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:38.095764 18197 raft_consensus.cc:2955] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.116597 23586 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:38.119217 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7002e0c7a3624420a1737b1fb29d8142 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:38.133772 18199 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:38.135804 17528 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:38.136178 17351 catalog_manager.cc:5697] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 15 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:38.137508 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08003d98e0 after lost signal to thread 16332
I20260709 13:20:38.138643 17452 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:20:38.138955 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5e00 after lost signal to thread 17386
I20260709 13:20:38.139920 23562 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:20:38.140319 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5ba0 after lost signal to thread 17478
W20260709 13:20:38.141624 17550 debug-util.cc:398] Leaking SignalData structure 0x7b0800314cc0 after lost signal to thread 17553
W20260709 13:20:38.143901 17550 debug-util.cc:398] Leaking SignalData structure 0x7b08003755c0 after lost signal to thread 17627
I20260709 13:20:38.145174 23516 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:20:38.145210 17550 debug-util.cc:398] Leaking SignalData structure 0x7b0800369360 after lost signal to thread 18225
I20260709 13:20:38.153975 23587 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:20:38.174880 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet 7002e0c7a3624420a1737b1fb29d8142 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:56906
I20260709 13:20:38.191895 17452 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:38.205366 17445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:43246
I20260709 13:20:38.206077 17445 raft_consensus.cc:606] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:38.214224 18201 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:38.218183 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:38.224694 23581 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:20:38.228031 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:38.233086 17603 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:38.236688 23506 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:38.236886 23516 raft_consensus.cc:2955] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.239042 17528 raft_consensus.cc:2955] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.262689 17446 raft_consensus.cc:2955] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.267134 23523 raft_consensus.cc:2955] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.271791 17603 raft_consensus.cc:2955] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.220247 23603 tablet_replica.cc:333] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:20:38.293541 23603 raft_consensus.cc:2243] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:38.296589 23603 raft_consensus.cc:2272] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:38.304509 18201 raft_consensus.cc:2955] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:38.321635 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 44554.7us
I20260709 13:20:38.334395 17352 catalog_manager.cc:5697] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 11 to 12, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 16 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.344801 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8fad2b3d8f774d4ca47be967955fb28b with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:38.351703 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fad2b3d8f774d4ca47be967955fb28b with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:37162
I20260709 13:20:38.361145 23581 raft_consensus.cc:993] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4: : Instructing follower abf46e430b7e4ad4919ca2a717f37e0e to start an election
I20260709 13:20:38.361701 23581 raft_consensus.cc:1081] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Signalling peer abf46e430b7e4ad4919ca2a717f37e0e to start an election
I20260709 13:20:38.363157 23606 tablet_replica.cc:333] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:38.364246 23606 raft_consensus.cc:2243] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:38.365401 23606 raft_consensus.cc:2272] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:38.370527 23606 ts_tablet_manager.cc:1916] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:38.375504 17596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:49566
I20260709 13:20:38.380662 17596 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.381122 17596 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:38.386404 23562 raft_consensus.cc:1064] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:38.389077 23562 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:38.378211 18197 raft_consensus.cc:2955] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.379180 17347 catalog_manager.cc:5697] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.416070 23606 ts_tablet_manager.cc:1929] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:20:38.416775 23606 log.cc:1199] T 8fad2b3d8f774d4ca47be967955fb28b P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/8fad2b3d8f774d4ca47be967955fb28b
I20260709 13:20:38.426764 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet 8fad2b3d8f774d4ca47be967955fb28b (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:38.439615 23603 ts_tablet_manager.cc:1916] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:38.452123 18199 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:38.457265 23587 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:38.458838 17528 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:38.460717 17446 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:38.463634 23586 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:38.468086 23587 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:38.444635 17596 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:38.494632 17600 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:38.513988 17528 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:38.515363 23586 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:38.518237 18197 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:38.529960 17596 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:38.530305 23585 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:38.537112 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:38.537693 17522 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:38.543286 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:38.544142 17454 raft_consensus.cc:3055] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:38.544463 17454 raft_consensus.cc:740] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:38.545163 17454 consensus_queue.cc:260] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:38.546473 17454 raft_consensus.cc:3060] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:38.556041 17528 raft_consensus.cc:2955] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.559649 17454 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:38.565464 17522 raft_consensus.cc:2468] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:38.538451 23516 raft_consensus.cc:2955] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.575130 17568 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:38.576983 23585 raft_consensus.cc:2804] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:38.577524 23585 raft_consensus.cc:697] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:38.578389 23585 consensus_queue.cc:237] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:38.589452 18199 raft_consensus.cc:2955] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.606357 17351 catalog_manager.cc:5697] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 10 to 11, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 14 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.627242 17436 tablet_service.cc:1558] Processing DeleteTablet for tablet f83c31b52fc7479896f1f02ab870dc3b with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55872
I20260709 13:20:38.669206 23613 tablet_replica.cc:333] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:38.670342 23613 raft_consensus.cc:2243] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:38.683432 23562 raft_consensus.cc:2955] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.695685 18201 raft_consensus.cc:2955] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.689575 23603 ts_tablet_manager.cc:1929] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:20:38.701972 17446 raft_consensus.cc:2955] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.701550 23603 log.cc:1199] T 7002e0c7a3624420a1737b1fb29d8142 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/7002e0c7a3624420a1737b1fb29d8142
W20260709 13:20:38.709026 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 106366us
I20260709 13:20:38.711633 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet 7002e0c7a3624420a1737b1fb29d8142 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:38.712415 17522 raft_consensus.cc:2955] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.731666 17347 catalog_manager.cc:5697] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.745146 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f83c31b52fc7479896f1f02ab870dc3b with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:38.738937 23613 raft_consensus.cc:2272] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:38.753954 17352 catalog_manager.cc:5697] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 12 to 13, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.754781 23613 ts_tablet_manager.cc:1916] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:38.822512 17596 consensus_queue.cc:237] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:38.833415 17454 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:38.834074 23613 ts_tablet_manager.cc:1929] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 13:20:38.834558 23613 log.cc:1199] T f83c31b52fc7479896f1f02ab870dc3b P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/f83c31b52fc7479896f1f02ab870dc3b
I20260709 13:20:38.836309 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet f83c31b52fc7479896f1f02ab870dc3b (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:38.835132 23562 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:38.833475 18201 raft_consensus.cc:1275] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:38.843626 23562 consensus_queue.cc:1048] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:38.879974 23587 raft_consensus.cc:2955] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.883216 17454 raft_consensus.cc:2955] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.886873 18201 raft_consensus.cc:2955] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.927752 17352 catalog_manager.cc:5697] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 10 to 11, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 15 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:38.968708 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet 45a13c485c0a480f8ce9eb1282cb6d01 with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:37162
I20260709 13:20:38.990931 17522 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:38.992671 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 45a13c485c0a480f8ce9eb1282cb6d01 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:38.993427 23562 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:39.023651 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 68619.3us
I20260709 13:20:39.040482 23618 tablet_replica.cc:333] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:39.050964 23618 raft_consensus.cc:2243] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:39.069204 23618 raft_consensus.cc:2272] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:39.075027 23618 ts_tablet_manager.cc:1916] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:39.127606 17445 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:39.129482 23562 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:39.184804 23618 ts_tablet_manager.cc:1929] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:20:39.185364 23618 log.cc:1199] T 45a13c485c0a480f8ce9eb1282cb6d01 P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/45a13c485c0a480f8ce9eb1282cb6d01
I20260709 13:20:39.207921 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet 45a13c485c0a480f8ce9eb1282cb6d01 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:39.229103 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:40.148311 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 64872.3us
I20260709 13:20:40.417181 17522 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:40.422477 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:40.456532 17495 consensus_peers.cc:597] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dac17c6792414180963986e500f47356. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:40.480922 17598 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:40.483625 23584 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:40.490751 17454 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:40.493333 23624 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:40.520840 23584 raft_consensus.cc:2955] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:40.538066 17596 raft_consensus.cc:2955] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:40.568543 17454 raft_consensus.cc:2955] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:40.585569 17445 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:40.593107 17351 catalog_manager.cc:5697] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index -1 to 12, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 17 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:20:40.622253 17420 consensus_peers.cc:597] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1c40484b7a540a9b32947573409178a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:40.635596 17528 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:40.637686 23543 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:40.642261 17596 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:40.644457 23543 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:40.716390 23625 raft_consensus.cc:2955] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:40.724515 17522 raft_consensus.cc:2955] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:40.761353 17596 raft_consensus.cc:2955] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:40.782202 17598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:40.782907 17598 raft_consensus.cc:606] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Received request to transfer leadership to TS ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:40.783708 17348 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:40.784940 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:40.787438 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:40.808594 17528 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:20:40.808606 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 53055.5us
W20260709 13:20:40.848476 17495 consensus_peers.cc:597] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1cf63370ef7f41519349f91e85c42d19. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:40.849737 17454 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:40.850595 17596 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:40.853413 23584 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:40.855656 23584 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:40.906422 17445 raft_consensus.cc:2955] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:40.916745 23584 raft_consensus.cc:2955] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:40.949930 17352 catalog_manager.cc:5697] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 16 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:41.022951 17596 raft_consensus.cc:2955] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:41.042344 17522 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:41.105712 17600 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:41.109118 23627 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:41.118062 17454 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:41.120626 23627 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:41.252207 23587 raft_consensus.cc:993] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: : Instructing follower ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:41.252839 23562 raft_consensus.cc:1081] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Signalling peer ddfe9cca0741489b994f8b0178c54fe7 to start an election
I20260709 13:20:41.251709 23584 raft_consensus.cc:2955] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:41.258349 17521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
 from {username='slave'} at 127.0.0.1:54548
I20260709 13:20:41.259125 17521 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:41.259512 17521 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:41.270771 17521 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:41.286367 17352 catalog_manager.cc:5697] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 8, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 13 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.296398 17521 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Requested vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:41.303102 17600 raft_consensus.cc:2955] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:41.314306 17452 raft_consensus.cc:2955] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:41.316709 17596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:41.317371 17596 raft_consensus.cc:3055] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:41.317667 17596 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:41.318470 17596 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:41.319406 17596 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:41.347093 17596 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:41.348658 23646 ts_tablet_manager.cc:933] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:41.362557 23649 ts_tablet_manager.cc:933] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
I20260709 13:20:41.366918 23649 tablet_copy_client.cc:323] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.65:36303
I20260709 13:20:41.371627 18198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:41.375802 18198 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:41.376744 17463 tablet_copy_service.cc:140] P 0480cf54c3cc424ab94b963ef2ff5bf4: Received BeginTabletCopySession request for tablet f1c40484b7a540a9b32947573409178a from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:47864)
I20260709 13:20:41.377452 17463 tablet_copy_service.cc:161] P 0480cf54c3cc424ab94b963ef2ff5bf4: Beginning new tablet copy session on tablet f1c40484b7a540a9b32947573409178a from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:47864: session id = 2158c0f750fd4b21afe24135c52167b2-f1c40484b7a540a9b32947573409178a
I20260709 13:20:41.374578 23646 tablet_copy_client.cc:323] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:20:41.386121 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet dac17c6792414180963986e500f47356 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:20:41.386693 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet dac17c6792414180963986e500f47356 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-dac17c6792414180963986e500f47356
I20260709 13:20:41.394196 17463 tablet_copy_source_session.cc:215] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:41.397799 17539 tablet_copy_source_session.cc:215] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:20:41.399899 17495 consensus_peers.cc:597] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abb20677645b433e839a2f21c9cc2ef3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:41.419900 17495 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:41.404356 18198 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:41.422323 23584 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:41.432420 23584 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:41.433312 23584 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:41.423645 23653 ts_tablet_manager.cc:933] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:41.426777 23646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac17c6792414180963986e500f47356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.448607 23649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c40484b7a540a9b32947573409178a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.505365 17352 catalog_manager.cc:5697] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 14 to 15, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 15 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.512638 23649 tablet_copy_client.cc:806] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
W20260709 13:20:41.518195 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 61685.9us
I20260709 13:20:41.543530 23649 tablet_copy_client.cc:670] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:41.556594 23646 tablet_copy_client.cc:806] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:41.557305 23646 tablet_copy_client.cc:670] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:41.561378 23649 tablet_copy_client.cc:538] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:41.575834 23653 tablet_copy_client.cc:323] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:20:41.588084 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet 1cf63370ef7f41519349f91e85c42d19 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:20:41.588672 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet 1cf63370ef7f41519349f91e85c42d19 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-1cf63370ef7f41519349f91e85c42d19
I20260709 13:20:41.598289 17539 tablet_copy_source_session.cc:215] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:41.598657 23646 tablet_copy_client.cc:538] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:41.612735 23653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf63370ef7f41519349f91e85c42d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.634200 23649 tablet_bootstrap.cc:492] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:41.656904 23658 ts_tablet_manager.cc:933] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:41.713011 23658 tablet_copy_client.cc:323] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:20:41.717236 23646 tablet_bootstrap.cc:492] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:41.735379 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet abb20677645b433e839a2f21c9cc2ef3 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:20:41.735953 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet abb20677645b433e839a2f21c9cc2ef3 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-abb20677645b433e839a2f21c9cc2ef3
I20260709 13:20:41.746109 17539 tablet_copy_source_session.cc:215] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:41.754005 23658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb20677645b433e839a2f21c9cc2ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.773058 23653 tablet_copy_client.cc:806] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:41.773729 23653 tablet_copy_client.cc:670] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:41.780010 23653 tablet_copy_client.cc:538] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:41.788875 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:41.810556 23653 tablet_bootstrap.cc:492] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:41.824934 23658 tablet_copy_client.cc:806] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:41.827533 23658 tablet_copy_client.cc:670] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:41.842109 23658 tablet_copy_client.cc:538] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:41.865175 23658 tablet_bootstrap.cc:492] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:41.886328 23649 tablet_bootstrap.cc:492] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:41.947579 23649 tablet_bootstrap.cc:492] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:41.950134 23649 ts_tablet_manager.cc:1403] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.316s	user 0.038s	sys 0.013s
I20260709 13:20:41.966429 23649 raft_consensus.cc:359] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:41.967418 23649 raft_consensus.cc:740] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:41.970065 23649 consensus_queue.cc:260] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:41.973620 23649 ts_tablet_manager.cc:1434] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:20:41.981518 18195 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:41.984385 23627 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:42.005504 17463 tablet_copy_service.cc:342] P 0480cf54c3cc424ab94b963ef2ff5bf4: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-f1c40484b7a540a9b32947573409178a received from {username='slave'} at 127.0.0.1:47864
I20260709 13:20:42.005992 17463 tablet_copy_service.cc:434] P 0480cf54c3cc424ab94b963ef2ff5bf4: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-f1c40484b7a540a9b32947573409178a on tablet f1c40484b7a540a9b32947573409178a with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:42.060819 17596 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:42.063762 23627 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:20:42.122773 23658 tablet_bootstrap.cc:492] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=3 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:42.124315 23658 tablet_bootstrap.cc:492] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:42.125116 23658 ts_tablet_manager.cc:1403] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.260s	user 0.055s	sys 0.012s
I20260709 13:20:42.135401 23658 raft_consensus.cc:359] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:42.136363 23658 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:42.137111 23658 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:42.176628 23658 ts_tablet_manager.cc:1434] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 13:20:42.195690 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-abb20677645b433e839a2f21c9cc2ef3 received from {username='slave'} at 127.0.0.1:35586
I20260709 13:20:42.196233 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-abb20677645b433e839a2f21c9cc2ef3 on tablet abb20677645b433e839a2f21c9cc2ef3 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:42.222817 23646 tablet_bootstrap.cc:492] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:42.227274 18195 raft_consensus.cc:1217] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 13:20:42.294536 23646 tablet_bootstrap.cc:492] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:42.327003 23646 ts_tablet_manager.cc:1403] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.610s	user 0.039s	sys 0.022s
I20260709 13:20:42.232404 23653 tablet_bootstrap.cc:492] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:42.330971 23653 tablet_bootstrap.cc:492] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:42.342852 23653 ts_tablet_manager.cc:1403] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.533s	user 0.040s	sys 0.016s
I20260709 13:20:42.343930 23646 raft_consensus.cc:359] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:42.345676 23646 raft_consensus.cc:740] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:42.350692 23646 consensus_queue.cc:260] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:42.353132 23646 ts_tablet_manager.cc:1434] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:20:42.349277 23653 raft_consensus.cc:359] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:42.360713 23653 raft_consensus.cc:740] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:42.361479 23653 consensus_queue.cc:260] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:42.363652 23653 ts_tablet_manager.cc:1434] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:20:42.365865 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-1cf63370ef7f41519349f91e85c42d19 received from {username='slave'} at 127.0.0.1:35586
I20260709 13:20:42.366411 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-1cf63370ef7f41519349f91e85c42d19 on tablet 1cf63370ef7f41519349f91e85c42d19 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:42.368468 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-dac17c6792414180963986e500f47356 received from {username='slave'} at 127.0.0.1:35586
I20260709 13:20:42.368970 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-dac17c6792414180963986e500f47356 on tablet dac17c6792414180963986e500f47356 with peer 2158c0f750fd4b21afe24135c52167b2
W20260709 13:20:42.421171 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 73432.7us
I20260709 13:20:42.480756 18195 raft_consensus.cc:1217] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
W20260709 13:20:42.527769 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 58561.5us
W20260709 13:20:42.658162 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 52380.4us
W20260709 13:20:42.657655 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 54672.8us
I20260709 13:20:42.703299 18195 raft_consensus.cc:1217] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 13:20:42.703833 18196 raft_consensus.cc:1217] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
W20260709 13:20:42.734386 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46334us
W20260709 13:20:42.742367 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 103847us
W20260709 13:20:42.792709 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 55256.6us
W20260709 13:20:42.896437 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 44912.8us
W20260709 13:20:42.914676 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 79045.7us
W20260709 13:20:42.976392 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 199411us
W20260709 13:20:43.003113 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 78484.8us
I20260709 13:20:43.034415 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:43.073565 23627 raft_consensus.cc:1064] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:43.076195 23627 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:43.083811 23584 raft_consensus.cc:1064] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:43.094897 23584 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:43.104229 23674 raft_consensus.cc:1064] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:43.109097 18195 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:43.111064 23681 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:43.110810 23674 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:43.114728 17600 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:43.116457 23624 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:43.135144 18196 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:20:43.177134 17494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.180497 17521 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:43.189497 17596 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:43.196074 23624 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:20:43.211331 23674 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:43.258138 23680 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:43.261334 23631 raft_consensus.cc:2955] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:43.275220 17419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.349717 17445 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:43.351101 17452 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:43.351212 17596 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:43.358180 18196 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:43.393296 17348 catalog_manager.cc:5697] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:43.416208 23584 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:43.419071 23584 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:43.421317 23640 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:43.426630 23697 log.cc:927] Time spent T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:20:43.429909 17602 raft_consensus.cc:2955] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:43.457480 23678 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:20:43.482751 18196 raft_consensus.cc:2955] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:43.533779 23627 raft_consensus.cc:1064] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:43.536492 23627 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:43.577215 17452 raft_consensus.cc:2955] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:43.621148 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 45574.8us
I20260709 13:20:43.761541 23681 raft_consensus.cc:2955] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:43.795912 23678 raft_consensus.cc:2955] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:43.826650 18196 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:43.828338 17597 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:43.826186 17445 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:43.829149 17596 raft_consensus.cc:2955] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:43.834482 18195 raft_consensus.cc:2955] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:43.854465 23631 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:43.859881 17445 raft_consensus.cc:2955] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:43.864594 23631 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:43.865928 17528 raft_consensus.cc:2955] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:43.865880 17602 raft_consensus.cc:2955] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:43.874048 18195 raft_consensus.cc:2955] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:43.890411 23624 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:43.930706 17522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b"
dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
mode: GRACEFUL
new_leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:60446
I20260709 13:20:43.931650 17522 raft_consensus.cc:606] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Received request to transfer leadership to TS abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:43.934847 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:43.949774 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:43.998565 23657 raft_consensus.cc:2955] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.010792 17452 raft_consensus.cc:2955] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.029250 18196 raft_consensus.cc:2955] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.056120 17596 raft_consensus.cc:2955] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.068463 23627 raft_consensus.cc:993] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: : Instructing follower abf46e430b7e4ad4919ca2a717f37e0e to start an election
I20260709 13:20:44.069089 23631 raft_consensus.cc:1081] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Signalling peer abf46e430b7e4ad4919ca2a717f37e0e to start an election
I20260709 13:20:44.071739 17602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
 from {username='slave'} at 127.0.0.1:49554
I20260709 13:20:44.072441 17602 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:44.072795 17602 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:44.061131 17352 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:44.085237 17352 catalog_manager.cc:5697] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 11 to 12, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:44.102324 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 161632us
I20260709 13:20:44.090329 17602 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:44.111277 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:44.112017 17528 raft_consensus.cc:3055] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:44.112352 17528 raft_consensus.cc:740] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:44.112488 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:44.113058 18195 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:44.113186 17528 consensus_queue.cc:260] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:44.115984 17528 raft_consensus.cc:3060] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:44.132685 18195 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
I20260709 13:20:44.141742 17602 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:44.188632 17528 raft_consensus.cc:2468] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
I20260709 13:20:44.144694 17347 catalog_manager.cc:5697] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 8 to 9, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:44.154462 17445 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:44.190287 17568 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:44.191773 23708 raft_consensus.cc:2804] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:44.192835 23708 raft_consensus.cc:697] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:44.193925 23708 consensus_queue.cc:237] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:44.217887 17521 consensus_queue.cc:237] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:44.222048 17527 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:44.217911 17522 consensus_queue.cc:237] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:44.231797 17602 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:44.250907 17596 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:44.253212 17445 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:44.253500 18198 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:44.254531 18195 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:44.256052 18196 raft_consensus.cc:1275] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:20:44.278333 23716 log.cc:927] Time spent T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.064s	user 0.003s	sys 0.006s
I20260709 13:20:44.278731 17352 catalog_manager.cc:5697] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 15 to 16, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 16 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:44.284852 23691 log.cc:927] Time spent T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: Append to log took a long time: real 0.062s	user 0.005s	sys 0.004s
I20260709 13:20:44.286165 23678 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:44.295324 17445 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:44.300637 23706 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:44.304193 18196 raft_consensus.cc:1275] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:44.315903 23657 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:44.318467 23674 raft_consensus.cc:2955] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.345006 23624 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:44.352197 23631 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:44.356950 18196 raft_consensus.cc:2955] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.355669 17596 raft_consensus.cc:2955] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.397665 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f1c40484b7a540a9b32947573409178a with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:44.397061 17352 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 12 to 13, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 14 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.408779 23631 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:44.413383 23631 consensus_queue.cc:1048] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:44.415063 23627 consensus_queue.cc:1048] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:44.431384 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet f1c40484b7a540a9b32947573409178a with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:37162
I20260709 13:20:44.451934 23627 raft_consensus.cc:2955] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.460879 23721 tablet_replica.cc:333] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:44.462531 23721 raft_consensus.cc:2243] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.463531 23721 raft_consensus.cc:2272] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.467343 23721 ts_tablet_manager.cc:1916] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:44.468838 23631 raft_consensus.cc:2955] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.486931 23584 raft_consensus.cc:2955] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.501835 17452 raft_consensus.cc:2955] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.511492 17352 catalog_manager.cc:5697] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 13 to 14, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 17 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.514628 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dac17c6792414180963986e500f47356 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:44.516115 17445 raft_consensus.cc:2955] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.522773 17596 raft_consensus.cc:2955] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.538812 18198 raft_consensus.cc:2955] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.552590 18196 raft_consensus.cc:2955] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.552587 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet dac17c6792414180963986e500f47356 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:56906
I20260709 13:20:44.578778 17347 catalog_manager.cc:5697] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 9 to 10, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 13 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:44.598923 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1cf63370ef7f41519349f91e85c42d19 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:44.603938 17351 catalog_manager.cc:5697] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 16 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:44.612571 17436 tablet_service.cc:1558] Processing DeleteTablet for tablet abb20677645b433e839a2f21c9cc2ef3 with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:55872
I20260709 13:20:44.629462 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet abb20677645b433e839a2f21c9cc2ef3 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:44.704628 18196 raft_consensus.cc:2955] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:44.706228 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 71478.9us
I20260709 13:20:44.727610 23721 ts_tablet_manager.cc:1929] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 13:20:44.728718 23721 log.cc:1199] T f1c40484b7a540a9b32947573409178a P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/f1c40484b7a540a9b32947573409178a
I20260709 13:20:44.730796 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cf63370ef7f41519349f91e85c42d19 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:56906
I20260709 13:20:44.741955 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet f1c40484b7a540a9b32947573409178a (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:44.767237 23723 tablet_replica.cc:333] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:20:44.768450 23723 raft_consensus.cc:2243] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.770960 17523 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:44.773478 23724 tablet_replica.cc:333] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:44.774583 23723 raft_consensus.cc:2272] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.782590 23673 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:44.785420 18195 raft_consensus.cc:1275] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:44.788560 23724 raft_consensus.cc:2243] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.791936 23724 raft_consensus.cc:2272] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.794797 23723 ts_tablet_manager.cc:1916] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:44.797443 23673 consensus_queue.cc:1048] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:44.853035 23724 ts_tablet_manager.cc:1916] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:44.956018 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:44.958285 23723 ts_tablet_manager.cc:1929] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 13:20:44.958797 23723 log.cc:1199] T dac17c6792414180963986e500f47356 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/dac17c6792414180963986e500f47356
I20260709 13:20:44.960659 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet dac17c6792414180963986e500f47356 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:44.961278 23723 tablet_replica.cc:333] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:20:44.972097 23723 raft_consensus.cc:2243] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.973096 23723 raft_consensus.cc:2272] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.979051 23723 ts_tablet_manager.cc:1916] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:45.015496 23723 ts_tablet_manager.cc:1929] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:20:45.015988 23724 ts_tablet_manager.cc:1929] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 13:20:45.018290 23724 log.cc:1199] T abb20677645b433e839a2f21c9cc2ef3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/abb20677645b433e839a2f21c9cc2ef3
I20260709 13:20:45.016010 23723 log.cc:1199] T 1cf63370ef7f41519349f91e85c42d19 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/1cf63370ef7f41519349f91e85c42d19
I20260709 13:20:45.021184 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet 1cf63370ef7f41519349f91e85c42d19 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:45.021920 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet abb20677645b433e839a2f21c9cc2ef3 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
W20260709 13:20:45.471856 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 49231.7us
W20260709 13:20:45.916651 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 45742.6us
I20260709 13:20:46.060672 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:46.092684 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 58211.8us
W20260709 13:20:46.148989 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 51918.6us
W20260709 13:20:46.164680 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 82880us
I20260709 13:20:46.142575 17600 consensus_queue.cc:237] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:46.227702 17602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "810ba5585281416bb8f23e88267d049b"
dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
mode: GRACEFUL
new_leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:42900
I20260709 13:20:46.228382 17602 raft_consensus.cc:606] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Received request to transfer leadership to TS 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:46.230829 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:46.233064 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:20:46.274134 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 103167us
W20260709 13:20:46.276454 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 70085.3us
W20260709 13:20:46.290518 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 57114.2us
I20260709 13:20:46.339372 17527 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:46.342964 23708 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:46.347539 17445 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:20:46.392611 17569 consensus_peers.cc:597] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f16762b5a82d4310ad01b31fd99d5921. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.395100 23738 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:46.396193 23682 raft_consensus.cc:993] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: : Instructing follower 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:46.396723 23726 raft_consensus.cc:1081] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Signalling peer 0480cf54c3cc424ab94b963ef2ff5bf4 to start an election
I20260709 13:20:46.400763 17445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "810ba5585281416bb8f23e88267d049b"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:20:46.401315 17445 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:46.401677 17445 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.408049 23708 raft_consensus.cc:2955] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.421756 17527 raft_consensus.cc:2955] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.420250 17445 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:46.434360 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:46.434996 17523 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.456983 17523 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:20:46.463061 17419 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:46.464208 23736 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:46.463929 17454 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:46.465351 23736 raft_consensus.cc:697] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:46.456892 17352 catalog_manager.cc:5697] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.467240 23736 consensus_queue.cc:237] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:46.489315 17445 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [CANDIDATE]: Term 13 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:46.490761 17600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:46.491412 17600 raft_consensus.cc:3055] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:46.491734 17600 raft_consensus.cc:740] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:46.492525 17600 consensus_queue.cc:260] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:46.494098 17600 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.495929 17347 catalog_manager.cc:5697] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: term changed from 12 to 13, leader changed from abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) to 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65). New cstate: current_term: 13 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:46.503808 17420 consensus_peers.cc:597] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43e1920c304743e78e8b777b3b7ea7f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.507570 17598 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:46.510345 17600 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0480cf54c3cc424ab94b963ef2ff5bf4 in term 13.
I20260709 13:20:46.508255 17452 raft_consensus.cc:2955] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.511620 23706 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:46.528679 17527 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:46.530488 23706 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:46.549566 23736 raft_consensus.cc:2955] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.556056 17523 raft_consensus.cc:2955] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.569322 17598 raft_consensus.cc:2955] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.621490 17598 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:46.645278 17523 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:46.646876 17452 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:20:46.647320 17569 consensus_peers.cc:597] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68e8e6dd889d4bcfabf84cedd079e2f2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.647953 23737 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:46.649608 23738 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:46.672729 23708 raft_consensus.cc:2955] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.679754 17523 raft_consensus.cc:2955] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.734943 17351 catalog_manager.cc:5697] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 15 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.745448 17351 catalog_manager.cc:5697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 16 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.742379 17454 raft_consensus.cc:2955] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.756053 17523 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:46.831293 23753 ts_tablet_manager.cc:933] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:46.862885 23753 tablet_copy_client.cc:323] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:20:46.865231 17613 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet f16762b5a82d4310ad01b31fd99d5921 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:20:46.865829 17613 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet f16762b5a82d4310ad01b31fd99d5921 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-f16762b5a82d4310ad01b31fd99d5921
I20260709 13:20:46.875556 17613 tablet_copy_source_session.cc:215] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:46.879237 17598 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:20:46.881896 17495 consensus_peers.cc:597] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e901a2e51634e18807d1c4292e3f285. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.882143 17452 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:46.891273 23624 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:46.900354 23753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16762b5a82d4310ad01b31fd99d5921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:46.908056 23722 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:46.933806 23627 raft_consensus.cc:2955] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.936885 17597 raft_consensus.cc:2955] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.944082 17454 raft_consensus.cc:2955] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:46.964018 17351 catalog_manager.cc:5697] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 9, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.970849 23753 tablet_copy_client.cc:806] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:46.971627 23753 tablet_copy_client.cc:670] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:46.978425 23753 tablet_copy_client.cc:538] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:46.989346 23753 tablet_bootstrap.cc:492] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:47.011977 17523 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:47.026872 23736 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:47.059931 23758 ts_tablet_manager.cc:933] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303)
I20260709 13:20:47.088594 17598 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:47.092398 23710 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:47.100602 23758 tablet_copy_client.cc:323] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.65:36303
I20260709 13:20:47.103191 17463 tablet_copy_service.cc:140] P 0480cf54c3cc424ab94b963ef2ff5bf4: Received BeginTabletCopySession request for tablet 43e1920c304743e78e8b777b3b7ea7f3 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:47864)
I20260709 13:20:47.103870 17463 tablet_copy_service.cc:161] P 0480cf54c3cc424ab94b963ef2ff5bf4: Beginning new tablet copy session on tablet 43e1920c304743e78e8b777b3b7ea7f3 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:47864: session id = 2158c0f750fd4b21afe24135c52167b2-43e1920c304743e78e8b777b3b7ea7f3
I20260709 13:20:47.141017 17463 tablet_copy_source_session.cc:215] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:47.195094 23758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e1920c304743e78e8b777b3b7ea7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:47.234076 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:47.287672 23758 tablet_copy_client.cc:806] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
W20260709 13:20:47.289095 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 58016.3us
I20260709 13:20:47.298522 23753 tablet_bootstrap.cc:492] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:47.299978 23753 tablet_bootstrap.cc:492] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:47.300822 23753 ts_tablet_manager.cc:1403] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.312s	user 0.022s	sys 0.044s
I20260709 13:20:47.305640 23758 tablet_copy_client.cc:670] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:47.306149 23767 ts_tablet_manager.cc:933] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:47.312813 23753 raft_consensus.cc:359] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:47.315555 23753 raft_consensus.cc:740] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:47.317833 23758 tablet_copy_client.cc:538] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:47.317560 23753 consensus_queue.cc:260] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:47.360121 23753 ts_tablet_manager.cc:1434] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.059s	user 0.000s	sys 0.008s
I20260709 13:20:47.355098 18195 raft_consensus.cc:1217] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:20:47.372400 23767 tablet_copy_client.cc:323] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:20:47.374892 17613 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-f16762b5a82d4310ad01b31fd99d5921 received from {username='slave'} at 127.0.0.1:52572
I20260709 13:20:47.375532 17613 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-f16762b5a82d4310ad01b31fd99d5921 on tablet f16762b5a82d4310ad01b31fd99d5921 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:47.375614 17612 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet 68e8e6dd889d4bcfabf84cedd079e2f2 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:20:47.376258 17612 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet 68e8e6dd889d4bcfabf84cedd079e2f2 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-68e8e6dd889d4bcfabf84cedd079e2f2
I20260709 13:20:47.379690 23769 ts_tablet_manager.cc:933] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:47.392131 23758 tablet_bootstrap.cc:492] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:47.394997 17612 tablet_copy_source_session.cc:215] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:47.412417 23767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e8e6dd889d4bcfabf84cedd079e2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:47.422457 23769 tablet_copy_client.cc:323] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.66:40943
I20260709 13:20:47.424701 17539 tablet_copy_service.cc:140] P ddfe9cca0741489b994f8b0178c54fe7: Received BeginTabletCopySession request for tablet 8e901a2e51634e18807d1c4292e3f285 from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:35586)
I20260709 13:20:47.425339 17539 tablet_copy_service.cc:161] P ddfe9cca0741489b994f8b0178c54fe7: Beginning new tablet copy session on tablet 8e901a2e51634e18807d1c4292e3f285 from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:35586: session id = 2158c0f750fd4b21afe24135c52167b2-8e901a2e51634e18807d1c4292e3f285
I20260709 13:20:47.436173 17539 tablet_copy_source_session.cc:215] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:47.441352 23769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e901a2e51634e18807d1c4292e3f285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:47.499044 23769 tablet_copy_client.cc:806] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:47.499732 23769 tablet_copy_client.cc:670] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:47.504575 23769 tablet_copy_client.cc:538] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:47.521577 23767 tablet_copy_client.cc:806] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:47.522789 23767 tablet_copy_client.cc:670] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:47.525216 23769 tablet_bootstrap.cc:492] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:47.526945 23767 tablet_copy_client.cc:538] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:47.549685 23767 tablet_bootstrap.cc:492] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:47.664479 23769 tablet_bootstrap.cc:492] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:47.665829 23769 tablet_bootstrap.cc:492] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:47.666695 23769 ts_tablet_manager.cc:1403] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.142s	user 0.036s	sys 0.064s
I20260709 13:20:47.670107 23769 raft_consensus.cc:359] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:47.671118 23769 raft_consensus.cc:740] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:47.671885 23769 consensus_queue.cc:260] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:47.675108 23769 ts_tablet_manager.cc:1434] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:20:47.680311 17539 tablet_copy_service.cc:342] P ddfe9cca0741489b994f8b0178c54fe7: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-8e901a2e51634e18807d1c4292e3f285 received from {username='slave'} at 127.0.0.1:35586
I20260709 13:20:47.680874 17539 tablet_copy_service.cc:434] P ddfe9cca0741489b994f8b0178c54fe7: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-8e901a2e51634e18807d1c4292e3f285 on tablet 8e901a2e51634e18807d1c4292e3f285 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:47.689409 23758 tablet_bootstrap.cc:492] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:47.695362 23758 tablet_bootstrap.cc:492] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:47.696242 23758 ts_tablet_manager.cc:1403] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.304s	user 0.035s	sys 0.023s
I20260709 13:20:47.705874 23758 raft_consensus.cc:359] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:47.706845 23758 raft_consensus.cc:740] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:47.718183 23758 consensus_queue.cc:260] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:47.730594 23758 ts_tablet_manager.cc:1434] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:20:47.737702 17463 tablet_copy_service.cc:342] P 0480cf54c3cc424ab94b963ef2ff5bf4: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-43e1920c304743e78e8b777b3b7ea7f3 received from {username='slave'} at 127.0.0.1:47864
I20260709 13:20:47.738253 17463 tablet_copy_service.cc:434] P 0480cf54c3cc424ab94b963ef2ff5bf4: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-43e1920c304743e78e8b777b3b7ea7f3 on tablet 43e1920c304743e78e8b777b3b7ea7f3 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:47.744946 23767 tablet_bootstrap.cc:492] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:47.746394 23767 tablet_bootstrap.cc:492] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:47.747229 23767 ts_tablet_manager.cc:1403] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.198s	user 0.062s	sys 0.014s
I20260709 13:20:47.752170 23767 raft_consensus.cc:359] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:47.753074 23767 raft_consensus.cc:740] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:47.753870 23767 consensus_queue.cc:260] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:47.776079 23767 ts_tablet_manager.cc:1434] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:20:47.780298 17612 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-68e8e6dd889d4bcfabf84cedd079e2f2 received from {username='slave'} at 127.0.0.1:52572
I20260709 13:20:47.780807 17612 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-68e8e6dd889d4bcfabf84cedd079e2f2 on tablet 68e8e6dd889d4bcfabf84cedd079e2f2 with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:47.787642 18195 raft_consensus.cc:1217] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:20:47.828547 23737 raft_consensus.cc:1064] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:47.838796 23737 consensus_queue.cc:237] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:47.881076 18195 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:47.884634 23776 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:47.897662 17448 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:47.908766 17522 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:47.913424 23779 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:47.929695 23738 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:47.939491 18196 raft_consensus.cc:1217] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
W20260709 13:20:47.963230 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 49716.4us
W20260709 13:20:47.963888 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 52805.4us
W20260709 13:20:47.966538 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 45151us
W20260709 13:20:48.036433 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 61214.7us
I20260709 13:20:48.048400 23781 raft_consensus.cc:2955] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.053123 17522 raft_consensus.cc:2955] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.102240 18195 raft_consensus.cc:2955] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.100438 17351 catalog_manager.cc:5697] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.128865 17448 raft_consensus.cc:2955] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } attrs { replace: true } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.170245 18196 raft_consensus.cc:1217] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:20:48.299181 17598 consensus_queue.cc:237] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:48.348778 18198 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:48.349298 17452 raft_consensus.cc:1275] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:48.355671 23738 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:48.359391 23738 consensus_queue.cc:1048] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:20:48.369786 23627 raft_consensus.cc:1064] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:48.372262 23627 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:48.380465 23776 raft_consensus.cc:1064] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:48.383533 23776 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:48.394629 18195 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEARNER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:48.396297 23722 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:48.398113 23783 raft_consensus.cc:2955] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.410753 17597 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:48.413486 17448 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:48.413920 23722 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:48.415143 23627 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:48.430130 17527 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:48.432333 23738 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:48.432912 17452 raft_consensus.cc:2955] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.437585 18195 raft_consensus.cc:2955] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.452481 17352 catalog_manager.cc:5697] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 10 to 11, VOTER ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) evicted. New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.457233 23627 raft_consensus.cc:2955] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.459329 17596 raft_consensus.cc:2955] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.486120 18198 raft_consensus.cc:2955] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.494503 17515 tablet_service.cc:1558] Processing DeleteTablet for tablet f16762b5a82d4310ad01b31fd99d5921 with delete_type TABLET_DATA_TOMBSTONED (TS ddfe9cca0741489b994f8b0178c54fe7 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:37162
I20260709 13:20:48.503465 18196 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:48.503492 17452 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:48.511574 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:48.514015 23798 tablet_replica.cc:333] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:48.518775 23798 raft_consensus.cc:2243] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.519804 23798 raft_consensus.cc:2272] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.531682 23798 ts_tablet_manager.cc:1916] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:48.509614 17352 catalog_manager.cc:5697] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:48.540140 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 47916.6us
I20260709 13:20:48.546258 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f16762b5a82d4310ad01b31fd99d5921 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:48.560412 17452 raft_consensus.cc:2955] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.586253 23738 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:48.581862 23710 raft_consensus.cc:1064] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:48.604553 23737 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:48.632340 23710 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:48.641427 17527 consensus_queue.cc:237] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:48.672150 23779 raft_consensus.cc:2955] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.683003 18195 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:48.685803 23627 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:48.685500 17448 raft_consensus.cc:2955] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.689375 17445 raft_consensus.cc:1275] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:48.700238 23624 raft_consensus.cc:2955] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.736033 18196 raft_consensus.cc:2955] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.740096 23798 ts_tablet_manager.cc:1929] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:20:48.743175 17352 catalog_manager.cc:5697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:48.745590 23722 consensus_queue.cc:1048] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:48.751087 17527 raft_consensus.cc:2955] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:48.785404 17338 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e901a2e51634e18807d1c4292e3f285 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:48.770409 23798 log.cc:1199] T f16762b5a82d4310ad01b31fd99d5921 P ddfe9cca0741489b994f8b0178c54fe7: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/wals/f16762b5a82d4310ad01b31fd99d5921
I20260709 13:20:48.809595 17338 catalog_manager.cc:5028] TS ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): tablet f16762b5a82d4310ad01b31fd99d5921 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:48.807821 17347 catalog_manager.cc:5697] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: config changed from index 10 to 11, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:48.866277 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 99386.8us
I20260709 13:20:48.874770 17448 raft_consensus.cc:2955] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
W20260709 13:20:48.907588 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 47535.6us
W20260709 13:20:48.979194 23797 log.cc:927] Time spent T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:48.984257 17448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9"
dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
mode: GRACEFUL
new_leader_uuid: "2158c0f750fd4b21afe24135c52167b2"
 from {username='slave'} at 127.0.0.1:43246
W20260709 13:20:48.984479 17419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 89182.6us
I20260709 13:20:48.984935 17448 raft_consensus.cc:606] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 19 LEADER]: Received request to transfer leadership to TS 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:48.989491 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 13:20:49.010190 23789 log.cc:927] Time spent T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:49.014276 18196 raft_consensus.cc:2955] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.051718 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:49.065847 17527 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:49.071993 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e901a2e51634e18807d1c4292e3f285 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:56906
I20260709 13:20:49.087673 23786 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:49.090148 17603 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:49.092202 23786 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:49.105731 18196 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEARNER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:49.137725 23766 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:49.138439 17603 consensus_queue.cc:237] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:49.167140 23816 tablet_replica.cc:333] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:20:49.169073 23816 raft_consensus.cc:2243] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.174769 23816 raft_consensus.cc:2272] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.177525 17528 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:49.181962 18201 raft_consensus.cc:1275] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:49.189955 23781 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:20:49.206342 23808 consensus_queue.cc:1048] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:20:49.209767 23816 ts_tablet_manager.cc:1916] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:49.216289 23779 raft_consensus.cc:2955] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.231739 23786 raft_consensus.cc:2955] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.235949 17527 raft_consensus.cc:2955] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.250559 17528 raft_consensus.cc:2955] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.257933 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 68e8e6dd889d4bcfabf84cedd079e2f2 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:49.265765 18196 raft_consensus.cc:2955] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.266701 17347 catalog_manager.cc:5697] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 11 to 12, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 16 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.266918 18195 raft_consensus.cc:2955] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.333550 17436 tablet_service.cc:1558] Processing DeleteTablet for tablet 68e8e6dd889d4bcfabf84cedd079e2f2 with delete_type TABLET_DATA_TOMBSTONED (TS 0480cf54c3cc424ab94b963ef2ff5bf4 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:55872
I20260709 13:20:49.350368 17597 raft_consensus.cc:2955] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.354967 23820 tablet_replica.cc:333] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:49.358793 17347 catalog_manager.cc:5697] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } attrs { replace: true } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.388284 23816 ts_tablet_manager.cc:1929] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 13:20:49.392884 23816 log.cc:1199] T 8e901a2e51634e18807d1c4292e3f285 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/8e901a2e51634e18807d1c4292e3f285
I20260709 13:20:49.399195 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet 8e901a2e51634e18807d1c4292e3f285 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:49.466624 23786 raft_consensus.cc:993] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: : Instructing follower 2158c0f750fd4b21afe24135c52167b2 to start an election
I20260709 13:20:49.467188 23786 raft_consensus.cc:1081] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 19 LEADER]: Signalling peer 2158c0f750fd4b21afe24135c52167b2 to start an election
I20260709 13:20:49.476421 18201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9"
dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
 from {username='slave'} at 127.0.0.1:42538
I20260709 13:20:49.477263 18201 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:49.480602 18201 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:49.502411 17452 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:49.507169 23820 raft_consensus.cc:2243] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.519423 23820 raft_consensus.cc:2272] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.540560 17528 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:49.546913 23804 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:20:49.564412 23820 ts_tablet_manager.cc:1916] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:49.574085 18201 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:49.581650 18201 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 20 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:49.582357 17445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4"
I20260709 13:20:49.582973 17445 raft_consensus.cc:3055] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:49.583248 17445 raft_consensus.cc:740] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0480cf54c3cc424ab94b963ef2ff5bf4, State: Running, Role: LEADER
I20260709 13:20:49.583992 17445 consensus_queue.cc:260] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:49.585345 18201 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Refusing update from remote peer 0480cf54c3cc424ab94b963ef2ff5bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:49.593015 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:49.593892 17528 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:49.585858 17445 raft_consensus.cc:3060] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:49.602236 23804 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:49.626639 17528 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 20.
I20260709 13:20:49.628443 18166 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:49.629529 23782 raft_consensus.cc:2804] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:49.634627 23820 ts_tablet_manager.cc:1929] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:20:49.635241 23820 log.cc:1199] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 0480cf54c3cc424ab94b963ef2ff5bf4: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/wals/68e8e6dd889d4bcfabf84cedd079e2f2
I20260709 13:20:49.635390 23782 raft_consensus.cc:697] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 20 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:20:49.636480 23782 consensus_queue.cc:237] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:49.638188 17339 catalog_manager.cc:5028] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): tablet 68e8e6dd889d4bcfabf84cedd079e2f2 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:49.638443 23786 raft_consensus.cc:2955] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.625604 17445 raft_consensus.cc:2468] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 20.
I20260709 13:20:49.645116 17527 raft_consensus.cc:2955] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.650875 18201 raft_consensus.cc:2955] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:49.656617 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 43e1920c304743e78e8b777b3b7ea7f3 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:49.676362 17347 catalog_manager.cc:5697] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 19 to 20, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 20 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.673733 17348 catalog_manager.cc:5697] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 reported cstate change: config changed from index 11 to 12, VOTER abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67) evicted. New cstate: current_term: 15 leader_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.708243 17592 tablet_service.cc:1558] Processing DeleteTablet for tablet 43e1920c304743e78e8b777b3b7ea7f3 with delete_type TABLET_DATA_TOMBSTONED (TS abf46e430b7e4ad4919ca2a717f37e0e not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:56906
I20260709 13:20:49.709362 23816 tablet_replica.cc:333] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:20:49.710438 23816 raft_consensus.cc:2243] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.711303 23816 raft_consensus.cc:2272] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.716130 23816 ts_tablet_manager.cc:1916] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:49.765304 23816 ts_tablet_manager.cc:1929] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:20:49.765753 23816 log.cc:1199] T 43e1920c304743e78e8b777b3b7ea7f3 P abf46e430b7e4ad4919ca2a717f37e0e: Deleting WAL directory at /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/wals/43e1920c304743e78e8b777b3b7ea7f3
I20260709 13:20:49.767889 17339 catalog_manager.cc:5028] TS abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): tablet 43e1920c304743e78e8b777b3b7ea7f3 (table test-workload [id=9e0ca530c8f24d2098eb9de7d39a4487]) successfully deleted
I20260709 13:20:50.048345 17445 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 20 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:50.050397 23811 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:50.052819 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:50.075779 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 60985.9us
I20260709 13:20:50.125818 17528 raft_consensus.cc:1275] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 20 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:50.133013 23782 consensus_queue.cc:1048] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:50.197464 16329 tablet_server.cc:179] TabletServer@127.15.242.65:0 shutting down...
W20260709 13:20:50.196163 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 46259.3us
W20260709 13:20:50.212747 17569 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:50.260274 17420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 47591.4us
W20260709 13:20:50.317924 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 69345.5us
W20260709 13:20:50.352311 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 139589us
W20260709 13:20:50.348950 18167 consensus_peers.cc:597] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.354045 18167 consensus_peers.cc:597] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.365486 18167 consensus_peers.cc:597] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.366109 18167 consensus_peers.cc:597] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.381003 17495 consensus_peers.cc:597] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.390666 17495 consensus_peers.cc:597] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.391376 17495 consensus_peers.cc:597] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.397912 17495 consensus_peers.cc:597] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.404145 17569 consensus_peers.cc:597] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.406725 17495 consensus_peers.cc:597] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.426658 18167 consensus_peers.cc:597] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.437386 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:50.438540 16329 tablet_replica.cc:333] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.439428 16329 raft_consensus.cc:2243] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.440356 16329 raft_consensus.cc:2272] T dac17c6792414180963986e500f47356 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.443035 16329 tablet_replica.cc:333] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.443876 16329 raft_consensus.cc:2243] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.444929 16329 raft_consensus.cc:2272] T 7398c91e7a884284a8b806d47551eaf7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:50.450079 17495 consensus_peers.cc:597] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.449995 17569 consensus_peers.cc:597] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.451234 17569 consensus_peers.cc:597] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.452657 16329 tablet_replica.cc:333] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
W20260709 13:20:50.452773 17569 consensus_peers.cc:597] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.453604 16329 raft_consensus.cc:2243] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.454679 16329 raft_consensus.cc:2272] T 43e1920c304743e78e8b777b3b7ea7f3 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:50.455947 18167 consensus_peers.cc:597] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.456444 17569 consensus_peers.cc:597] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.458609 17569 consensus_peers.cc:597] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.461714 17569 consensus_peers.cc:597] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.463769 16329 tablet_replica.cc:333] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.465116 16329 raft_consensus.cc:2243] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.466588 16329 raft_consensus.cc:2272] T 36043ed9ab7c47e9882fa33c5c135545 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.477212 16329 tablet_replica.cc:333] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.478113 16329 raft_consensus.cc:2243] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.478835 16329 raft_consensus.cc:2272] T 777822978f904e159194479932f1936f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.481168 16329 tablet_replica.cc:333] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.481755 16329 raft_consensus.cc:2243] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.482414 16329 raft_consensus.cc:2272] T 45a13c485c0a480f8ce9eb1282cb6d01 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.487708 16329 tablet_replica.cc:333] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.488613 16329 raft_consensus.cc:2243] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.489717 16329 raft_consensus.cc:2272] T a851f7fe7702439a9a695c117b09f6ae P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.492574 16329 tablet_replica.cc:333] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
W20260709 13:20:50.496523 17569 consensus_peers.cc:597] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.497684 16329 raft_consensus.cc:2243] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.498374 16329 raft_consensus.cc:2272] T 12ca126b355348958188e14e8b1c7470 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.503080 16329 tablet_replica.cc:333] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.504055 16329 raft_consensus.cc:2243] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.504739 16329 raft_consensus.cc:2272] T 0c6864e5b711423291c531e98224c311 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.508255 16329 tablet_replica.cc:333] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.509107 16329 raft_consensus.cc:2243] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.509775 16329 raft_consensus.cc:2272] T 1cf63370ef7f41519349f91e85c42d19 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.512550 16329 tablet_replica.cc:333] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.513454 16329 raft_consensus.cc:2243] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.514797 16329 raft_consensus.cc:2272] T 8fad2b3d8f774d4ca47be967955fb28b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.517840 16329 tablet_replica.cc:333] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.518725 16329 raft_consensus.cc:2243] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.519397 16329 raft_consensus.cc:2272] T 8e901a2e51634e18807d1c4292e3f285 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.524847 16329 tablet_replica.cc:333] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.527300 16329 raft_consensus.cc:2243] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.528467 16329 raft_consensus.cc:2272] T 6b3434da716f41f0bc0eb393a53152ed P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.531606 16329 tablet_replica.cc:333] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.532598 16329 raft_consensus.cc:2243] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:20:50.533823 17495 consensus_peers.cc:597] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.533846 16329 raft_consensus.cc:2272] T bea493621f1e42c2b8689859233cc798 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.549623 16329 tablet_replica.cc:333] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.550606 16329 raft_consensus.cc:2243] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.551790 16329 raft_consensus.cc:2272] T cb3ad3ce4b124497a737d40423bea33d P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.554863 16329 tablet_replica.cc:333] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.555852 16329 raft_consensus.cc:2243] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.556985 16329 raft_consensus.cc:2272] T cb985f82c610405fb3774fe99cf142e7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.560086 16329 tablet_replica.cc:333] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.561013 16329 raft_consensus.cc:2243] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.561678 16329 raft_consensus.cc:2272] T e072fa9bcaa24490bd884d56ff245e5f P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.567982 16329 tablet_replica.cc:333] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.568783 16329 raft_consensus.cc:2243] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.569376 16329 raft_consensus.cc:2272] T a372191e02cc468bbc747310e2818f07 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.574084 16329 tablet_replica.cc:333] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
W20260709 13:20:50.574365 17569 consensus_peers.cc:597] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.575425 16329 raft_consensus.cc:2243] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.576632 16329 raft_consensus.cc:2272] T 2edee9f2356c4e878f2e11af63e46ab9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.595310 16329 tablet_replica.cc:333] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.596135 16329 raft_consensus.cc:2243] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:50.599574 17569 consensus_peers.cc:597] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.597031 16329 raft_consensus.cc:2272] T 1b89997d0ecd4f03a927078433a85a66 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.608929 16329 tablet_replica.cc:333] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.609947 16329 raft_consensus.cc:2243] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:50.614943 17495 consensus_peers.cc:597] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.610653 16329 raft_consensus.cc:2272] T dcd29f6044f6485580736010a0122d2b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.620054 16329 tablet_replica.cc:333] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.620983 16329 raft_consensus.cc:2243] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.622174 16329 raft_consensus.cc:2272] T 858a1d920b5540b3b9107201e3b32d46 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.638199 16329 tablet_replica.cc:333] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.639187 16329 raft_consensus.cc:2243] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.640331 16329 raft_consensus.cc:2272] T be6cfcb1338b4398b769f6956792bdd7 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.643285 16329 tablet_replica.cc:333] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.644153 16329 raft_consensus.cc:2243] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.645292 16329 raft_consensus.cc:2272] T 14b4916b36c24c9bb0562a70795b8ed1 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.648244 16329 tablet_replica.cc:333] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.649055 16329 raft_consensus.cc:2243] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.649631 16329 raft_consensus.cc:2272] T 8999fe04fedd4bcc9305446ba6f99d23 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:50.649726 17495 consensus_peers.cc:597] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.680917 16329 tablet_replica.cc:333] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.681834 16329 raft_consensus.cc:2243] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.682569 16329 raft_consensus.cc:2272] T d4f2604c78c341a88d17d653b9abcbda P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:50.696226 18167 consensus_peers.cc:597] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.706987 17495 consensus_peers.cc:597] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.712469 16329 tablet_replica.cc:333] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
W20260709 13:20:50.713336 18167 consensus_peers.cc:597] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.714148 18167 consensus_peers.cc:597] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.713438 16329 raft_consensus.cc:2243] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.716897 16329 raft_consensus.cc:2272] T 9d6cb82d38034da9b7efa624d5ed7744 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.724833 16329 tablet_replica.cc:333] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.726094 16329 raft_consensus.cc:2243] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.726903 16329 raft_consensus.cc:2272] T c159f64326b74a248a65dc1dae5c79a0 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.741066 16329 tablet_replica.cc:333] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.742079 16329 raft_consensus.cc:2243] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.743358 16329 raft_consensus.cc:2272] T f1c40484b7a540a9b32947573409178a P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.746134 16329 tablet_replica.cc:333] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.747117 16329 raft_consensus.cc:2243] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.748045 16329 raft_consensus.cc:2272] T 3dfacd1c614b49b290b54a86d3270339 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.763177 16329 tablet_replica.cc:333] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.774811 16329 raft_consensus.cc:2243] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:50.771273 17495 consensus_peers.cc:597] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.775660 16329 raft_consensus.cc:2272] T d0843b162ea34017b0c1243e97245db9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.781347 16329 tablet_replica.cc:333] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.782363 16329 raft_consensus.cc:2243] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.788689 16329 raft_consensus.cc:2272] T 0c198fb42e5b400c91f60d6969641780 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.800843 16329 tablet_replica.cc:333] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.802627 16329 raft_consensus.cc:2243] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.811115 16329 raft_consensus.cc:2272] T ea190a19aed74ffea2c29fa8c13edeac P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.814474 16329 tablet_replica.cc:333] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.822726 16329 raft_consensus.cc:2243] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.824201 16329 raft_consensus.cc:2272] T 916155438d0e450f9fdbbb449eee2721 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.839700 16329 tablet_replica.cc:333] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.840565 16329 raft_consensus.cc:2243] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.850420 16329 raft_consensus.cc:2272] T 4022f7d9b64e45d18be29fda16f3ecde P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.853314 16329 tablet_replica.cc:333] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.854329 16329 raft_consensus.cc:2243] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.855235 16329 raft_consensus.cc:2272] T f16762b5a82d4310ad01b31fd99d5921 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.858263 16329 tablet_replica.cc:333] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.859192 16329 raft_consensus.cc:2243] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.860241 16329 raft_consensus.cc:2272] T ec32c18bcdaa4eca99f08bba98bb1e0e P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.863315 16329 tablet_replica.cc:333] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.864221 16329 raft_consensus.cc:2243] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.864909 16329 raft_consensus.cc:2272] T 306df9e1a44b411595f67a918d6a7a14 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.874706 16329 tablet_replica.cc:333] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.880889 16329 raft_consensus.cc:2243] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.881779 16329 raft_consensus.cc:2272] T 0c221353c2c64e8b96d73953eebea083 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.885020 16329 tablet_replica.cc:333] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.888599 16329 raft_consensus.cc:2243] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.889432 16329 raft_consensus.cc:2272] T 4efb13f5c64447d2bbcbef8bc568f882 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.892166 16329 tablet_replica.cc:333] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.902686 16329 raft_consensus.cc:2243] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.903750 16329 raft_consensus.cc:2272] T 7002e0c7a3624420a1737b1fb29d8142 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.906883 16329 tablet_replica.cc:333] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.907747 16329 raft_consensus.cc:2243] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.908957 16329 raft_consensus.cc:2272] T 42a91336a4f94e5db0ce4fa334e9bd37 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.925856 16329 tablet_replica.cc:333] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.928597 17597 consensus_queue.cc:237] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:50.930243 16329 raft_consensus.cc:2243] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:50.931825 16329 raft_consensus.cc:2272] T 545b345ea8d04e8daea29d4a4f6477a9 P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.941993 16329 tablet_replica.cc:333] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.944618 16329 raft_consensus.cc:2243] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.946563 16329 raft_consensus.cc:2272] T 810ba5585281416bb8f23e88267d049b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:50.959370 16329 tablet_replica.cc:333] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4: stopping tablet replica
I20260709 13:20:50.961524 16329 raft_consensus.cc:2243] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:50.963527 16329 raft_consensus.cc:2272] T cf597fe63db446f38a58bcbc792dd49b P 0480cf54c3cc424ab94b963ef2ff5bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:51.067269 17527 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:51.069226 23737 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:51.097710 23829 raft_consensus.cc:2955] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:20:51.107970 17569 consensus_peers.cc:597] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313): Couldn't send request to peer 2158c0f750fd4b21afe24135c52167b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4022f7d9b64e45d18be29fda16f3ecde. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:51.128191 17521 raft_consensus.cc:2955] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
W20260709 13:20:51.153404 17569 consensus_peers.cc:597] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:51.160800 17352 catalog_manager.cc:5697] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index -1 to 10, NON_VOTER 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) added. New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } } }
I20260709 13:20:51.646621 23852 ts_tablet_manager.cc:933] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2: Initiating tablet copy from peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:51.688776 23852 tablet_copy_client.cc:323] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.67:36581
I20260709 13:20:51.691354 17612 tablet_copy_service.cc:140] P abf46e430b7e4ad4919ca2a717f37e0e: Received BeginTabletCopySession request for tablet 4022f7d9b64e45d18be29fda16f3ecde from peer 2158c0f750fd4b21afe24135c52167b2 ({username='slave'} at 127.0.0.1:52572)
I20260709 13:20:51.691965 17612 tablet_copy_service.cc:161] P abf46e430b7e4ad4919ca2a717f37e0e: Beginning new tablet copy session on tablet 4022f7d9b64e45d18be29fda16f3ecde from peer 2158c0f750fd4b21afe24135c52167b2 at {username='slave'} at 127.0.0.1:52572: session id = 2158c0f750fd4b21afe24135c52167b2-4022f7d9b64e45d18be29fda16f3ecde
I20260709 13:20:51.701138 17612 tablet_copy_source_session.cc:215] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:51.710295 23852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4022f7d9b64e45d18be29fda16f3ecde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:51.736763 23627 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.737812 23627 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:51.742206 23627 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:51.746651 23627 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.746937 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:51.747123 23627 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:51.749099 23627 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:51.756770 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:51.763793 23782 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.764444 23782 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:51.766525 17495 leader_election.cc:336] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.766979 17495 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:51.767061 23782 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:51.767752 23627 raft_consensus.cc:2749] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:51.769443 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:20:51.771317 17495 leader_election.cc:336] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.771813 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:51.773639 23627 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:51.775223 18167 leader_election.cc:336] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.775753 18167 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:51.776955 23782 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:51.786134 23782 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.786712 23782 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:51.789047 23782 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:51.795583 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:20:51.796048 18167 leader_election.cc:336] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.796346 17521 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 15.
I20260709 13:20:51.797907 18166 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:51.799172 23811 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.799348 23780 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:51.799791 23780 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.799767 23811 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:51.800369 23780 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:51.807520 23811 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:51.810875 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:51.813633 23852 tablet_copy_client.cc:806] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:51.814329 23852 tablet_copy_client.cc:670] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Starting download of 1 WAL segments...
W20260709 13:20:51.820603 18167 leader_election.cc:336] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.821604 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:51.822402 23811 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:51.836525 23852 tablet_copy_client.cc:538] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:51.872046 23852 tablet_bootstrap.cc:492] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2: Bootstrap starting.
I20260709 13:20:51.824117 23780 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:51.882203 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:51.883070 17521 raft_consensus.cc:3060] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:51.883298 23843 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.883946 23843 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:51.888274 23627 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.889053 23627 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:51.890893 23627 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:51.891147 23781 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.891721 23781 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:51.897992 23829 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.898687 23829 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:51.899951 17521 raft_consensus.cc:2468] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 16.
I20260709 13:20:51.900769 23829 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:51.901321 18166 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:51.902339 23854 raft_consensus.cc:2804] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:51.906405 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:51.907951 23802 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.908619 23802 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:51.910579 23854 raft_consensus.cc:697] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:20:51.911922 23854 consensus_queue.cc:237] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:51.919466 17569 leader_election.cc:336] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.915143 23846 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.920166 23846 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:51.912698 23780 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:51.893855 23781 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:51.922436 23846 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:51.923053 23846 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.923457 23802 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:51.923581 23846 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:51.924073 23802 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.924585 23802 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:51.921788 23843 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:51.922472 23781 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.926621 23781 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:51.927421 18167 leader_election.cc:336] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.928372 23802 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:51.929165 23781 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:51.925848 23846 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:51.932938 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:51.941031 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:51.941244 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:51.942124 18196 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 18.
I20260709 13:20:51.943202 17347 catalog_manager.cc:5697] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 15 to 16, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 16 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:51.949157 23854 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.949906 23854 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:51.951246 17569 leader_election.cc:336] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:51.951866 17569 leader_election.cc:336] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.956775 23780 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.957576 23780 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:51.959211 18167 leader_election.cc:336] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.961953 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:51.963347 17569 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:20:51.962854 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 57869.4us
I20260709 13:20:51.953900 23854 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:51.965543 23780 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:51.978623 17568 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:51.972074 23857 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.979445 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:51.980271 17602 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 12.
I20260709 13:20:51.980131 23857 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:51.973775 18167 leader_election.cc:336] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.975567 23782 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:20:51.978612 17569 leader_election.cc:336] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.963191 23843 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:51.983443 17569 leader_election.cc:336] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.983532 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:51.984254 17602 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
W20260709 13:20:51.984350 17569 leader_election.cc:336] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:51.983100 23829 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:51.986979 23829 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:51.987365 23857 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:51.987430 23829 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:51.988109 23782 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:51.990628 23782 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:51.987519 23781 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:51.991844 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:51.999119 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:51.999883 17527 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
I20260709 13:20:52.001832 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:52.002524 17527 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:52.004136 23829 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.006680 23857 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.007421 23857 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.009348 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:52.010113 17527 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:20:52.010381 23857 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:52.011318 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:52.011952 18196 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
I20260709 13:20:51.993083 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:20:52.014664 17569 leader_election.cc:336] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:52.013075 18167 leader_election.cc:336] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.015290 23802 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:52.015738 23802 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.016131 23802 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:52.017803 17569 leader_election.cc:336] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.023198 18166 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:52.024418 23780 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:52.025199 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:52.028385 17569 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:52.029211 23857 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:52.029595 23857 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.029938 23857 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.026990 23856 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.038581 23856 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.025863 23829 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 19 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:52.042464 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:52.043131 18196 raft_consensus.cc:3060] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:52.043051 23802 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.047588 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:52.048002 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:52.048595 17597 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 14.
I20260709 13:20:52.049227 23855 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:52.049835 23855 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.050338 23855 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.053212 17568 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:52.053274 18167 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:52.055610 23782 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:52.055940 23861 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:52.056464 23861 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.056914 23861 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:52.055986 23782 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.058609 23782 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.060168 23802 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:52.070329 23856 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:52.072242 23857 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.078191 17602 raft_consensus.cc:2393] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 17: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:20:52.078532 17495 leader_election.cc:336] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.079188 17495 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:52.079371 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:52.080022 17527 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:20:52.080415 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:52.081590 23627 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.082369 23627 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.085400 18196 raft_consensus.cc:2468] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 19.
I20260709 13:20:52.085999 23627 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:52.087265 23627 raft_consensus.cc:2749] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:52.087852 23627 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.088272 23627 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.090212 23627 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:52.088227 17569 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:20:52.091774 17569 leader_election.cc:336] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.093001 23829 raft_consensus.cc:2804] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:52.093196 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:52.073570 17568 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:52.102541 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:52.104388 18196 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
I20260709 13:20:52.102829 23843 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:52.105849 17495 leader_election.cc:336] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:52.107232 17495 leader_election.cc:336] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.093693 23829 raft_consensus.cc:697] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:52.105245 23843 raft_consensus.cc:493] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.116416 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:52.116111 23843 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:52.119292 17569 leader_election.cc:336] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.120424 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:52.121186 23781 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:52.124461 23865 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:52.124931 23865 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.125275 23865 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.130053 23861 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.130548 23829 consensus_queue.cc:237] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.131474 17602 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 13: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:52.132421 23861 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:52.134982 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:20:52.135154 17495 leader_election.cc:336] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.137115 23857 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:52.135635 17603 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
W20260709 13:20:52.178797 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 105316us
I20260709 13:20:52.179661 17568 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:52.180446 23861 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:52.180352 23843 raft_consensus.cc:515] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.146232 23780 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.180949 23861 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.184448 23861 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.184341 23780 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.185832 23843 leader_election.cc:290] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:52.181113 17568 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:52.190043 23855 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.186620 23780 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:52.193740 23781 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.194420 23781 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:52.195122 16329 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 17475)
I20260709 13:20:52.196054 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:52.196709 23781 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:52.198624 23782 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.200137 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6cb82d38034da9b7efa624d5ed7744" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:52.200855 23782 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:52.201007 17528 raft_consensus.cc:3060] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.185552 23865 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.196735 17603 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 16.
I20260709 13:20:52.202230 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:52.209174 17528 raft_consensus.cc:2468] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:20:52.210278 17527 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 13: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:20:52.211973 17568 leader_election.cc:304] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:52.213866 23846 raft_consensus.cc:2804] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:52.214622 23846 raft_consensus.cc:697] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:52.215401 18167 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:52.215550 23846 consensus_queue.cc:237] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.216323 23782 raft_consensus.cc:3060] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.217139 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
W20260709 13:20:52.218340 18167 leader_election.cc:336] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.202768 23857 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:52.222582 23857 raft_consensus.cc:493] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.234151 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:52.224186 23854 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:52.236570 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 96617.4us
I20260709 13:20:52.236788 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:52.235622 23857 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:52.242889 23865 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:52.240005 23869 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.244726 23869 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.246403 23865 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.247179 23869 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:52.247005 23865 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.255656 23865 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:52.257064 23863 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.257642 23863 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.259666 23863 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:52.237188 23854 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.263870 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:52.267881 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:52.268620 17603 raft_consensus.cc:3060] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.271065 23863 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:52.271507 23863 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.271911 23863 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.268546 23855 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:52.272750 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:52.273499 18192 raft_consensus.cc:3060] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.263799 23854 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:52.280045 17495 leader_election.cc:336] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:52.281113 17495 leader_election.cc:336] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.281508 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:52.282610 23861 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.284154 23627 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:52.284878 23861 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:52.285892 18167 leader_election.cc:336] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.288981 23782 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:52.265606 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:52.294492 17602 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 14.
I20260709 13:20:52.298383 17347 catalog_manager.cc:5697] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 18 to 19, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 19 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.300318 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:52.301316 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:52.302142 17602 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 13.
W20260709 13:20:52.302266 18167 leader_election.cc:336] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.306133 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:52.306951 17527 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 15: Already voted for candidate ddfe9cca0741489b994f8b0178c54fe7 in this term.
I20260709 13:20:52.308441 23857 raft_consensus.cc:515] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.309608 23861 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
W20260709 13:20:52.311676 17569 leader_election.cc:336] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.312126 17569 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:52.312788 23843 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:52.310472 23861 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:52.312994 17569 leader_election.cc:336] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.314507 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:52.315300 17602 raft_consensus.cc:2393] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 15: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:52.316269 23857 leader_election.cc:290] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:52.314637 23861 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:52.318387 18167 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:52.320082 23780 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:52.320602 23780 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.320320 23854 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.321038 23780 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.321682 18201 raft_consensus.cc:2393] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 17: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:20:52.326975 18196 raft_consensus.cc:2468] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 17.
I20260709 13:20:52.327147 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ad3ce4b124497a737d40423bea33d" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:52.327805 17527 raft_consensus.cc:3060] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:52.333469 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:52.334195 18201 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 11.
I20260709 13:20:52.334388 17603 raft_consensus.cc:2468] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 15.
I20260709 13:20:52.341132 17527 raft_consensus.cc:2468] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
W20260709 13:20:52.347234 17569 leader_election.cc:336] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:52.348145 17569 leader_election.cc:336] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.348613 18192 raft_consensus.cc:2468] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
W20260709 13:20:52.348874 17495 leader_election.cc:336] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.347637 17568 leader_election.cc:304] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:52.352459 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:52.359499 18167 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:52.360348 23627 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:52.360740 23627 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.361070 23627 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.363880 23780 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.369304 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:52.373248 17347 catalog_manager.cc:5697] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 13 to 14, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 14 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.381307 17569 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:52.382658 23857 raft_consensus.cc:3060] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.385342 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:52.377555 23782 raft_consensus.cc:2804] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:52.382710 23843 raft_consensus.cc:2804] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:52.387002 23843 raft_consensus.cc:697] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:52.388021 23843 consensus_queue.cc:237] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.389904 23780 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:52.390172 23782 raft_consensus.cc:697] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:20:52.391256 23782 consensus_queue.cc:237] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.391609 23863 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.393764 23863 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:52.395177 17495 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:52.396129 23802 raft_consensus.cc:2804] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:52.396692 23802 raft_consensus.cc:697] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:52.397660 23802 consensus_queue.cc:237] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.379055 23854 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:52.374188 23846 raft_consensus.cc:2804] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:52.402469 23846 raft_consensus.cc:697] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:52.403401 23846 consensus_queue.cc:237] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.407769 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:52.409896 23781 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:52.410374 23781 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.376598 23627 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.410727 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:52.415980 17602 raft_consensus.cc:3060] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:52.414513 17569 leader_election.cc:336] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.418514 23873 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.419081 23873 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.420509 23852 tablet_bootstrap.cc:492] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:52.421159 23873 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:52.421506 23852 tablet_bootstrap.cc:492] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2: Bootstrap complete.
I20260709 13:20:52.410758 23781 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:52.422478 23852 ts_tablet_manager.cc:1403] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2: Time spent bootstrapping tablet: real 0.551s	user 0.053s	sys 0.026s
I20260709 13:20:52.423761 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:52.424371 17527 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 14.
I20260709 13:20:52.424980 17602 raft_consensus.cc:2468] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 15.
I20260709 13:20:52.416572 17569 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:52.425411 18166 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
W20260709 13:20:52.427814 17569 leader_election.cc:336] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:52.428520 17569 leader_election.cc:336] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.433715 23829 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:52.435985 23811 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:52.436424 23811 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0480cf54c3cc424ab94b963ef2ff5bf4)
I20260709 13:20:52.436800 23811 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.438076 23857 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:52.430171 18167 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:52.440657 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:52.441532 17602 raft_consensus.cc:3060] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:52.441512 18167 leader_election.cc:336] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.444021 23782 raft_consensus.cc:2804] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:52.445099 23627 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:52.451023 17603 raft_consensus.cc:2468] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 17.
I20260709 13:20:52.457983 17602 raft_consensus.cc:2468] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 15.
I20260709 13:20:52.465685 23782 raft_consensus.cc:697] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:20:52.462270 23781 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.482616 23782 consensus_queue.cc:237] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.483299 23781 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:52.491922 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea190a19aed74ffea2c29fa8c13edeac" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:52.492797 18192 raft_consensus.cc:3060] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:52.503163 17528 raft_consensus.cc:1275] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:52.505132 23852 raft_consensus.cc:359] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:52.505426 23854 consensus_queue.cc:1048] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:52.479439 18167 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:52.507895 23852 raft_consensus.cc:740] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Initialized, Role: LEARNER
I20260709 13:20:52.508752 23852 consensus_queue.cc:260] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
W20260709 13:20:52.509618 18167 leader_election.cc:336] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.509763 23873 raft_consensus.cc:2804] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:52.511471 18167 leader_election.cc:336] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.511551 23873 raft_consensus.cc:697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:20:52.507922 17348 catalog_manager.cc:5697] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 14 to 15, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 15 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.512633 23873 consensus_queue.cc:237] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.515244 17347 catalog_manager.cc:5697] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 13 to 14, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:52.461731 17495 leader_election.cc:336] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.517231 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:52.517994 23802 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:52.518191 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 56475.1us
W20260709 13:20:52.518875 17495 leader_election.cc:336] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:52.519558 17495 leader_election.cc:336] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.519923 17495 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:52.522262 23802 raft_consensus.cc:2749] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:52.527087 17352 catalog_manager.cc:5697] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 16 to 17, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 17 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.510488 18192 raft_consensus.cc:2468] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 12.
W20260709 13:20:52.538467 18167 consensus_peers.cc:597] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:52.529189 17352 catalog_manager.cc:5697] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 15 to 16, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 16 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.547224 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "810ba5585281416bb8f23e88267d049b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:52.547955 17603 raft_consensus.cc:3060] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.509721 23811 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:52.549870 17569 leader_election.cc:336] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.551247 17569 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:52.553845 23781 raft_consensus.cc:2804] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:52.554505 23781 raft_consensus.cc:697] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:52.555699 23781 consensus_queue.cc:237] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.557853 23811 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:52.559048 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:52.559746 17527 raft_consensus.cc:3060] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.511579 23852 ts_tablet_manager.cc:1434] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.000s
I20260709 13:20:52.575006 17612 tablet_copy_service.cc:342] P abf46e430b7e4ad4919ca2a717f37e0e: Request end of tablet copy session 2158c0f750fd4b21afe24135c52167b2-4022f7d9b64e45d18be29fda16f3ecde received from {username='slave'} at 127.0.0.1:52572
I20260709 13:20:52.575598 17612 tablet_copy_service.cc:434] P abf46e430b7e4ad4919ca2a717f37e0e: ending tablet copy session 2158c0f750fd4b21afe24135c52167b2-4022f7d9b64e45d18be29fda16f3ecde on tablet 4022f7d9b64e45d18be29fda16f3ecde with peer 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:52.571602 17495 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:52.581043 23863 raft_consensus.cc:2804] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:52.581656 23863 raft_consensus.cc:697] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:52.582666 23863 consensus_queue.cc:237] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.576908 17603 raft_consensus.cc:2468] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 14.
W20260709 13:20:52.591352 18167 leader_election.cc:336] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:52.605101 17495 leader_election.cc:336] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:52.619450 17495 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:52.619931 17527 raft_consensus.cc:2468] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 15.
I20260709 13:20:52.620631 23802 raft_consensus.cc:2804] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:52.621181 23802 raft_consensus.cc:697] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Leader. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:52.621356 18166 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4
I20260709 13:20:52.622653 23873 raft_consensus.cc:2804] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:52.622578 23802 consensus_queue.cc:237] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:52.623536 23873 raft_consensus.cc:697] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:20:52.624650 23873 consensus_queue.cc:237] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:52.636123 17352 catalog_manager.cc:5697] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 14 to 15, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 15 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.644604 17348 catalog_manager.cc:5697] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 14 to 15, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 15 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.646606 17348 catalog_manager.cc:5697] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 16 to 17, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 17 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.649091 17347 catalog_manager.cc:5697] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 11 to 12, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 12 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.666986 18196 raft_consensus.cc:1217] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
W20260709 13:20:52.670337 17495 leader_election.cc:336] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:52.674378 17569 consensus_peers.cc:597] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.680770 17569 consensus_peers.cc:597] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.681233 17569 consensus_peers.cc:597] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.700685 17569 consensus_peers.cc:597] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:52.704468 17352 catalog_manager.cc:5697] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: term changed from 13 to 14, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66). New cstate: current_term: 14 leader_uuid: "ddfe9cca0741489b994f8b0178c54fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:52.722870 17569 consensus_peers.cc:597] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.731307 18192 raft_consensus.cc:1275] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:52.732882 23843 consensus_queue.cc:1048] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:52.757158 17528 raft_consensus.cc:1275] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:20:52.757856 18167 consensus_peers.cc:597] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.759006 23829 consensus_queue.cc:1048] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:52.773903 18167 consensus_peers.cc:597] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.775540 17347 catalog_manager.cc:5697] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 14 to 15, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 15 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:52.798467 17569 consensus_peers.cc:597] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:52.801623 18167 consensus_peers.cc:597] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:52.811925 17495 consensus_peers.cc:597] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.813589 17569 consensus_peers.cc:597] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.819473 18192 raft_consensus.cc:1275] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:52.823009 23843 consensus_queue.cc:1048] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:52.835273 18196 raft_consensus.cc:1275] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:52.860285 23802 consensus_queue.cc:1048] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:52.874742 17569 consensus_peers.cc:597] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:52.878638 17602 raft_consensus.cc:1275] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:20:52.887836 17495 consensus_peers.cc:597] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.889534 18167 consensus_peers.cc:597] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.894702 23782 consensus_queue.cc:1048] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:52.929769 17495 consensus_peers.cc:597] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.936342 18167 consensus_peers.cc:597] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.947196 17569 consensus_peers.cc:597] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.964388 17528 raft_consensus.cc:1275] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:20:52.966178 18167 consensus_peers.cc:597] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.966014 23829 consensus_queue.cc:1048] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:20:52.974658 17495 consensus_peers.cc:597] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:52.975183 17495 consensus_peers.cc:597] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.980824 17569 consensus_peers.cc:597] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:52.984308 18167 consensus_peers.cc:597] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.008662 17495 consensus_peers.cc:597] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:53.012816 17602 raft_consensus.cc:1275] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:20:53.016613 18167 consensus_peers.cc:597] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:53.019865 23782 consensus_queue.cc:1048] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:53.023362 17528 raft_consensus.cc:1275] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:20:53.033757 18167 consensus_peers.cc:597] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:53.036479 23782 consensus_queue.cc:1048] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:20:53.082991 18167 consensus_peers.cc:597] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:53.084080 17569 consensus_peers.cc:597] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.123461 18167 consensus_peers.cc:597] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:53.132555 17602 raft_consensus.cc:1275] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:53.139968 18196 raft_consensus.cc:1275] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:20:53.140612 17495 consensus_peers.cc:597] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:53.144361 23843 consensus_queue.cc:1048] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:53.148488 23873 consensus_queue.cc:1048] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:53.159441 17598 raft_consensus.cc:1275] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:53.161093 23802 consensus_queue.cc:1048] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:20:53.174834 17569 consensus_peers.cc:597] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:53.189829 17602 raft_consensus.cc:1275] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Refusing update from remote peer ddfe9cca0741489b994f8b0178c54fe7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:20:53.195575 16329 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 17475)
W20260709 13:20:53.197207 17569 consensus_peers.cc:597] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:53.199681 23863 consensus_queue.cc:1048] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:53.226444 23843 raft_consensus.cc:1064] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: attempting to promote NON_VOTER 2158c0f750fd4b21afe24135c52167b2 to VOTER
I20260709 13:20:53.230156 23843 consensus_queue.cc:237] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:53.244454 17495 consensus_peers.cc:597] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.268357 17495 consensus_peers.cc:597] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:53.288734 18167 consensus_peers.cc:597] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:53.292860 18192 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEARNER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:53.296461 23857 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:53.324504 17495 consensus_peers.cc:597] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:53.324779 18167 consensus_peers.cc:597] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.327323 17495 consensus_peers.cc:597] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.376817 17569 consensus_peers.cc:597] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:54.196331 16329 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 17475)
I20260709 13:20:54.249116 23912 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.267112 23912 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:54.274885 23912 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:54.298332 23913 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.307423 23913 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.314659 23913 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:54.299217 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 83196.7us
I20260709 13:20:54.336318 23912 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.337237 23912 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:54.345842 23913 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.347002 23913 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.351291 23913 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:54.384039 23912 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:54.387923 23916 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.389062 23916 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.393901 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:54.396821 23916 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.423439 23916 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.424633 23916 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.428064 23916 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:54.433830 23916 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.434872 23916 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.438242 23916 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.439622 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:54.469882 23861 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.510833 23861 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.516157 23915 raft_consensus.cc:493] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:54.517113 23915 raft_consensus.cc:515] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.552166 23861 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:54.569614 23916 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.570926 23916 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.590102 23915 leader_election.cc:290] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:54.627904 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:54.629069 17602 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 14.
I20260709 13:20:54.631129 18167 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:54.634856 23916 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.652949 23900 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.653810 23900 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.664611 23916 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.665557 23916 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.666934 23917 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.677573 23917 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.681461 23917 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.665481 23918 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:54.682397 23918 raft_consensus.cc:493] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.682909 23914 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.682937 23918 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:54.683995 23914 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:54.686095 23915 raft_consensus.cc:493] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:54.686631 23917 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.686921 23915 raft_consensus.cc:515] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.687554 23917 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.669170 23873 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.673173 17528 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:54.689781 17528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54548 (request call id 4275) took 1347 ms. Trace:
I20260709 13:20:54.690697 23915 leader_election.cc:290] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:54.690292 17528 rpcz_store.cc:276] 0709 13:20:53.355036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.670260 (+1315224us) service_pool.cc:224] Handling call
0709 13:20:54.672369 (+  2109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:54.689275 (+ 16906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:54.689685 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:54.691646 23914 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:54.691239 23917 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:54.701237 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 1.35995e+06us
I20260709 13:20:54.716223 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:54.719974 23915 raft_consensus.cc:493] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:54.720827 23915 raft_consensus.cc:515] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.746621 23873 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.749822 23873 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:54.750070 23917 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.751667 23917 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.754149 23917 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.755458 23916 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.756183 23916 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.757115 23921 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.756932 23916 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.724632 23900 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:54.757921 23921 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:20:54.758440 23900 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.759214 23900 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.760690 23921 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:54.761667 23900 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.762718 23914 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.762961 23829 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:54.763774 23911 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.765527 23914 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.765681 23829 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.768420 23914 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:54.769193 23829 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:54.766088 23911 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:54.765674 23861 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.771661 23861 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:54.772125 23911 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:54.773977 23915 leader_election.cc:290] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:54.757731 23919 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.775004 23919 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.782294 23873 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.783301 23873 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:54.786831 18167 leader_election.cc:336] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:54.787688 18167 leader_election.cc:336] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:54.790263 23921 raft_consensus.cc:493] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:54.791046 23921 raft_consensus.cc:515] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.792789 23917 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:20:54.788264 18167 leader_election.cc:336] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:54.793673 23917 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:54.794183 18167 leader_election.cc:336] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:54.796664 23861 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:54.797850 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 89762.3us
I20260709 13:20:54.801936 23873 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.801295 23919 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:20:54.815105 17495 consensus_peers.cc:597] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:54.793691 23921 leader_election.cc:290] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:54.816291 23919 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.833885 23919 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.833714 23918 raft_consensus.cc:515] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.835402 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16762b5a82d4310ad01b31fd99d5921" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:54.836470 23919 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.840546 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7398c91e7a884284a8b806d47551eaf7" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:54.836931 23918 leader_election.cc:290] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.849472 17348 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40508 (request call id 339) took 1521 ms. Trace:
I20260709 13:20:54.850081 17348 rpcz_store.cc:276] 0709 13:20:53.324847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.325159 (+   312us) service_pool.cc:224] Handling call
0709 13:20:54.841690 (+1516531us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:20:54.852414 23917 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:54.854244 18167 leader_election.cc:336] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:54.843468 23919 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.855855 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:54.854453 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:54.865639 17602 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 17.
I20260709 13:20:54.854617 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:54.872236 17597 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 14.
I20260709 13:20:54.875463 23843 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.876549 23843 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.884599 23921 raft_consensus.cc:493] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:54.885370 23921 raft_consensus.cc:515] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.887569 23921 leader_election.cc:290] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:54.891080 23916 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.891245 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fad2b3d8f774d4ca47be967955fb28b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:54.892846 23843 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:54.892915 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:54.895052 17597 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:54.899228 23908 raft_consensus.cc:493] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.900082 23908 raft_consensus.cc:515] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:54.900341 23917 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.900589 23802 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.897294 23919 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.901283 23917 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.903239 23919 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.901361 23802 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.925455 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb985f82c610405fb3774fe99cf142e7" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:54.926049 23872 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.926584 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:54.926692 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:54.926880 23872 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:54.927444 17525 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:20:54.930127 23908 leader_election.cc:290] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.933352 23917 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.929744 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:54.942134 23908 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:54.942909 23908 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.944324 23802 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:54.945395 23908 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:54.946220 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:54.948678 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6864e5b711423291c531e98224c311" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:54.951740 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:54.952515 17529 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:54.954211 23919 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.955017 23919 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.957691 23919 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.953630 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8999fe04fedd4bcc9305446ba6f99d23" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:54.958423 17524 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:54.959730 23872 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.965785 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:54.966703 18196 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 17.
I20260709 13:20:54.970885 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c198fb42e5b400c91f60d6969641780" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:54.971288 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:54.972385 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea493621f1e42c2b8689859233cc798" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:54.972929 23843 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:54.980892 23925 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:54.981390 23873 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.983326 18167 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:54.984588 23875 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:54.984975 18167 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:54.985064 23875 raft_consensus.cc:493] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.985786 23875 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:54.986171 23913 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:54.986672 23913 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:54.987092 23913 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:54.981789 23925 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.994309 23873 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:54.995119 23925 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:54.996842 23873 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:54.997663 17568 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:55.001305 23861 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:55.006280 23861 raft_consensus.cc:493] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.007084 23861 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:55.008824 23926 raft_consensus.cc:493] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:55.013504 23863 raft_consensus.cc:493] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:55.014286 23907 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:55.015010 23907 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: NON_VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: true } }
I20260709 13:20:55.017436 23907 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:55.018122 23863 raft_consensus.cc:515] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.020496 23863 leader_election.cc:290] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:55.009554 23926 raft_consensus.cc:515] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.029425 23926 leader_election.cc:290] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:55.033370 23843 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:55.034148 23843 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:55.035354 18194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c40484b7a540a9b32947573409178a" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.035728 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.036513 18200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916155438d0e450f9fdbbb449eee2721" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.036872 18195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.037848 23843 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:55.040688 23875 raft_consensus.cc:515] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:54.999121 18167 leader_election.cc:336] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:55.044741 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 45661us
I20260709 13:20:55.044757 17597 raft_consensus.cc:2468] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 15.
I20260709 13:20:55.046605 23927 raft_consensus.cc:493] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:55.047559 23927 raft_consensus.cc:515] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.048794 23913 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.052802 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac17c6792414180963986e500f47356" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.056416 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c18bcdaa4eca99f08bba98bb1e0e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:20:55.056571 18167 leader_election.cc:336] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.057771 18167 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.058921 23854 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:55.059036 18167 leader_election.cc:336] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.059132 23913 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:55.059526 18167 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.062086 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e8e6dd889d4bcfabf84cedd079e2f2" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.062284 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.062417 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4916b36c24c9bb0562a70795b8ed1" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.063959 23927 leader_election.cc:290] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:55.064110 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.064859 17568 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:55.065660 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7002e0c7a3624420a1737b1fb29d8142" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.066164 23921 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:55.066586 23921 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:55.066988 23921 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:55.067749 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a372191e02cc468bbc747310e2818f07" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.070848 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.072145 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6cfcb1338b4398b769f6956792bdd7" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.075054 23922 raft_consensus.cc:493] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:55.075795 23922 raft_consensus.cc:515] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.076910 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.079411 17568 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:55.075003 23927 raft_consensus.cc:493] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:55.080402 23927 raft_consensus.cc:515] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.082530 18197 raft_consensus.cc:2393] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 15: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:20:55.083518 23875 leader_election.cc:290] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:55.084193 23875 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:55.086819 23861 raft_consensus.cc:515] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
W20260709 13:20:55.087817 18167 leader_election.cc:336] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.088366 18167 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.089092 23861 leader_election.cc:290] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:55.089298 23875 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:55.091581 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.093587 23927 leader_election.cc:290] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:55.103960 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf63370ef7f41519349f91e85c42d19" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.104681 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.105484 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.078342 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.107131 23921 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.078193 23922 leader_election.cc:290] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:55.098634 23910 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:55.109185 23910 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:55.109396 23921 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:55.109603 23910 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:55.111235 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:55.113003 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:55.114480 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:55.114698 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3434da716f41f0bc0eb393a53152ed" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:55.099356 23857 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:55.115640 23857 raft_consensus.cc:493] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.116178 23857 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:55.116240 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da520cc299d940b68e5655cd8094d48e" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:55.118729 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e901a2e51634e18807d1c4292e3f285" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:55.101318 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773182c45284396b8fd0513eb349cc4" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:55.102010 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858a1d920b5540b3b9107201e3b32d46" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:55.102125 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306df9e1a44b411595f67a918d6a7a14" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:20:55.106451 18222 debug-util.cc:398] Leaking SignalData structure 0x7b0800367620 after lost signal to thread 16332
I20260709 13:20:55.108492 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:20:55.121585 18222 debug-util.cc:398] Leaking SignalData structure 0x7b0800316c20 after lost signal to thread 17386
I20260709 13:20:55.121765 17524 raft_consensus.cc:3060] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:55.123132 18222 debug-util.cc:398] Leaking SignalData structure 0x7b0800234fa0 after lost signal to thread 17553
W20260709 13:20:55.124480 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8200 after lost signal to thread 17627
W20260709 13:20:55.125808 18222 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1c80 after lost signal to thread 18225
I20260709 13:20:55.125723 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253dd23b514c487eaca1aecfa9b6e629" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:55.126721 18166 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.127959 23875 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:55.129948 18166 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:55.131072 18167 leader_election.cc:336] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.132877 23875 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:55.133638 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:55.134528 18166 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.135743 23875 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:55.135654 17569 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.136930 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:55.137217 23843 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:55.131609 18167 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.141731 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2edee9f2356c4e878f2e11af63e46ab9" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.142657 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd29f6044f6485580736010a0122d2b" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:20:55.143652 18167 leader_election.cc:336] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.145172 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.145898 18196 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:55.146920 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:55.148537 18166 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.149417 23854 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:55.149541 17597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347905859bee416fb447f19528527f52" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:55.150287 23854 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:55.144200 18167 leader_election.cc:336] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.151836 23854 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:55.152436 23854 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.155725 23854 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:55.165954 18167 leader_election.cc:304] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:55.166971 23854 raft_consensus.cc:2804] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:55.168469 23854 raft_consensus.cc:697] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:20:55.169476 18167 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.169751 23854 consensus_queue.cc:237] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.167896 18166 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.173667 23925 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:55.176019 23875 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:55.179195 18166 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.188797 18166 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.189709 23913 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:55.194984 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:55.195499 18166 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.195832 23875 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:55.192956 18167 leader_election.cc:336] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.196717 18167 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.197469 23913 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:55.198197 16329 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 17475)
I20260709 13:20:55.199632 23913 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:55.199607 23829 raft_consensus.cc:2955] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:55.203014 18196 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:55.202009 18167 leader_election.cc:336] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.204917 17528 raft_consensus.cc:2955] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:55.207688 17348 catalog_manager.cc:5697] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 14 to 15, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 15 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:55.211740 18167 leader_election.cc:336] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.212366 18167 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.213099 23875 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:55.214540 17596 raft_consensus.cc:1240] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:55.196473 23910 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.219411 17602 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 18: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:55.220238 23910 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:55.231954 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:55.233672 23857 raft_consensus.cc:515] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:55.236323 23857 leader_election.cc:290] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:55.239012 17524 raft_consensus.cc:2468] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 16.
I20260709 13:20:55.241504 17602 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:55.244899 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfacd1c614b49b290b54a86d3270339" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:20:55.246789 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 62109.9us
W20260709 13:20:55.247525 17569 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111) [suppressed 290 similar messages]
I20260709 13:20:55.248394 23843 raft_consensus.cc:2749] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:55.250619 18166 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.252040 23875 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:55.259228 17597 raft_consensus.cc:2468] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 15.
I20260709 13:20:55.261615 17568 leader_election.cc:304] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:55.262933 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:55.264638 18166 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.267789 17524 raft_consensus.cc:3060] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:55.268762 23875 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:55.271239 23910 raft_consensus.cc:2804] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:55.271962 23910 raft_consensus.cc:697] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:55.273952 23910 consensus_queue.cc:237] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:55.275876 18166 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.279418 18166 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.280617 23875 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:55.281849 23875 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:55.287253 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:55.288477 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.291167 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:55.292203 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.292882 17598 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:55.291981 18167 leader_election.cc:304] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.294736 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.296615 23913 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:55.298353 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a851f7fe7702439a9a695c117b09f6ae" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:55.299513 17598 raft_consensus.cc:2393] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 14: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:55.303031 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:55.305336 18166 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.306433 23913 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:55.308468 18166 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.312825 23875 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:55.319502 17598 raft_consensus.cc:1240] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer 2158c0f750fd4b21afe24135c52167b2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:55.321421 23913 consensus_queue.cc:1059] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:55.322687 23913 raft_consensus.cc:3055] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:55.323076 23913 raft_consensus.cc:740] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:20:55.324105 23913 consensus_queue.cc:260] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.326256 23913 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:55.335740 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e1920c304743e78e8b777b3b7ea7f3" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.336890 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:55.337404 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf597fe63db446f38a58bcbc792dd49b" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.310127 23854 raft_consensus.cc:2804] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:55.341085 18196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cfff7457484bd5b062ad3bc520549e" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.343338 23854 raft_consensus.cc:697] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:20:55.341140 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:55.344990 23854 consensus_queue.cc:237] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.355228 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:55.356159 18192 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 18: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
W20260709 13:20:55.367491 17569 leader_election.cc:336] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:55.368364 17569 leader_election.cc:336] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.368861 17569 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.379118 17524 raft_consensus.cc:2468] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:20:55.374714 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4022f7d9b64e45d18be29fda16f3ecde" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
W20260709 13:20:55.382068 17569 leader_election.cc:336] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.382674 17569 leader_election.cc:304] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
W20260709 13:20:55.383745 17569 leader_election.cc:336] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.383860 17568 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:55.384220 17569 leader_election.cc:304] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:55.382395 23843 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:55.392026 17569 leader_election.cc:336] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:55.393446 17569 leader_election.cc:336] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.394066 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:55.395382 17569 leader_election.cc:336] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.395987 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:55.402484 17569 leader_election.cc:336] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.403578 17569 leader_election.cc:304] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:55.384763 23857 raft_consensus.cc:2749] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:55.397395 23829 raft_consensus.cc:2804] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:55.413162 23929 consensus_queue.cc:1059] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:20:55.412493 17569 leader_election.cc:336] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.396875 23843 raft_consensus.cc:2749] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:55.402094 23921 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:55.404206 23861 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:55.419777 17569 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.428494 23929 consensus_queue.cc:1243] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer 2158c0f750fd4b21afe24135c52167b2 log is divergent from this leader: its last log entry 15.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:55.431105 23927 raft_consensus.cc:3055] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:55.431491 23927 raft_consensus.cc:740] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:55.427299 23829 raft_consensus.cc:697] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
I20260709 13:20:55.432464 23927 consensus_queue.cc:260] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.432715 23829 consensus_queue.cc:237] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:55.419303 23910 raft_consensus.cc:2749] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:55.432057 17352 catalog_manager.cc:5697] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 reported cstate change: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:55.434808 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.435938 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ab58b1d58a45d9ba339018260d1ee4" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:55.440819 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0843b162ea34017b0c1243e97245db9" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:55.436883 18196 raft_consensus.cc:1240] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:55.447888 17569 leader_election.cc:336] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:55.448465 17569 leader_election.cc:336] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.433992 23927 raft_consensus.cc:3060] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:55.447738 23910 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:55.456909 17569 leader_election.cc:304] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:55.458461 23843 raft_consensus.cc:2749] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:55.458916 17569 leader_election.cc:304] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:55.461259 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.466300 17569 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.475139 23843 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:55.475683 23843 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:55.467940 23911 raft_consensus.cc:2749] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:55.476051 23843 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:55.514451 18197 raft_consensus.cc:1240] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:55.517248 17347 catalog_manager.cc:5697] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 14 to 16, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 16 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:55.519589 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 75072.6us
I20260709 13:20:55.478011 23829 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:20:55.560511 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 94454.6us
W20260709 13:20:55.563659 17568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 95750.2us
I20260709 13:20:55.570701 23843 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.575474 23843 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:20:55.582265 17495 consensus_peers.cc:597] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:55.587337 23927 consensus_queue.cc:1059] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:55.588781 23928 raft_consensus.cc:3055] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:55.589226 23928 raft_consensus.cc:740] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:55.590292 23928 consensus_queue.cc:260] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.590606 17495 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.592643 23926 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:55.592789 17495 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.591300 23928 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:55.593775 23926 raft_consensus.cc:2749] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:55.594308 23929 consensus_queue.cc:1059] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:55.595722 23927 raft_consensus.cc:3055] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:55.596123 23927 raft_consensus.cc:740] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:55.597113 23927 consensus_queue.cc:260] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.597185 17348 catalog_manager.cc:5697] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 14 to 15, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 15 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.598536 23927 raft_consensus.cc:3060] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:55.602696 17495 leader_election.cc:304] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.603832 23922 raft_consensus.cc:2749] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:55.590898 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.612108 23843 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:20:55.615283 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 57088.3us
I20260709 13:20:55.619307 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
W20260709 13:20:55.628918 17569 leader_election.cc:336] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.637796 17569 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.635160 17495 leader_election.cc:304] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.639909 23861 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:55.639972 23926 raft_consensus.cc:2749] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:55.638913 17347 catalog_manager.cc:5697] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 12 to 14, leader changed from 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 14 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:55.641219 17569 leader_election.cc:336] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:55.643910 17569 leader_election.cc:336] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.643985 17602 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 13:20:55.645068 17495 leader_election.cc:336] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.653890 17598 consensus_queue.cc:237] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:55.659379 17495 leader_election.cc:304] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.660145 23922 raft_consensus.cc:2749] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:55.660593 17569 consensus_peers.cc:597] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:55.661201 17495 consensus_peers.cc:597] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:55.662088 23913 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:20:55.662998 17495 leader_election.cc:336] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.663439 17495 leader_election.cc:304] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.664234 23922 raft_consensus.cc:2749] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:55.668164 17495 leader_election.cc:336] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.668740 17495 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:55.669804 17525 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:20:55.670210 17495 leader_election.cc:336] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.670706 17495 leader_election.cc:304] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:55.671929 23861 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:55.672701 23922 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:55.685642 23926 raft_consensus.cc:2749] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:55.686755 17495 leader_election.cc:336] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.694964 17495 leader_election.cc:304] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:55.696097 23942 raft_consensus.cc:2955] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:55.698014 17523 raft_consensus.cc:2955] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:55.704432 18201 raft_consensus.cc:2955] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } attrs { replace: true } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:55.714962 23922 raft_consensus.cc:2749] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:55.716542 17495 leader_election.cc:336] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:55.717231 17495 leader_election.cc:304] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddfe9cca0741489b994f8b0178c54fe7; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, 2158c0f750fd4b21afe24135c52167b2
I20260709 13:20:55.719038 17339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4022f7d9b64e45d18be29fda16f3ecde with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:55.719225 18197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:55.726917 23922 raft_consensus.cc:2749] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:55.728801 17525 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:55.733790 23913 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:55.773222 17525 raft_consensus.cc:1275] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:55.774989 23861 consensus_queue.cc:1048] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:55.778859 18196 raft_consensus.cc:1275] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:55.784940 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:55.788450 23944 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:55.804005 17598 raft_consensus.cc:1275] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:55.804188 17529 raft_consensus.cc:1275] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:20:55.810209 23944 consensus_queue.cc:1048] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:20:55.813315 23925 consensus_queue.cc:1048] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:55.807850 23875 consensus_queue.cc:1048] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:20:55.807606 17347 catalog_manager.cc:5697] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: config changed from index 11 to 12, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New cstate: current_term: 13 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:55.849534 17569 consensus_peers.cc:597] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.861770 18196 raft_consensus.cc:2955] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } } }
I20260709 13:20:55.897182 17529 raft_consensus.cc:1275] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:55.900568 23861 consensus_queue.cc:1048] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:56.025839 17569 consensus_peers.cc:597] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:56.028416 17339 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 79821.9us
W20260709 13:20:56.031526 17339 catalog_manager.cc:4755] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4022f7d9b64e45d18be29fda16f3ecde: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:56.040994 18167 consensus_peers.cc:597] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:56.059087 17598 raft_consensus.cc:1240] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Rejecting Update request from peer ddfe9cca0741489b994f8b0178c54fe7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:56.061822 23928 consensus_queue.cc:1059] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:56.063341 23928 raft_consensus.cc:3055] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:56.063923 23928 raft_consensus.cc:740] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddfe9cca0741489b994f8b0178c54fe7, State: Running, Role: LEADER
I20260709 13:20:56.064986 23928 consensus_queue.cc:260] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:56.066733 23928 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:56.182633 18167 consensus_peers.cc:597] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.198632 16329 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 17475)
W20260709 13:20:56.379276 18167 consensus_peers.cc:597] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:56.525079 17569 consensus_peers.cc:597] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.536208 17569 consensus_peers.cc:597] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.541574 18167 consensus_peers.cc:597] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.583835 17569 consensus_peers.cc:597] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:56.586918 17569 consensus_peers.cc:597] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.668149 17569 consensus_peers.cc:597] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.686116 18167 consensus_peers.cc:597] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.700235 18167 consensus_peers.cc:597] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:56.705600 17569 consensus_peers.cc:597] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:56.710045 18167 consensus_peers.cc:597] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:56.783794 23854 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.784421 23854 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:56.787227 23854 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:56.789353 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:56.789994 17598 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 14.
I20260709 13:20:56.787783 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:56.793573 18167 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:56.794452 23854 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:56.794890 23854 raft_consensus.cc:493] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.795300 23854 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:56.793766 17526 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 13.
W20260709 13:20:56.810128 17569 consensus_peers.cc:597] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:56.810568 18167 consensus_peers.cc:597] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.811156 18167 consensus_peers.cc:597] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.815497 18167 consensus_peers.cc:597] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:56.816308 23854 raft_consensus.cc:515] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:56.818637 17569 consensus_peers.cc:597] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:56.849027 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:56.849669 17523 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:56.856477 17523 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 15.
I20260709 13:20:56.858897 18166 leader_election.cc:304] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:56.859725 23925 raft_consensus.cc:2804] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:56.860199 23925 raft_consensus.cc:697] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:20:56.861054 23925 consensus_queue.cc:237] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:56.870868 23854 leader_election.cc:290] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:56.873626 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d603d87b8422dad32dfbb77b7e95c" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:56.874277 17598 raft_consensus.cc:3060] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:56.903995 17347 catalog_manager.cc:5697] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.924667 17598 raft_consensus.cc:2468] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 15.
W20260709 13:20:56.932185 17569 consensus_peers.cc:597] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:56.954734 17569 consensus_peers.cc:597] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.017465 18167 consensus_peers.cc:597] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.093178 18167 consensus_peers.cc:597] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.093988 18167 consensus_peers.cc:597] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.190085 17569 consensus_peers.cc:597] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.196792 18167 consensus_peers.cc:597] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:57.212853 17569 consensus_peers.cc:597] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:57.226095 17495 consensus_peers.cc:597] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.275641 17339 catalog_manager.cc:4755] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4022f7d9b64e45d18be29fda16f3ecde: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:57.360543 17525 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:57.367796 23854 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:57.406082 17602 raft_consensus.cc:1275] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:57.419016 23965 consensus_queue.cc:1048] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:57.497982 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 55142.2us
I20260709 13:20:57.505275 23928 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.536293 23928 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:57.539024 23928 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:57.526304 23854 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.540467 23854 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:57.545746 23854 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:20:57.531869 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:36313, user_credentials={real_user=slave}} blocked reactor thread for 83103.5us
W20260709 13:20:57.566284 17495 consensus_peers.cc:597] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.567085 17495 consensus_peers.cc:597] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:57.589830 23925 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:57.590587 23925 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:57.592996 23925 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:57.598858 16329 tablet_server.cc:196] TabletServer@127.15.242.65:0 shutdown complete.
I20260709 13:20:57.615002 23857 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.615794 23857 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:57.618976 23857 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:57.637264 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:57.638012 17602 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 18.
I20260709 13:20:57.639143 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:57.639424 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:57.639842 17525 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 18.
I20260709 13:20:57.640141 17602 raft_consensus.cc:2393] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 14: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
W20260709 13:20:57.642879 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 75216.6us
I20260709 13:20:57.648213 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:57.648904 17525 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 14.
I20260709 13:20:57.650234 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:57.651453 23843 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.651957 23843 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:57.653891 23843 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:57.650979 18192 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 18.
I20260709 13:20:57.673444 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:57.674274 18201 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 13.
I20260709 13:20:57.676077 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:57.684144 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:57.684959 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7" is_pre_election: true
I20260709 13:20:57.685423 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:57.686682 17528 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 14.
I20260709 13:20:57.687016 17598 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfe9cca0741489b994f8b0178c54fe7 in term 18.
I20260709 13:20:57.689425 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "ddfe9cca0741489b994f8b0178c54fe7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:57.689819 23854 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:57.690601 23854 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.691998 23854 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:57.687520 17569 consensus_peers.cc:597] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:57.687717 17525 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 18.
I20260709 13:20:57.701153 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:57.699119 18166 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:57.702615 23925 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:57.703063 23925 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:57.703482 23925 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:57.705127 23910 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:57.705777 23910 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.711635 23910 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:57.717083 23854 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:57.718405 18201 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddfe9cca0741489b994f8b0178c54fe7 in current term 19: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:20:57.728297 23854 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 19 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:57.746953 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: 
I20260709 13:20:57.749668 23977 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:57.750777 23977 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.751181 23977 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:57.750113 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 46845.2us
I20260709 13:20:57.760334 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:57.761101 17526 raft_consensus.cc:3060] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:57.772469 23925 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:57.774945 23910 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:57.777189 23910 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 19 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:20:57.778857 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 68035.7us
W20260709 13:20:57.779497 17495 consensus_peers.cc:597] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.784763 17526 raft_consensus.cc:2468] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 19.
I20260709 13:20:57.786123 18166 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:57.787590 23978 raft_consensus.cc:2804] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:57.794495 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:57.795667 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:57.796448 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:57.797179 17528 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate abf46e430b7e4ad4919ca2a717f37e0e in current term 19: Already voted for candidate 2158c0f750fd4b21afe24135c52167b2 in this term.
I20260709 13:20:57.798101 23978 raft_consensus.cc:697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 19 LEADER]: Becoming Leader. State: Replica: 2158c0f750fd4b21afe24135c52167b2, State: Running, Role: LEADER
I20260709 13:20:57.799058 23978 consensus_queue.cc:237] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:57.801438 18167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:36581, user_credentials={real_user=slave}} blocked reactor thread for 89811.7us
I20260709 13:20:57.810833 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:57.811671 17598 raft_consensus.cc:2393] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 in current term 19: Already voted for candidate abf46e430b7e4ad4919ca2a717f37e0e in this term.
I20260709 13:20:57.806880 23977 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:57.816407 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddfe9cca0741489b994f8b0178c54fe7"
I20260709 13:20:57.818178 18192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2"
I20260709 13:20:57.819043 18192 raft_consensus.cc:3060] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:57.824656 17495 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:57.825423 23973 raft_consensus.cc:2764] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:20:57.827641 23925 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:57.839002 17525 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2158c0f750fd4b21afe24135c52167b2 in term 14.
I20260709 13:20:57.851671 18166 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7; no voters: 
I20260709 13:20:57.852195 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb20677645b433e839a2f21c9cc2ef3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e"
I20260709 13:20:57.852556 23977 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Requested vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
I20260709 13:20:57.853047 17598 raft_consensus.cc:2368] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for earlier term 14. Current term is 15.
I20260709 13:20:57.836144 18192 raft_consensus.cc:2468] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf46e430b7e4ad4919ca2a717f37e0e in term 15.
I20260709 13:20:57.854264 23979 raft_consensus.cc:2764] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:20:57.855834 17569 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2, abf46e430b7e4ad4919ca2a717f37e0e; no voters: ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:57.856746 17495 consensus_peers.cc:597] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.857249 23977 raft_consensus.cc:2804] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:57.867902 23977 raft_consensus.cc:697] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Becoming Leader. State: Replica: abf46e430b7e4ad4919ca2a717f37e0e, State: Running, Role: LEADER
W20260709 13:20:57.857291 17495 consensus_peers.cc:597] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.872166 17495 consensus_peers.cc:597] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.873461 23977 consensus_queue.cc:237] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:57.866302 18167 leader_election.cc:400] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 election: Vote denied by peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581) with higher term. Message: Invalid argument: T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2158c0f750fd4b21afe24135c52167b2 for earlier term 14. Current term is 15.
I20260709 13:20:57.867005 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:57.886206 23910 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:57.890170 17347 catalog_manager.cc:5697] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 reported cstate change: term changed from 17 to 19, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68). New cstate: current_term: 19 leader_uuid: "2158c0f750fd4b21afe24135c52167b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:57.898092 17495 consensus_peers.cc:597] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.898691 17495 consensus_peers.cc:597] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.899144 17495 consensus_peers.cc:597] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.899784 17495 consensus_peers.cc:597] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:57.941438 17352 catalog_manager.cc:5697] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e reported cstate change: term changed from 13 to 15, leader changed from ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66) to abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67). New cstate: current_term: 15 leader_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:57.944583 17495 consensus_peers.cc:597] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.953933 17495 consensus_peers.cc:597] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:58.054157 16329 tablet_server.cc:179] TabletServer@127.15.242.66:0 shutting down...
W20260709 13:20:58.062340 18166 consensus_peers.cc:597] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.081009 18166 consensus_peers.cc:597] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.112424 17568 consensus_peers.cc:597] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.165522 18166 consensus_peers.cc:597] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.179872 18166 consensus_peers.cc:597] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.181172 17568 consensus_peers.cc:597] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.181959 17568 consensus_peers.cc:597] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.187206 17569 consensus_peers.cc:597] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:58.190181 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:58.195894 16329 tablet_replica.cc:333] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.198624 16329 raft_consensus.cc:2243] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.199878 16329 raft_consensus.cc:2272] T dac17c6792414180963986e500f47356 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.210342 16329 tablet_replica.cc:333] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.211282 16329 raft_consensus.cc:2243] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.212558 16329 raft_consensus.cc:2272] T 43e1920c304743e78e8b777b3b7ea7f3 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.217157 16329 tablet_replica.cc:333] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.217998 16329 raft_consensus.cc:2243] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.223556 16329 raft_consensus.cc:2272] T 36043ed9ab7c47e9882fa33c5c135545 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.225535 17598 raft_consensus.cc:1275] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 FOLLOWER]: Refusing update from remote peer 2158c0f750fd4b21afe24135c52167b2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:58.227277 16329 tablet_replica.cc:333] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.228212 16329 raft_consensus.cc:2243] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.230818 16329 raft_consensus.cc:2272] T da520cc299d940b68e5655cd8094d48e P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.233693 16329 tablet_replica.cc:333] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
W20260709 13:20:58.244035 17568 consensus_peers.cc:597] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.237432 16329 raft_consensus.cc:2243] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.245790 16329 raft_consensus.cc:2272] T 0c6864e5b711423291c531e98224c311 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.248486 16329 tablet_replica.cc:333] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.249221 16329 raft_consensus.cc:2243] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.249403 23979 consensus_queue.cc:1048] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:58.250368 16329 raft_consensus.cc:2272] T 1cf63370ef7f41519349f91e85c42d19 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.271967 16329 tablet_replica.cc:333] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.272852 16329 raft_consensus.cc:2243] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:58.273115 17568 consensus_peers.cc:597] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.273440 16329 raft_consensus.cc:2272] T a851f7fe7702439a9a695c117b09f6ae P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.280308 16329 tablet_replica.cc:333] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.281282 16329 raft_consensus.cc:2243] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.282051 16329 raft_consensus.cc:2272] T 12ca126b355348958188e14e8b1c7470 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.285002 16329 tablet_replica.cc:333] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.285907 16329 raft_consensus.cc:2243] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.286862 16329 raft_consensus.cc:2272] T 8e901a2e51634e18807d1c4292e3f285 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:58.289269 18166 consensus_peers.cc:597] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.308871 17495 consensus_peers.cc:597] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:58.310252 18166 consensus_peers.cc:597] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.310969 18166 consensus_peers.cc:597] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.318348 17568 consensus_peers.cc:597] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.326917 17568 consensus_peers.cc:597] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.328243 16329 tablet_replica.cc:333] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.329244 16329 raft_consensus.cc:2243] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.330509 16329 raft_consensus.cc:2272] T cb985f82c610405fb3774fe99cf142e7 P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:58.352205 17339 catalog_manager.cc:4755] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4022f7d9b64e45d18be29fda16f3ecde: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:58.355587 18166 consensus_peers.cc:597] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.353806 17568 consensus_peers.cc:597] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.360157 17569 consensus_peers.cc:597] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.364670 18166 consensus_peers.cc:597] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.376740 16329 tablet_replica.cc:333] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.377859 16329 raft_consensus.cc:2243] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.382578 16329 raft_consensus.cc:2272] T e072fa9bcaa24490bd884d56ff245e5f P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.387418 16329 tablet_replica.cc:333] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.388190 16329 raft_consensus.cc:2243] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 LEADER]: Raft consensus shutting down.
W20260709 13:20:58.389006 18166 consensus_peers.cc:597] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.389257 16329 raft_consensus.cc:2272] T a372191e02cc468bbc747310e2818f07 P ddfe9cca0741489b994f8b0178c54fe7 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:58.408196 17568 consensus_peers.cc:597] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.409621 16329 tablet_replica.cc:333] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
W20260709 13:20:58.410199 18166 consensus_peers.cc:597] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.410274 17568 consensus_peers.cc:597] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.410580 16329 raft_consensus.cc:2243] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:58.410987 17568 consensus_peers.cc:597] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.411226 16329 raft_consensus.cc:2272] T 1a2d603d87b8422dad32dfbb77b7e95c P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.416751 16329 tablet_replica.cc:333] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.417686 16329 raft_consensus.cc:2243] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.418948 16329 raft_consensus.cc:2272] T cb3ad3ce4b124497a737d40423bea33d P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.421772 16329 tablet_replica.cc:333] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.422752 16329 raft_consensus.cc:2243] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.423420 16329 raft_consensus.cc:2272] T 858a1d920b5540b3b9107201e3b32d46 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.426306 16329 tablet_replica.cc:333] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.427170 16329 raft_consensus.cc:2243] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.428457 16329 raft_consensus.cc:2272] T be6cfcb1338b4398b769f6956792bdd7 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.431360 16329 tablet_replica.cc:333] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.432610 16329 raft_consensus.cc:2243] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.433321 16329 raft_consensus.cc:2272] T d4f2604c78c341a88d17d653b9abcbda P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.434932 18192 raft_consensus.cc:1275] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Refusing update from remote peer abf46e430b7e4ad4919ca2a717f37e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:58.436161 16329 tablet_replica.cc:333] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
W20260709 13:20:58.437336 18166 consensus_peers.cc:597] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.439920 23910 consensus_queue.cc:1048] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:58.440888 16329 raft_consensus.cc:2243] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.442466 16329 raft_consensus.cc:2272] T 14b4916b36c24c9bb0562a70795b8ed1 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.445227 16329 tablet_replica.cc:333] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.446002 16329 raft_consensus.cc:2243] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.446720 16329 raft_consensus.cc:2272] T 68e8e6dd889d4bcfabf84cedd079e2f2 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:58.456393 18166 consensus_peers.cc:597] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.457234 17568 consensus_peers.cc:597] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.457846 17568 consensus_peers.cc:597] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.458433 17568 consensus_peers.cc:597] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.465801 17568 consensus_peers.cc:597] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.469261 18166 consensus_peers.cc:597] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.506640 16329 tablet_replica.cc:333] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.508059 16329 raft_consensus.cc:2243] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:20:58.520795 17568 consensus_peers.cc:597] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.522468 16329 raft_consensus.cc:2272] T 8999fe04fedd4bcc9305446ba6f99d23 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.525789 16329 tablet_replica.cc:333] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.526676 16329 raft_consensus.cc:2243] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.527355 16329 raft_consensus.cc:2272] T f83c31b52fc7479896f1f02ab870dc3b P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.530555 16329 tablet_replica.cc:333] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.531250 16329 raft_consensus.cc:2243] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.531805 16329 raft_consensus.cc:2272] T 9d6cb82d38034da9b7efa624d5ed7744 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.536134 16329 tablet_replica.cc:333] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.536929 16329 raft_consensus.cc:2243] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.537853 16329 raft_consensus.cc:2272] T c159f64326b74a248a65dc1dae5c79a0 P ddfe9cca0741489b994f8b0178c54fe7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.540694 16329 tablet_replica.cc:333] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.541601 16329 raft_consensus.cc:2243] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.542490 16329 raft_consensus.cc:2272] T 3dfacd1c614b49b290b54a86d3270339 P ddfe9cca0741489b994f8b0178c54fe7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.545905 16329 tablet_replica.cc:333] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.546831 16329 raft_consensus.cc:2243] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.550298 16329 raft_consensus.cc:2272] T d0843b162ea34017b0c1243e97245db9 P ddfe9cca0741489b994f8b0178c54fe7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.554247 16329 tablet_replica.cc:333] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.555094 16329 raft_consensus.cc:2243] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.556157 16329 raft_consensus.cc:2272] T 253dd23b514c487eaca1aecfa9b6e629 P ddfe9cca0741489b994f8b0178c54fe7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.558962 16329 tablet_replica.cc:333] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.560410 16329 raft_consensus.cc:2243] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.561465 16329 raft_consensus.cc:2272] T e57fe371976a485bbdedfdaa4659dec3 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.564313 16329 tablet_replica.cc:333] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.565128 16329 raft_consensus.cc:2243] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.565802 16329 raft_consensus.cc:2272] T 37ab58b1d58a45d9ba339018260d1ee4 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.568617 16329 tablet_replica.cc:333] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.569509 16329 raft_consensus.cc:2243] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.570075 16329 raft_consensus.cc:2272] T dd986037a248442489c77e1aed466117 P ddfe9cca0741489b994f8b0178c54fe7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.572858 16329 tablet_replica.cc:333] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.573722 16329 raft_consensus.cc:2243] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.574786 16329 raft_consensus.cc:2272] T 4022f7d9b64e45d18be29fda16f3ecde P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.577317 16329 tablet_replica.cc:333] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.578146 16329 raft_consensus.cc:2243] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.579303 16329 raft_consensus.cc:2272] T 0c198fb42e5b400c91f60d6969641780 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.582783 16329 tablet_replica.cc:333] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.583647 16329 raft_consensus.cc:2243] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.584925 16329 raft_consensus.cc:2272] T 810ba5585281416bb8f23e88267d049b P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.587939 16329 tablet_replica.cc:333] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.588769 16329 raft_consensus.cc:2243] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.589349 16329 raft_consensus.cc:2272] T 92cfff7457484bd5b062ad3bc520549e P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.592594 16329 tablet_replica.cc:333] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.593526 16329 raft_consensus.cc:2243] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.594591 16329 raft_consensus.cc:2272] T cf597fe63db446f38a58bcbc792dd49b P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.602401 16329 tablet_replica.cc:333] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.603387 16329 raft_consensus.cc:2243] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.604573 16329 raft_consensus.cc:2272] T ec32c18bcdaa4eca99f08bba98bb1e0e P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.607506 16329 tablet_replica.cc:333] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.608352 16329 raft_consensus.cc:2243] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.608945 16329 raft_consensus.cc:2272] T 6b44f8d5d5454fb7af9630783cd02def P ddfe9cca0741489b994f8b0178c54fe7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.611588 16329 tablet_replica.cc:333] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.612421 16329 raft_consensus.cc:2243] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.613006 16329 raft_consensus.cc:2272] T 2773182c45284396b8fd0513eb349cc4 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.616677 16329 tablet_replica.cc:333] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.617506 16329 raft_consensus.cc:2243] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.618206 16329 raft_consensus.cc:2272] T 262981f7c32f49709e3a56b85e75ffcf P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.622236 16329 tablet_replica.cc:333] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
W20260709 13:20:58.622418 18166 consensus_peers.cc:597] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.623183 16329 raft_consensus.cc:2243] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.624143 16329 raft_consensus.cc:2272] T 545b345ea8d04e8daea29d4a4f6477a9 P ddfe9cca0741489b994f8b0178c54fe7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.627816 16329 tablet_replica.cc:333] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.628604 16329 raft_consensus.cc:2243] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.629200 16329 raft_consensus.cc:2272] T abb20677645b433e839a2f21c9cc2ef3 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.632295 16329 tablet_replica.cc:333] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.633176 16329 raft_consensus.cc:2243] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.633831 16329 raft_consensus.cc:2272] T 4efb13f5c64447d2bbcbef8bc568f882 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.637616 16329 tablet_replica.cc:333] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.638509 16329 raft_consensus.cc:2243] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.639717 16329 raft_consensus.cc:2272] T 7002e0c7a3624420a1737b1fb29d8142 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.642726 16329 tablet_replica.cc:333] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.643481 16329 raft_consensus.cc:2243] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.644091 16329 raft_consensus.cc:2272] T 347905859bee416fb447f19528527f52 P ddfe9cca0741489b994f8b0178c54fe7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.647037 16329 tablet_replica.cc:333] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.647817 16329 raft_consensus.cc:2243] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.648952 16329 raft_consensus.cc:2272] T 306df9e1a44b411595f67a918d6a7a14 P ddfe9cca0741489b994f8b0178c54fe7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.651503 16329 tablet_replica.cc:333] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7: stopping tablet replica
I20260709 13:20:58.652149 16329 raft_consensus.cc:2243] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.652830 16329 raft_consensus.cc:2272] T 0c221353c2c64e8b96d73953eebea083 P ddfe9cca0741489b994f8b0178c54fe7 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:58.688261 18167 consensus_peers.cc:597] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:59.245306 23996 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:59.245993 23996 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.248450 23996 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:59.242477 23925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.004s	sys 0.008s
W20260709 13:20:59.252786 23925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.004s	sys 0.008s
I20260709 13:20:59.657989 24001 raft_consensus.cc:493] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:59.658787 24001 raft_consensus.cc:515] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } }
I20260709 13:20:59.661001 24001 leader_election.cc:290] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:59.711457 17568 leader_election.cc:336] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.769055 18166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.016s	sys 0.000s
W20260709 13:20:59.769557 18166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.017s	sys 0.000s
I20260709 13:20:59.780177 17347 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33624 (request call id 283) took 1102 ms. Trace:
I20260709 13:20:59.780503 24001 raft_consensus.cc:493] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:59.780710 17347 rpcz_store.cc:276] 0709 13:20:58.677957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.770088 (+1092131us) service_pool.cc:224] Handling call
0709 13:20:59.780110 (+ 10022us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:20:59.781411 24001 raft_consensus.cc:515] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:59.784103 24001 leader_election.cc:290] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:59.787660 24002 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:59.788304 24002 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.790580 24002 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:20:59.792475 17568 leader_election.cc:336] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.792778 24002 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:59.793294 23999 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:59.793458 24002 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.793956 23999 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.795878 24002 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:59.796252 23999 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:59.797303 24001 raft_consensus.cc:493] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:59.797987 24001 raft_consensus.cc:515] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.800303 24001 leader_election.cc:290] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:20:59.804050 17568 leader_election.cc:336] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.806234 17569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:36303, user_credentials={real_user=slave}} blocked reactor thread for 1.1069e+06us
I20260709 13:20:59.821930 24012 raft_consensus.cc:493] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:59.822652 24012 raft_consensus.cc:515] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:59.825287 24012 leader_election.cc:290] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:59.826258 24005 raft_consensus.cc:493] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2158c0f750fd4b21afe24135c52167b2)
I20260709 13:20:59.826751 24005 raft_consensus.cc:515] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.828685 24005 leader_election.cc:290] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), 2158c0f750fd4b21afe24135c52167b2 (127.15.242.68:36313)
W20260709 13:20:59.830976 18167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.005s	sys 0.012s
W20260709 13:20:59.831322 18167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.005s	sys 0.012s
I20260709 13:20:59.834163 24002 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:20:59.834685 24002 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.835693 23978 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:59.836264 23978 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.843653 23996 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:20:59.844408 17568 leader_election.cc:336] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.844283 23996 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:20:59.845252 17568 leader_election.cc:336] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.847508 24002 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:20:59.848546 23978 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:59.849589 23996 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:20:59.867378 18166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:40943, user_credentials={real_user=slave}} blocked reactor thread for 60964.6us
I20260709 13:20:59.872610 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262981f7c32f49709e3a56b85e75ffcf" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
I20260709 13:20:59.881692 24004 raft_consensus.cc:493] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:59.882426 24004 raft_consensus.cc:515] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:59.884769 24004 leader_election.cc:290] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:59.887405 18201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd986037a248442489c77e1aed466117" candidate_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2158c0f750fd4b21afe24135c52167b2" is_pre_election: true
W20260709 13:20:59.889360 17569 consensus_peers.cc:597] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:59.901751 24003 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:59.902398 24003 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.903357 23979 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:59.903959 23979 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.904742 24003 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:59.905295 24003 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:59.907230 23979 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:59.905748 24003 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.910351 24003 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:59.911401 18166 leader_election.cc:336] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.913951 17569 leader_election.cc:304] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:59.914812 24004 raft_consensus.cc:2749] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:59.916141 17569 leader_election.cc:304] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 2158c0f750fd4b21afe24135c52167b2, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:59.917035 24004 raft_consensus.cc:2749] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:59.919333 18167 consensus_peers.cc:597] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:59.920045 18167 leader_election.cc:336] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:59.920513 18167 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:59.921398 24003 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:59.922502 18167 consensus_peers.cc:597] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:59.922945 17569 consensus_peers.cc:597] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:59.923130 18167 consensus_peers.cc:597] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:59.923835 17569 leader_election.cc:336] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:59.924206 18167 consensus_peers.cc:597] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:59.924420 17569 leader_election.cc:304] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:59.925256 24004 raft_consensus.cc:2749] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:59.926306 17569 leader_election.cc:336] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:59.926409 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b89997d0ecd4f03a927078433a85a66" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:59.926807 17569 leader_election.cc:304] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:59.927691 24004 raft_consensus.cc:2749] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:59.928298 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a13c485c0a480f8ce9eb1282cb6d01" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:20:59.931435 18166 leader_election.cc:336] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.934675 17569 leader_election.cc:336] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:59.935835 17569 leader_election.cc:336] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:59.936301 17569 leader_election.cc:304] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:59.937218 24004 raft_consensus.cc:2749] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:59.939742 17569 consensus_peers.cc:597] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:59.940828 24004 raft_consensus.cc:493] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:59.941507 24004 raft_consensus.cc:515] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:20:59.942214 24003 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:20:59.942737 24003 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.944005 24004 leader_election.cc:290] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:20:59.944748 24003 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:59.945464 18167 consensus_peers.cc:597] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:59.945932 18167 leader_election.cc:336] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:59.946411 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57fe371976a485bbdedfdaa4659dec3" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
I20260709 13:20:59.948200 17598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83c31b52fc7479896f1f02ab870dc3b" candidate_uuid: "2158c0f750fd4b21afe24135c52167b2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" is_pre_election: true
W20260709 13:20:59.946451 18167 consensus_peers.cc:597] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:59.950192 17569 leader_election.cc:336] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:59.950580 18167 leader_election.cc:336] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:59.951102 18167 leader_election.cc:336] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:59.951452 18167 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:59.952117 24003 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:59.952986 18167 leader_election.cc:336] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:59.955948 18166 leader_election.cc:336] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.957924 24003 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
W20260709 13:20:59.958230 18166 leader_election.cc:336] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.958647 18166 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:59.958495 24003 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:20:59.959502 23996 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:59.959851 18166 leader_election.cc:336] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.960429 18166 leader_election.cc:336] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.960640 24003 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:20:59.960703 17568 leader_election.cc:336] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.961436 17568 leader_election.cc:304] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:59.961822 18167 leader_election.cc:336] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:59.962314 24004 raft_consensus.cc:2749] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:59.962430 18167 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:59.965832 17568 leader_election.cc:336] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.966277 24003 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:59.960981 18166 leader_election.cc:336] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.969765 17568 leader_election.cc:304] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:59.970481 18167 leader_election.cc:336] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:20:59.970690 18166 leader_election.cc:336] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.976318 24004 raft_consensus.cc:2749] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:59.978547 18167 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:59.979442 18167 leader_election.cc:336] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:20:59.979812 18167 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
W20260709 13:20:59.980031 18166 leader_election.cc:336] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.980516 23996 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:59.981334 23996 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:59.982216 18166 leader_election.cc:336] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.987305 18167 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:59.988276 24003 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:59.989511 18167 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:20:59.990303 24003 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:59.996544 18167 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:59.997319 24003 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:59.998903 18167 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:20:59.999877 24003 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:00.003153 18167 leader_election.cc:336] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:21:00.003660 18167 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:00.012913 24003 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:00.018671 24004 raft_consensus.cc:493] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:21:00.019622 24004 raft_consensus.cc:515] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } }
I20260709 13:21:00.022869 24004 leader_election.cc:290] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:21:00.023396 18167 leader_election.cc:336] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:21:00.024046 18167 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:00.025020 24003 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:00.028728 17569 leader_election.cc:336] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:21:00.044775 17569 consensus_peers.cc:597] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:00.046780 17569 consensus_peers.cc:597] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:00.042786 17568 leader_election.cc:336] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
I20260709 13:21:00.047937 17568 leader_election.cc:304] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abf46e430b7e4ad4919ca2a717f37e0e; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:00.048733 24005 raft_consensus.cc:2749] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:00.203692 17569 consensus_peers.cc:597] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:00.218963 17569 consensus_peers.cc:597] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:00.236878 17569 consensus_peers.cc:597] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:00.240648 18167 consensus_peers.cc:597] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:00.247732 18167 consensus_peers.cc:597] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:00.249233 18167 consensus_peers.cc:597] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:00.259203 17568 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111) [suppressed 472 similar messages]
W20260709 13:21:00.280143 17624 debug-util.cc:398] Leaking SignalData structure 0x7b08003897a0 after lost signal to thread 16332
W20260709 13:21:00.281191 17624 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6aa0 after lost signal to thread 17386
W20260709 13:21:00.281752 17624 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6980 after lost signal to thread 17553
W20260709 13:21:00.282857 17624 debug-util.cc:398] Leaking SignalData structure 0x7b080009ae60 after lost signal to thread 17627
W20260709 13:21:00.284005 17624 debug-util.cc:398] Leaking SignalData structure 0x7b080009ac80 after lost signal to thread 18225
W20260709 13:21:00.315263 18167 consensus_peers.cc:597] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:00.325362 17569 consensus_peers.cc:597] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:00.366166 17569 consensus_peers.cc:597] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:00.454488 17569 consensus_peers.cc:597] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:00.461628 17339 catalog_manager.cc:4755] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4022f7d9b64e45d18be29fda16f3ecde: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:21:00.480906 17569 consensus_peers.cc:597] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:00.572378 18167 consensus_peers.cc:597] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:00.681609 17569 consensus_peers.cc:597] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:00.822666 18167 consensus_peers.cc:597] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:00.843076 18167 consensus_peers.cc:597] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:00.866267 16329 tablet_server.cc:196] TabletServer@127.15.242.66:0 shutdown complete.
W20260709 13:21:00.920174 17569 consensus_peers.cc:597] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:01.033679 16329 tablet_server.cc:179] TabletServer@127.15.242.67:0 shutting down...
W20260709 13:21:01.048823 18167 consensus_peers.cc:597] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.073113 18167 consensus_peers.cc:597] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.090435 18167 consensus_peers.cc:597] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.096838 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:01.097872 16329 tablet_replica.cc:333] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.098551 16329 raft_consensus.cc:2243] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.099617 16329 raft_consensus.cc:2272] T 7398c91e7a884284a8b806d47551eaf7 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.102079 16329 tablet_replica.cc:333] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.102727 16329 raft_consensus.cc:2243] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.103598 16329 raft_consensus.cc:2272] T da520cc299d940b68e5655cd8094d48e P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.106611 16329 tablet_replica.cc:333] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.107457 16329 raft_consensus.cc:2243] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.108207 16329 raft_consensus.cc:2272] T 777822978f904e159194479932f1936f P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.110918 16329 tablet_replica.cc:333] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.111696 16329 raft_consensus.cc:2243] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.112551 16329 raft_consensus.cc:2272] T 45a13c485c0a480f8ce9eb1282cb6d01 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.114746 16329 tablet_replica.cc:333] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.115485 16329 raft_consensus.cc:2243] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.116197 16329 raft_consensus.cc:2272] T 0c6864e5b711423291c531e98224c311 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.118481 16329 tablet_replica.cc:333] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.119139 16329 raft_consensus.cc:2243] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.119962 16329 raft_consensus.cc:2272] T a851f7fe7702439a9a695c117b09f6ae P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.122066 16329 tablet_replica.cc:333] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.122658 16329 raft_consensus.cc:2243] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.123561 16329 raft_consensus.cc:2272] T 8fad2b3d8f774d4ca47be967955fb28b P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.126099 16329 tablet_replica.cc:333] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.126839 16329 raft_consensus.cc:2243] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.127373 16329 raft_consensus.cc:2272] T cb985f82c610405fb3774fe99cf142e7 P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.130250 16329 tablet_replica.cc:333] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.131150 16329 raft_consensus.cc:2243] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.132176 16329 raft_consensus.cc:2272] T e072fa9bcaa24490bd884d56ff245e5f P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.134433 16329 tablet_replica.cc:333] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.135000 16329 raft_consensus.cc:2243] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.135828 16329 raft_consensus.cc:2272] T 6b3434da716f41f0bc0eb393a53152ed P abf46e430b7e4ad4919ca2a717f37e0e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.138397 16329 tablet_replica.cc:333] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.139258 16329 raft_consensus.cc:2243] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.139833 16329 raft_consensus.cc:2272] T bea493621f1e42c2b8689859233cc798 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.142285 16329 tablet_replica.cc:333] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.143124 16329 raft_consensus.cc:2243] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.143690 16329 raft_consensus.cc:2272] T 1a2d603d87b8422dad32dfbb77b7e95c P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.146262 16329 tablet_replica.cc:333] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.147060 16329 raft_consensus.cc:2243] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.148119 16329 raft_consensus.cc:2272] T cb3ad3ce4b124497a737d40423bea33d P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.150543 16329 tablet_replica.cc:333] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.151234 16329 raft_consensus.cc:2243] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.151841 16329 raft_consensus.cc:2272] T 2edee9f2356c4e878f2e11af63e46ab9 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.154191 16329 tablet_replica.cc:333] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.154937 16329 raft_consensus.cc:2243] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.155841 16329 raft_consensus.cc:2272] T 92cfff7457484bd5b062ad3bc520549e P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.158368 16329 tablet_replica.cc:333] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.159154 16329 raft_consensus.cc:2243] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.160177 16329 raft_consensus.cc:2272] T 68e8e6dd889d4bcfabf84cedd079e2f2 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.162530 16329 tablet_replica.cc:333] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.163376 16329 raft_consensus.cc:2243] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:01.163574 17569 consensus_peers.cc:597] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:01.164122 16329 raft_consensus.cc:2272] T 8999fe04fedd4bcc9305446ba6f99d23 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.166566 16329 tablet_replica.cc:333] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.167373 16329 raft_consensus.cc:2243] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.168431 16329 raft_consensus.cc:2272] T f83c31b52fc7479896f1f02ab870dc3b P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.170774 16329 tablet_replica.cc:333] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.171319 16329 raft_consensus.cc:2243] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.172224 16329 raft_consensus.cc:2272] T d4f2604c78c341a88d17d653b9abcbda P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.174640 16329 tablet_replica.cc:333] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.175324 16329 raft_consensus.cc:2243] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.176378 16329 raft_consensus.cc:2272] T 9d6cb82d38034da9b7efa624d5ed7744 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.177105 18166 consensus_peers.cc:597] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.178534 16329 tablet_replica.cc:333] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.179374 16329 raft_consensus.cc:2243] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.180071 16329 raft_consensus.cc:2272] T f1c40484b7a540a9b32947573409178a P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.182461 16329 tablet_replica.cc:333] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.183110 16329 raft_consensus.cc:2243] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.184070 16329 raft_consensus.cc:2272] T 3dfacd1c614b49b290b54a86d3270339 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.186257 16329 tablet_replica.cc:333] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.186851 16329 raft_consensus.cc:2243] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.187714 16329 raft_consensus.cc:2272] T 253dd23b514c487eaca1aecfa9b6e629 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.189890 16329 tablet_replica.cc:333] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.190783 16329 raft_consensus.cc:2243] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.191949 16329 raft_consensus.cc:2272] T e57fe371976a485bbdedfdaa4659dec3 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.194747 16329 tablet_replica.cc:333] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
W20260709 13:21:01.195499 18167 consensus_peers.cc:597] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.195618 16329 raft_consensus.cc:2243] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.196555 16329 raft_consensus.cc:2272] T 37ab58b1d58a45d9ba339018260d1ee4 P abf46e430b7e4ad4919ca2a717f37e0e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.198752 16329 tablet_replica.cc:333] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.199425 16329 raft_consensus.cc:2243] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.200058 16329 raft_consensus.cc:2272] T dd986037a248442489c77e1aed466117 P abf46e430b7e4ad4919ca2a717f37e0e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.202179 16329 tablet_replica.cc:333] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.202749 16329 raft_consensus.cc:2243] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.203274 16329 raft_consensus.cc:2272] T 0c198fb42e5b400c91f60d6969641780 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.205176 16329 tablet_replica.cc:333] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.205756 16329 raft_consensus.cc:2243] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.206650 16329 raft_consensus.cc:2272] T f16762b5a82d4310ad01b31fd99d5921 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.209285 16329 tablet_replica.cc:333] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.210132 16329 raft_consensus.cc:2243] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.211026 16329 raft_consensus.cc:2272] T 347905859bee416fb447f19528527f52 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.212798 18167 consensus_peers.cc:597] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.213495 16329 tablet_replica.cc:333] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.214226 16329 raft_consensus.cc:2243] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.214773 16329 raft_consensus.cc:2272] T 306df9e1a44b411595f67a918d6a7a14 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.216822 16329 tablet_replica.cc:333] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.217428 16329 raft_consensus.cc:2243] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.218340 16329 raft_consensus.cc:2272] T 0c221353c2c64e8b96d73953eebea083 P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.220415 16329 tablet_replica.cc:333] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.221220 16329 raft_consensus.cc:2243] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.221995 16329 raft_consensus.cc:2272] T 6b44f8d5d5454fb7af9630783cd02def P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.224447 16329 tablet_replica.cc:333] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.225289 16329 raft_consensus.cc:2243] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.225940 16329 raft_consensus.cc:2272] T 262981f7c32f49709e3a56b85e75ffcf P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.228492 16329 tablet_replica.cc:333] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.229743 16329 raft_consensus.cc:2243] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.230317 16329 raft_consensus.cc:2272] T 810ba5585281416bb8f23e88267d049b P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.232623 16329 tablet_replica.cc:333] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.233254 16329 raft_consensus.cc:2243] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.234285 16329 raft_consensus.cc:2272] T ea190a19aed74ffea2c29fa8c13edeac P abf46e430b7e4ad4919ca2a717f37e0e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.236362 16329 tablet_replica.cc:333] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.236927 16329 raft_consensus.cc:2243] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.237485 16329 raft_consensus.cc:2272] T 916155438d0e450f9fdbbb449eee2721 P abf46e430b7e4ad4919ca2a717f37e0e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.240002 16329 tablet_replica.cc:333] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.240818 16329 raft_consensus.cc:2243] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.241456 16329 raft_consensus.cc:2272] T 2773182c45284396b8fd0513eb349cc4 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.244071 16329 tablet_replica.cc:333] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.244874 16329 raft_consensus.cc:2243] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.245429 16329 raft_consensus.cc:2272] T 42a91336a4f94e5db0ce4fa334e9bd37 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.248312 16329 tablet_replica.cc:333] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.248982 16329 raft_consensus.cc:2243] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.249851 16329 raft_consensus.cc:2272] T 4022f7d9b64e45d18be29fda16f3ecde P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.251785 16329 tablet_replica.cc:333] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.252295 16329 raft_consensus.cc:2243] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.253227 16329 raft_consensus.cc:2272] T abb20677645b433e839a2f21c9cc2ef3 P abf46e430b7e4ad4919ca2a717f37e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.256275 16329 tablet_replica.cc:333] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.257120 16329 raft_consensus.cc:2243] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.258154 16329 raft_consensus.cc:2272] T 4efb13f5c64447d2bbcbef8bc568f882 P abf46e430b7e4ad4919ca2a717f37e0e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.260761 16329 tablet_replica.cc:333] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.261526 16329 raft_consensus.cc:2243] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.262753 16329 raft_consensus.cc:2272] T 1b89997d0ecd4f03a927078433a85a66 P abf46e430b7e4ad4919ca2a717f37e0e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.265620 16329 tablet_replica.cc:333] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.266438 16329 raft_consensus.cc:2243] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.266963 16329 raft_consensus.cc:2272] T dcd29f6044f6485580736010a0122d2b P abf46e430b7e4ad4919ca2a717f37e0e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.267740 18167 consensus_peers.cc:597] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.269662 16329 tablet_replica.cc:333] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e: stopping tablet replica
I20260709 13:21:01.270339 16329 raft_consensus.cc:2243] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.271232 16329 raft_consensus.cc:2272] T 858a1d920b5540b3b9107201e3b32d46 P abf46e430b7e4ad4919ca2a717f37e0e [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.272743 18167 consensus_peers.cc:597] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.304716 18167 consensus_peers.cc:597] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.377955 18167 consensus_peers.cc:597] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.386155 18166 consensus_peers.cc:597] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.394297 18167 consensus_peers.cc:597] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.411129 18167 consensus_peers.cc:597] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.413352 18167 consensus_peers.cc:597] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.426127 18167 consensus_peers.cc:597] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.492394 18167 consensus_peers.cc:597] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.537266 18166 consensus_peers.cc:597] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.540015 24024 raft_consensus.cc:493] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:21:01.540705 24024 raft_consensus.cc:515] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:01.542846 24024 leader_election.cc:290] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:21:01.547305 18166 leader_election.cc:336] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
W20260709 13:21:01.551594 18167 leader_election.cc:336] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:21:01.553164 18167 leader_election.cc:304] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:01.554855 24027 raft_consensus.cc:2749] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:21:01.570734 18167 consensus_peers.cc:597] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 -> Peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Couldn't send request to peer abf46e430b7e4ad4919ca2a717f37e0e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.578855 18166 consensus_peers.cc:597] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.693454 18166 consensus_peers.cc:597] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.735236 18166 consensus_peers.cc:597] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.755985 18166 consensus_peers.cc:597] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.765239 18166 consensus_peers.cc:597] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.776283 24027 raft_consensus.cc:493] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:21:01.777035 24027 raft_consensus.cc:515] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:01.779386 24027 leader_election.cc:290] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:21:01.784391 18167 leader_election.cc:336] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:21:01.784953 18166 leader_election.cc:336] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
I20260709 13:21:01.785535 18166 leader_election.cc:304] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:01.786188 24027 raft_consensus.cc:2749] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:01.811894 24027 raft_consensus.cc:493] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:21:01.812654 24027 raft_consensus.cc:515] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:01.814621 24027 leader_election.cc:290] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:21:01.818320 18167 leader_election.cc:336] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:21:01.819284 18166 leader_election.cc:336] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
I20260709 13:21:01.819681 18166 leader_election.cc:304] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:01.820354 24027 raft_consensus.cc:2749] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:01.847246 18167 consensus_peers.cc:597] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:01.850178 18166 consensus_peers.cc:597] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.916745 18166 consensus_peers.cc:597] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.922914 24027 raft_consensus.cc:493] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:21:01.923524 24027 raft_consensus.cc:515] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:01.926119 24027 leader_election.cc:290] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:21:01.930546 18167 leader_election.cc:336] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:21:01.931366 18166 leader_election.cc:336] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
I20260709 13:21:01.931941 18166 leader_election.cc:304] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:01.933169 24027 raft_consensus.cc:2749] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:01.948335 18167 consensus_peers.cc:597] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:01.967669 18166 consensus_peers.cc:597] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:02.010705 18166 consensus_peers.cc:597] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:02.038615 18166 consensus_peers.cc:597] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.074139 24024 raft_consensus.cc:493] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:21:02.074689 24024 raft_consensus.cc:515] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.076754 24024 leader_election.cc:290] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
I20260709 13:21:02.081548 24024 raft_consensus.cc:493] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:21:02.082103 24024 raft_consensus.cc:515] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:21:02.083781 18166 leader_election.cc:336] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
I20260709 13:21:02.084110 24024 leader_election.cc:290] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:21:02.084401 18166 consensus_peers.cc:597] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:02.084756 18167 leader_election.cc:336] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:21:02.085160 18167 leader_election.cc:304] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:02.085812 24024 raft_consensus.cc:2749] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:02.090639 18166 leader_election.cc:336] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
W20260709 13:21:02.091853 18167 leader_election.cc:336] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:21:02.092258 18167 leader_election.cc:304] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:02.092918 24024 raft_consensus.cc:2749] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:02.093786 18166 consensus_peers.cc:597] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 -> Peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Couldn't send request to peer ddfe9cca0741489b994f8b0178c54fe7. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.126551 24024 raft_consensus.cc:493] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:21:02.127233 24024 raft_consensus.cc:515] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.129606 24024 leader_election.cc:290] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:21:02.135042 18166 leader_election.cc:336] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
W20260709 13:21:02.135607 18167 leader_election.cc:336] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:21:02.136272 18167 leader_election.cc:304] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:02.137275 24024 raft_consensus.cc:2749] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:02.140853 18167 consensus_peers.cc:597] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:02.154935 24024 raft_consensus.cc:493] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddfe9cca0741489b994f8b0178c54fe7)
I20260709 13:21:02.155550 24024 raft_consensus.cc:515] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.157829 24024 leader_election.cc:290] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943)
W20260709 13:21:02.162753 18166 leader_election.cc:336] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
W20260709 13:21:02.163241 18167 leader_election.cc:336] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:21:02.163653 18167 leader_election.cc:304] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:02.164258 24024 raft_consensus.cc:2749] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:02.174345 24024 raft_consensus.cc:493] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.174832 24024 raft_consensus.cc:515] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.176707 24024 leader_election.cc:290] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:21:02.180420 18166 leader_election.cc:336] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
W20260709 13:21:02.181070 18167 leader_election.cc:336] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
I20260709 13:21:02.181411 18167 leader_election.cc:304] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:02.181993 24024 raft_consensus.cc:2749] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:02.192970 24024 raft_consensus.cc:493] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.193459 24024 raft_consensus.cc:515] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.195487 24024 leader_election.cc:290] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:21:02.200979 18167 consensus_peers.cc:597] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:02.201455 18167 leader_election.cc:336] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:21:02.202165 18167 leader_election.cc:336] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
I20260709 13:21:02.202565 18167 leader_election.cc:304] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:21:02.203295 24024 raft_consensus.cc:2749] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:21:02.204686 18167 consensus_peers.cc:597] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:02.264040 18167 consensus_peers.cc:597] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:02.321107 18167 consensus_peers.cc:597] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:02.336699 24024 raft_consensus.cc:493] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.337184 24024 raft_consensus.cc:515] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.339486 24024 leader_election.cc:290] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:21:02.342559 18167 leader_election.cc:336] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
W20260709 13:21:02.344249 18166 leader_election.cc:336] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
I20260709 13:21:02.344653 18166 leader_election.cc:304] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:02.345325 24024 raft_consensus.cc:2749] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:02.353016 24027 raft_consensus.cc:493] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.353780 24027 raft_consensus.cc:515] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.356065 24027 leader_election.cc:290] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:21:02.356418 24024 raft_consensus.cc:493] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.357023 24024 raft_consensus.cc:515] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.358824 24024 leader_election.cc:290] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:21:02.362095 18167 leader_election.cc:336] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
W20260709 13:21:02.362596 18167 leader_election.cc:336] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
W20260709 13:21:02.362747 18166 leader_election.cc:336] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
I20260709 13:21:02.363221 18166 leader_election.cc:304] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:02.363814 24024 raft_consensus.cc:2749] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:21:02.363982 18166 leader_election.cc:336] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
I20260709 13:21:02.364408 18166 leader_election.cc:304] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:02.365090 24027 raft_consensus.cc:2749] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:02.407459 24027 raft_consensus.cc:493] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.408031 24027 raft_consensus.cc:515] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.410157 24027 leader_election.cc:290] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
I20260709 13:21:02.412075 24027 raft_consensus.cc:493] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.412559 24027 raft_consensus.cc:515] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.414463 24027 leader_election.cc:290] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:21:02.414786 18167 leader_election.cc:336] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:21:02.416105 18167 leader_election.cc:336] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
I20260709 13:21:02.416484 18167 leader_election.cc:304] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:21:02.417157 24027 raft_consensus.cc:2749] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:21:02.418607 24027 raft_consensus.cc:493] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
W20260709 13:21:02.418975 18167 leader_election.cc:336] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
I20260709 13:21:02.419068 24027 raft_consensus.cc:515] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
W20260709 13:21:02.419642 18166 leader_election.cc:336] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
I20260709 13:21:02.420056 18166 leader_election.cc:304] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:02.420750 24024 raft_consensus.cc:2749] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:02.421352 24027 leader_election.cc:290] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:21:02.424628 18166 leader_election.cc:336] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
W20260709 13:21:02.425128 18167 leader_election.cc:336] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
I20260709 13:21:02.425529 18167 leader_election.cc:304] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:02.426250 24027 raft_consensus.cc:2749] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:02.435379 18167 consensus_peers.cc:597] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:02.455389 24024 raft_consensus.cc:493] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.456040 24024 raft_consensus.cc:515] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.458405 24024 leader_election.cc:290] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:21:02.462663 18167 leader_election.cc:336] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:21:02.463609 18167 leader_election.cc:336] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
I20260709 13:21:02.463999 18167 leader_election.cc:304] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:21:02.464663 24027 raft_consensus.cc:2749] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:21:02.477447 24027 raft_consensus.cc:493] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.477917 24027 raft_consensus.cc:515] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ddfe9cca0741489b994f8b0178c54fe7" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40943 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.479722 24027 leader_election.cc:290] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:21:02.485201 18166 leader_election.cc:336] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ddfe9cca0741489b994f8b0178c54fe7 (127.15.242.66:40943): Network error: Client connection negotiation failed: client connection to 127.15.242.66:40943: connect: Connection refused (error 111)
W20260709 13:21:02.485777 18167 leader_election.cc:336] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
I20260709 13:21:02.486299 18167 leader_election.cc:304] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: abf46e430b7e4ad4919ca2a717f37e0e, ddfe9cca0741489b994f8b0178c54fe7
I20260709 13:21:02.486946 24027 raft_consensus.cc:2749] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:02.499338 18167 consensus_peers.cc:597] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:02.501374 24027 raft_consensus.cc:493] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.501950 24027 raft_consensus.cc:515] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.503999 24027 leader_election.cc:290] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:21:02.508483 18167 leader_election.cc:336] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:21:02.509059 18167 leader_election.cc:336] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
I20260709 13:21:02.509361 18167 leader_election.cc:304] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:21:02.509958 24027 raft_consensus.cc:2749] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:02.559083 24026 raft_consensus.cc:493] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.559674 24026 raft_consensus.cc:515] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.561757 24026 leader_election.cc:290] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:21:02.565948 18167 leader_election.cc:336] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
W20260709 13:21:02.569669 18167 leader_election.cc:336] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:21:02.570152 18167 leader_election.cc:304] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:21:02.570894 24026 raft_consensus.cc:2749] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:02.579106 18167 consensus_peers.cc:597] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:02.586512 24026 raft_consensus.cc:493] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.587138 24026 raft_consensus.cc:515] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.588945 24026 leader_election.cc:290] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:21:02.593048 18167 leader_election.cc:336] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:21:02.593672 18167 leader_election.cc:336] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
I20260709 13:21:02.594008 18167 leader_election.cc:304] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:21:02.594753 24026 raft_consensus.cc:2749] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:21:02.600409 18167 consensus_peers.cc:597] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:02.607640 24026 raft_consensus.cc:493] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader abf46e430b7e4ad4919ca2a717f37e0e)
I20260709 13:21:02.608232 24026 raft_consensus.cc:515] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0480cf54c3cc424ab94b963ef2ff5bf4" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 36303 } } peers { permanent_uuid: "abf46e430b7e4ad4919ca2a717f37e0e" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36581 } } peers { permanent_uuid: "2158c0f750fd4b21afe24135c52167b2" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 36313 } attrs { promote: false } }
I20260709 13:21:02.610337 24026 leader_election.cc:290] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303), abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581)
W20260709 13:21:02.614665 18167 leader_election.cc:336] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
W20260709 13:21:02.615574 18167 leader_election.cc:336] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer abf46e430b7e4ad4919ca2a717f37e0e (127.15.242.67:36581): Network error: Client connection negotiation failed: client connection to 127.15.242.67:36581: connect: Connection refused (error 111)
I20260709 13:21:02.615913 18167 leader_election.cc:304] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2158c0f750fd4b21afe24135c52167b2; no voters: 0480cf54c3cc424ab94b963ef2ff5bf4, abf46e430b7e4ad4919ca2a717f37e0e
I20260709 13:21:02.616483 24026 raft_consensus.cc:2749] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:02.933230 16329 tablet_server.cc:196] TabletServer@127.15.242.67:0 shutdown complete.
W20260709 13:21:02.953685 18167 consensus_peers.cc:597] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:03.020787 18167 consensus_peers.cc:597] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 -> Peer 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): Couldn't send request to peer 0480cf54c3cc424ab94b963ef2ff5bf4. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:03.041491 16329 tablet_server.cc:179] TabletServer@127.15.242.68:0 shutting down...
I20260709 13:21:03.105886 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:03.107045 16329 tablet_replica.cc:333] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.108162 16329 raft_consensus.cc:2243] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.109005 16329 raft_consensus.cc:2272] T 4022f7d9b64e45d18be29fda16f3ecde P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.111477 16329 tablet_replica.cc:333] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.112147 16329 raft_consensus.cc:2243] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.112757 16329 raft_consensus.cc:2272] T 68e8e6dd889d4bcfabf84cedd079e2f2 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.114864 16329 tablet_replica.cc:333] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.115474 16329 raft_consensus.cc:2243] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.116405 16329 raft_consensus.cc:2272] T 43e1920c304743e78e8b777b3b7ea7f3 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.118642 16329 tablet_replica.cc:333] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.119270 16329 raft_consensus.cc:2243] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.119792 16329 raft_consensus.cc:2272] T 1cf63370ef7f41519349f91e85c42d19 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.121908 16329 tablet_replica.cc:333] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.122546 16329 raft_consensus.cc:2243] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.123291 16329 raft_consensus.cc:2272] T abb20677645b433e839a2f21c9cc2ef3 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.125886 16329 tablet_replica.cc:333] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.126629 16329 raft_consensus.cc:2243] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.127115 16329 raft_consensus.cc:2272] T 7002e0c7a3624420a1737b1fb29d8142 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.129071 16329 tablet_replica.cc:333] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.129683 16329 raft_consensus.cc:2243] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.130695 16329 raft_consensus.cc:2272] T f1c40484b7a540a9b32947573409178a P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.132800 16329 tablet_replica.cc:333] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.133359 16329 raft_consensus.cc:2243] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.133882 16329 raft_consensus.cc:2272] T 253dd23b514c487eaca1aecfa9b6e629 P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.136801 16329 tablet_replica.cc:333] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.137521 16329 raft_consensus.cc:2243] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.138409 16329 raft_consensus.cc:2272] T 347905859bee416fb447f19528527f52 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.140801 16329 tablet_replica.cc:333] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.141410 16329 raft_consensus.cc:2243] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.142386 16329 raft_consensus.cc:2272] T bea493621f1e42c2b8689859233cc798 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.144449 16329 tablet_replica.cc:333] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.145282 16329 raft_consensus.cc:2243] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.146147 16329 raft_consensus.cc:2272] T 2773182c45284396b8fd0513eb349cc4 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.148065 16329 tablet_replica.cc:333] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.148669 16329 raft_consensus.cc:2243] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.149215 16329 raft_consensus.cc:2272] T da520cc299d940b68e5655cd8094d48e P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.151310 16329 tablet_replica.cc:333] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.151906 16329 raft_consensus.cc:2243] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.152412 16329 raft_consensus.cc:2272] T f83c31b52fc7479896f1f02ab870dc3b P 2158c0f750fd4b21afe24135c52167b2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.154393 16329 tablet_replica.cc:333] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.154954 16329 raft_consensus.cc:2243] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.155499 16329 raft_consensus.cc:2272] T 14b4916b36c24c9bb0562a70795b8ed1 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.157409 16329 tablet_replica.cc:333] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.157979 16329 raft_consensus.cc:2243] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.158588 16329 raft_consensus.cc:2272] T 6b3434da716f41f0bc0eb393a53152ed P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.160495 16329 tablet_replica.cc:333] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.161077 16329 raft_consensus.cc:2243] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.161965 16329 raft_consensus.cc:2272] T 92cfff7457484bd5b062ad3bc520549e P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.163762 16329 tablet_replica.cc:333] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.164422 16329 raft_consensus.cc:2243] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.165302 16329 raft_consensus.cc:2272] T cf597fe63db446f38a58bcbc792dd49b P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.167351 16329 tablet_replica.cc:333] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.167932 16329 raft_consensus.cc:2243] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.168784 16329 raft_consensus.cc:2272] T 6b44f8d5d5454fb7af9630783cd02def P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.170612 16329 tablet_replica.cc:333] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.171236 16329 raft_consensus.cc:2243] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.171705 16329 raft_consensus.cc:2272] T e57fe371976a485bbdedfdaa4659dec3 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.173914 16329 tablet_replica.cc:333] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.174791 16329 raft_consensus.cc:2243] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.175683 16329 raft_consensus.cc:2272] T 2edee9f2356c4e878f2e11af63e46ab9 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.178104 16329 tablet_replica.cc:333] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.178710 16329 raft_consensus.cc:2243] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.179230 16329 raft_consensus.cc:2272] T 1b89997d0ecd4f03a927078433a85a66 P 2158c0f750fd4b21afe24135c52167b2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.181212 16329 tablet_replica.cc:333] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.181766 16329 raft_consensus.cc:2243] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.182575 16329 raft_consensus.cc:2272] T dcd29f6044f6485580736010a0122d2b P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.184506 16329 tablet_replica.cc:333] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.185083 16329 raft_consensus.cc:2243] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.185652 16329 raft_consensus.cc:2272] T be6cfcb1338b4398b769f6956792bdd7 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.187810 16329 tablet_replica.cc:333] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.188373 16329 raft_consensus.cc:2243] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.189217 16329 raft_consensus.cc:2272] T 262981f7c32f49709e3a56b85e75ffcf P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.191203 16329 tablet_replica.cc:333] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.191782 16329 raft_consensus.cc:2243] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.192351 16329 raft_consensus.cc:2272] T 8e901a2e51634e18807d1c4292e3f285 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.194602 16329 tablet_replica.cc:333] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.195171 16329 raft_consensus.cc:2243] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.195720 16329 raft_consensus.cc:2272] T 8fad2b3d8f774d4ca47be967955fb28b P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.197650 16329 tablet_replica.cc:333] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.198246 16329 raft_consensus.cc:2243] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.198704 16329 raft_consensus.cc:2272] T 7398c91e7a884284a8b806d47551eaf7 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.200837 16329 tablet_replica.cc:333] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.201397 16329 raft_consensus.cc:2243] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.201951 16329 raft_consensus.cc:2272] T f16762b5a82d4310ad01b31fd99d5921 P 2158c0f750fd4b21afe24135c52167b2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.203927 16329 tablet_replica.cc:333] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.204485 16329 raft_consensus.cc:2243] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.204939 16329 raft_consensus.cc:2272] T a372191e02cc468bbc747310e2818f07 P 2158c0f750fd4b21afe24135c52167b2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.206884 16329 tablet_replica.cc:333] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.207444 16329 raft_consensus.cc:2243] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.207962 16329 raft_consensus.cc:2272] T dac17c6792414180963986e500f47356 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.210183 16329 tablet_replica.cc:333] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.210780 16329 raft_consensus.cc:2243] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.211591 16329 raft_consensus.cc:2272] T 42a91336a4f94e5db0ce4fa334e9bd37 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.213510 16329 tablet_replica.cc:333] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.214393 16329 raft_consensus.cc:2243] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.215293 16329 raft_consensus.cc:2272] T 545b345ea8d04e8daea29d4a4f6477a9 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.217306 16329 tablet_replica.cc:333] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.217944 16329 raft_consensus.cc:2243] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.218637 16329 raft_consensus.cc:2272] T ec32c18bcdaa4eca99f08bba98bb1e0e P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.221472 16329 tablet_replica.cc:333] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.222075 16329 raft_consensus.cc:2243] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.222862 16329 raft_consensus.cc:2272] T d0843b162ea34017b0c1243e97245db9 P 2158c0f750fd4b21afe24135c52167b2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.226102 16329 tablet_replica.cc:333] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.226902 16329 raft_consensus.cc:2243] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.227674 16329 raft_consensus.cc:2272] T ea190a19aed74ffea2c29fa8c13edeac P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.230144 16329 tablet_replica.cc:333] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.230718 16329 raft_consensus.cc:2243] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.231779 16329 raft_consensus.cc:2272] T 916155438d0e450f9fdbbb449eee2721 P 2158c0f750fd4b21afe24135c52167b2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.233868 16329 tablet_replica.cc:333] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.234519 16329 raft_consensus.cc:2243] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.235368 16329 raft_consensus.cc:2272] T dd986037a248442489c77e1aed466117 P 2158c0f750fd4b21afe24135c52167b2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.237198 16329 tablet_replica.cc:333] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.237775 16329 raft_consensus.cc:2243] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.238660 16329 raft_consensus.cc:2272] T 37ab58b1d58a45d9ba339018260d1ee4 P 2158c0f750fd4b21afe24135c52167b2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.240716 16329 tablet_replica.cc:333] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.241242 16329 raft_consensus.cc:2243] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.241971 16329 raft_consensus.cc:2272] T c159f64326b74a248a65dc1dae5c79a0 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.243953 16329 tablet_replica.cc:333] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.244458 16329 raft_consensus.cc:2243] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.245050 16329 raft_consensus.cc:2272] T 45a13c485c0a480f8ce9eb1282cb6d01 P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.247126 16329 tablet_replica.cc:333] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.247656 16329 raft_consensus.cc:2243] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.248680 16329 raft_consensus.cc:2272] T 777822978f904e159194479932f1936f P 2158c0f750fd4b21afe24135c52167b2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.250645 16329 tablet_replica.cc:333] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.251179 16329 raft_consensus.cc:2243] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.252068 16329 raft_consensus.cc:2272] T 36043ed9ab7c47e9882fa33c5c135545 P 2158c0f750fd4b21afe24135c52167b2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.254758 16329 tablet_replica.cc:333] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.255465 16329 raft_consensus.cc:2243] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.256286 16329 raft_consensus.cc:2272] T 12ca126b355348958188e14e8b1c7470 P 2158c0f750fd4b21afe24135c52167b2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.258446 16329 tablet_replica.cc:333] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2: stopping tablet replica
I20260709 13:21:03.258951 16329 raft_consensus.cc:2243] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.259760 16329 raft_consensus.cc:2272] T 1a2d603d87b8422dad32dfbb77b7e95c P 2158c0f750fd4b21afe24135c52167b2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.702728 16329 tablet_server.cc:196] TabletServer@127.15.242.68:0 shutdown complete.
I20260709 13:21:03.821583 16329 master.cc:562] Master@127.15.242.126:39589 shutting down...
W20260709 13:21:04.596802 17339 catalog_manager.cc:4755] TS 0480cf54c3cc424ab94b963ef2ff5bf4 (127.15.242.65:36303): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4022f7d9b64e45d18be29fda16f3ecde: Network error: Client connection negotiation failed: client connection to 127.15.242.65:36303: connect: Connection refused (error 111)
I20260709 13:21:04.625504 16329 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:04.626672 16329 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.627125 16329 tablet_replica.cc:333] T 00000000000000000000000000000000 P c6b0d42b8daf43a291946b809079b0d7: stopping tablet replica
I20260709 13:21:04.753439 16329 master.cc:584] Master@127.15.242.126:39589 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (205166 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:21:04.868412 16329 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.242.126:42991
I20260709 13:21:04.869592 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:04.876696 24033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:04.877108 24034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:04.878893 24036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:04.882298 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:04.884724 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:04.884927 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:04.885049 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603264885038 us; error 0 us; skew 500 ppm
I20260709 13:21:04.885493 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:04.887969 16329 webserver.cc:533] Webserver started at http://127.15.242.126:43975/ using document root <none> and password file <none>
I20260709 13:21:04.888427 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:04.888581 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:04.888795 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:04.890096 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/master-0-root/instance:
uuid: "fd725a448b4949ce974e95420329ff6d"
format_stamp: "Formatted at 2026-07-09 13:21:04 on dist-test-slave-fh5z"
I20260709 13:21:04.894853 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:04.898423 24041 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:04.899216 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:21:04.899541 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/master-0-root
uuid: "fd725a448b4949ce974e95420329ff6d"
format_stamp: "Formatted at 2026-07-09 13:21:04 on dist-test-slave-fh5z"
I20260709 13:21:04.899854 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:04.912822 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:04.914134 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:04.955412 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.126:42991
I20260709 13:21:04.955536 24092 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.126:42991 every 8 connection(s)
I20260709 13:21:04.959748 24093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.971076 24093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d: Bootstrap starting.
I20260709 13:21:04.975888 24093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:04.981262 24093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d: No bootstrap required, opened a new log
I20260709 13:21:04.983690 24093 raft_consensus.cc:359] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd725a448b4949ce974e95420329ff6d" member_type: VOTER }
I20260709 13:21:04.984158 24093 raft_consensus.cc:385] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:04.984376 24093 raft_consensus.cc:740] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd725a448b4949ce974e95420329ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:21:04.984911 24093 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd725a448b4949ce974e95420329ff6d" member_type: VOTER }
I20260709 13:21:04.985370 24093 raft_consensus.cc:399] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:04.985603 24093 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:04.985846 24093 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:04.990823 24093 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd725a448b4949ce974e95420329ff6d" member_type: VOTER }
I20260709 13:21:04.991339 24093 leader_election.cc:304] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd725a448b4949ce974e95420329ff6d; no voters: 
I20260709 13:21:04.992522 24093 leader_election.cc:290] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:04.992905 24096 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:04.994380 24096 raft_consensus.cc:697] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [term 1 LEADER]: Becoming Leader. State: Replica: fd725a448b4949ce974e95420329ff6d, State: Running, Role: LEADER
I20260709 13:21:04.995177 24096 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd725a448b4949ce974e95420329ff6d" member_type: VOTER }
I20260709 13:21:04.995702 24093 sys_catalog.cc:565] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:05.002528 24097 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd725a448b4949ce974e95420329ff6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd725a448b4949ce974e95420329ff6d" member_type: VOTER } }
I20260709 13:21:05.003512 24097 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:05.006510 24098 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd725a448b4949ce974e95420329ff6d. Latest consensus state: current_term: 1 leader_uuid: "fd725a448b4949ce974e95420329ff6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd725a448b4949ce974e95420329ff6d" member_type: VOTER } }
I20260709 13:21:05.008524 24098 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:05.012537 24102 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:05.018236 24102 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:05.022716 16329 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:05.028440 24102 catalog_manager.cc:1383] Generated new cluster ID: bd3f077f72db46bf9c7180dc69392af5
I20260709 13:21:05.028775 24102 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:05.044561 24102 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:05.046213 24102 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:05.060395 24102 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d: Generated new TSK 0
I20260709 13:21:05.061053 24102 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:05.089704 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:05.096019 24114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:05.097235 24115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:05.101969 24117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:05.103379 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:05.105820 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:05.106088 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:05.106238 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603265106223 us; error 0 us; skew 500 ppm
I20260709 13:21:05.106720 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:05.109179 16329 webserver.cc:533] Webserver started at http://127.15.242.65:41997/ using document root <none> and password file <none>
I20260709 13:21:05.109622 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:05.109772 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:05.109985 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:05.111171 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/instance:
uuid: "97e577a376c948bfac33665f06a4bb98"
format_stamp: "Formatted at 2026-07-09 13:21:05 on dist-test-slave-fh5z"
I20260709 13:21:05.115921 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:21:05.120157 24122 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:05.121313 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 13:21:05.121867 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-0-root
uuid: "97e577a376c948bfac33665f06a4bb98"
format_stamp: "Formatted at 2026-07-09 13:21:05 on dist-test-slave-fh5z"
I20260709 13:21:05.122319 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:05.145886 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:05.147181 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:05.148717 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:05.151293 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:05.151562 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:05.151821 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:05.152009 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:05.195531 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.65:39703
I20260709 13:21:05.195675 24184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.65:39703 every 8 connection(s)
I20260709 13:21:05.200862 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:05.208920 24189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:05.212134 24192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:05.212687 24190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:05.215170 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:05.215894 24185 heartbeater.cc:344] Connected to a master server at 127.15.242.126:42991
I20260709 13:21:05.216289 24185 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:05.217087 24185 heartbeater.cc:507] Master 127.15.242.126:42991 requested a full tablet report, sending...
I20260709 13:21:05.217804 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:05.218098 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:05.218297 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603265218274 us; error 0 us; skew 500 ppm
I20260709 13:21:05.219352 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:05.219617 24058 ts_manager.cc:194] Registered new tserver with Master: 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:05.221884 24058 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56930
I20260709 13:21:05.221958 16329 webserver.cc:533] Webserver started at http://127.15.242.66:46441/ using document root <none> and password file <none>
I20260709 13:21:05.222645 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:05.222853 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:05.223177 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:05.224635 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/instance:
uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
format_stamp: "Formatted at 2026-07-09 13:21:05 on dist-test-slave-fh5z"
I20260709 13:21:05.229243 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:05.232940 24197 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:05.233887 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:21:05.234319 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-1-root
uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
format_stamp: "Formatted at 2026-07-09 13:21:05 on dist-test-slave-fh5z"
I20260709 13:21:05.234650 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:05.258297 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:05.259580 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:05.261204 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:05.263654 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:05.263890 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:05.264225 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:05.264472 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:05.312119 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.66:34445
I20260709 13:21:05.312215 24259 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.66:34445 every 8 connection(s)
I20260709 13:21:05.317783 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:05.326092 24263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:05.327935 24264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:05.328652 24266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:05.328711 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:05.330269 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:05.330550 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:05.330765 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603265330746 us; error 0 us; skew 500 ppm
I20260709 13:21:05.331336 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:05.332022 24260 heartbeater.cc:344] Connected to a master server at 127.15.242.126:42991
I20260709 13:21:05.332500 24260 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:05.333386 24260 heartbeater.cc:507] Master 127.15.242.126:42991 requested a full tablet report, sending...
I20260709 13:21:05.334319 16329 webserver.cc:533] Webserver started at http://127.15.242.67:36853/ using document root <none> and password file <none>
I20260709 13:21:05.334924 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:05.335147 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:05.335420 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:05.335853 24058 ts_manager.cc:194] Registered new tserver with Master: 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:05.337358 24058 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56938
I20260709 13:21:05.337422 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/instance:
uuid: "b8c6aaf55421432a91a73360865771d3"
format_stamp: "Formatted at 2026-07-09 13:21:05 on dist-test-slave-fh5z"
I20260709 13:21:05.342906 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:21:05.346752 24271 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:05.347658 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:21:05.348018 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-2-root
uuid: "b8c6aaf55421432a91a73360865771d3"
format_stamp: "Formatted at 2026-07-09 13:21:05 on dist-test-slave-fh5z"
I20260709 13:21:05.348471 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:05.372355 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:05.373723 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:05.375514 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:05.378795 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:05.379074 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:05.379359 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:05.379571 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:05.430373 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.67:46833
I20260709 13:21:05.430467 24333 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.67:46833 every 8 connection(s)
I20260709 13:21:05.436053 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:05.446659 24337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:05.448069 24338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:05.451216 24334 heartbeater.cc:344] Connected to a master server at 127.15.242.126:42991
I20260709 13:21:05.451757 24334 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:05.452762 24334 heartbeater.cc:507] Master 127.15.242.126:42991 requested a full tablet report, sending...
I20260709 13:21:05.452988 16329 server_base.cc:1061] running on GCE node
W20260709 13:21:05.453287 24340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:05.454562 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:05.454810 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:05.455035 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603265454998 us; error 0 us; skew 500 ppm
I20260709 13:21:05.455379 24058 ts_manager.cc:194] Registered new tserver with Master: b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:05.455592 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:05.457298 24058 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56942
I20260709 13:21:05.458626 16329 webserver.cc:533] Webserver started at http://127.15.242.68:34675/ using document root <none> and password file <none>
I20260709 13:21:05.459172 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:05.459383 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:05.459658 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:05.460793 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-3-root/instance:
uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
format_stamp: "Formatted at 2026-07-09 13:21:05 on dist-test-slave-fh5z"
I20260709 13:21:05.465329 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:05.468925 24345 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:05.469951 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:21:05.470305 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-3-root
uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
format_stamp: "Formatted at 2026-07-09 13:21:05 on dist-test-slave-fh5z"
I20260709 13:21:05.470580 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:05.492240 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:05.493494 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:05.494855 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:05.497249 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:05.497442 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:05.497747 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:05.497889 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:05.553944 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.68:44365
I20260709 13:21:05.554167 24407 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.68:44365 every 8 connection(s)
I20260709 13:21:05.570323 24408 heartbeater.cc:344] Connected to a master server at 127.15.242.126:42991
I20260709 13:21:05.570785 24408 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:05.571547 24408 heartbeater.cc:507] Master 127.15.242.126:42991 requested a full tablet report, sending...
I20260709 13:21:05.573622 24058 ts_manager.cc:194] Registered new tserver with Master: 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:05.573956 16329 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016681052s
I20260709 13:21:05.576035 24058 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56954
I20260709 13:21:05.604903 24058 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56958:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:21:05.883947 24299 tablet_service.cc:1511] Processing CreateTablet for tablet 0b184e3a09204b16a54a19c799fe3491 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:05.885557 24299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b184e3a09204b16a54a19c799fe3491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.887234 24298 tablet_service.cc:1511] Processing CreateTablet for tablet 0814205560524ce18e70c58645190dcd (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:05.887502 24149 tablet_service.cc:1511] Processing CreateTablet for tablet 0814205560524ce18e70c58645190dcd (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:05.888772 24298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0814205560524ce18e70c58645190dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.888566 24147 tablet_service.cc:1511] Processing CreateTablet for tablet 2e20ad9ccb7d416fb78ca24817f25f01 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:05.889226 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0814205560524ce18e70c58645190dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.890319 24147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e20ad9ccb7d416fb78ca24817f25f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.891273 24297 tablet_service.cc:1511] Processing CreateTablet for tablet f6350c1629234440b97877600cb50d2a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:05.892647 24297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6350c1629234440b97877600cb50d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.893648 24146 tablet_service.cc:1511] Processing CreateTablet for tablet dcd592b9cef049dfbfa3d0ee1ab44c41 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:05.895269 24146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd592b9cef049dfbfa3d0ee1ab44c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.895365 24148 tablet_service.cc:1511] Processing CreateTablet for tablet 926dce38ed89423898a8cd9ca37e1f7e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:05.896441 24150 tablet_service.cc:1511] Processing CreateTablet for tablet 0b184e3a09204b16a54a19c799fe3491 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:05.896917 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926dce38ed89423898a8cd9ca37e1f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.902446 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b184e3a09204b16a54a19c799fe3491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.902832 24145 tablet_service.cc:1511] Processing CreateTablet for tablet 61ca07974685419bbf6372e6306542e8 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:05.904417 24145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ca07974685419bbf6372e6306542e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.908872 24296 tablet_service.cc:1511] Processing CreateTablet for tablet 2e20ad9ccb7d416fb78ca24817f25f01 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:05.909258 24144 tablet_service.cc:1511] Processing CreateTablet for tablet 08f87db850ae4d62b879e989d7572ad8 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:05.910353 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e20ad9ccb7d416fb78ca24817f25f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.910940 24144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f87db850ae4d62b879e989d7572ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.914441 24295 tablet_service.cc:1511] Processing CreateTablet for tablet 61ca07974685419bbf6372e6306542e8 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:05.915838 24295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ca07974685419bbf6372e6306542e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.919241 24143 tablet_service.cc:1511] Processing CreateTablet for tablet 965a2d41972049e2975015ab66773956 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:05.920663 24143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965a2d41972049e2975015ab66773956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.923259 24142 tablet_service.cc:1511] Processing CreateTablet for tablet c29861adc1e34aeb8b9916d115af5f9b (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:05.924707 24142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29861adc1e34aeb8b9916d115af5f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.927901 24293 tablet_service.cc:1511] Processing CreateTablet for tablet 08f87db850ae4d62b879e989d7572ad8 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:05.929476 24293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f87db850ae4d62b879e989d7572ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.929212 24292 tablet_service.cc:1511] Processing CreateTablet for tablet c29861adc1e34aeb8b9916d115af5f9b (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:05.932461 24292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29861adc1e34aeb8b9916d115af5f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.927907 24294 tablet_service.cc:1511] Processing CreateTablet for tablet cfb70981888a450ca715b1ed427ba95e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:05.933758 24294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfb70981888a450ca715b1ed427ba95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.940810 24373 tablet_service.cc:1511] Processing CreateTablet for tablet 0b184e3a09204b16a54a19c799fe3491 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:05.943061 24373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b184e3a09204b16a54a19c799fe3491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.953536 24372 tablet_service.cc:1511] Processing CreateTablet for tablet 926dce38ed89423898a8cd9ca37e1f7e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:05.955070 24372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926dce38ed89423898a8cd9ca37e1f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.953562 24291 tablet_service.cc:1511] Processing CreateTablet for tablet bb6f84753e2b4220a883363c1561af3a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:05.960124 24291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6f84753e2b4220a883363c1561af3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.963924 24371 tablet_service.cc:1511] Processing CreateTablet for tablet f6350c1629234440b97877600cb50d2a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:05.966658 24371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6350c1629234440b97877600cb50d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.971467 24141 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7d5de1a9b448969e2db6601b724c9c (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:05.973143 24141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7d5de1a9b448969e2db6601b724c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.983575 24370 tablet_service.cc:1511] Processing CreateTablet for tablet dcd592b9cef049dfbfa3d0ee1ab44c41 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:05.985416 24370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd592b9cef049dfbfa3d0ee1ab44c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.991976 24369 tablet_service.cc:1511] Processing CreateTablet for tablet 61ca07974685419bbf6372e6306542e8 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:05.993654 24369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ca07974685419bbf6372e6306542e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:05.996059 24368 tablet_service.cc:1511] Processing CreateTablet for tablet cfb70981888a450ca715b1ed427ba95e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:05.997653 24368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfb70981888a450ca715b1ed427ba95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.006700 24225 tablet_service.cc:1511] Processing CreateTablet for tablet 0814205560524ce18e70c58645190dcd (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:06.008419 24225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0814205560524ce18e70c58645190dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.009060 24224 tablet_service.cc:1511] Processing CreateTablet for tablet 926dce38ed89423898a8cd9ca37e1f7e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:06.011400 24223 tablet_service.cc:1511] Processing CreateTablet for tablet f6350c1629234440b97877600cb50d2a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:06.012765 24221 tablet_service.cc:1511] Processing CreateTablet for tablet dcd592b9cef049dfbfa3d0ee1ab44c41 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:06.013703 24219 tablet_service.cc:1511] Processing CreateTablet for tablet 08f87db850ae4d62b879e989d7572ad8 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:06.015174 24220 tablet_service.cc:1511] Processing CreateTablet for tablet cfb70981888a450ca715b1ed427ba95e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:06.016476 24218 tablet_service.cc:1511] Processing CreateTablet for tablet 965a2d41972049e2975015ab66773956 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
W20260709 13:21:06.019935 24106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:06.011423 24222 tablet_service.cc:1511] Processing CreateTablet for tablet 2e20ad9ccb7d416fb78ca24817f25f01 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:06.023293 24217 tablet_service.cc:1511] Processing CreateTablet for tablet bb6f84753e2b4220a883363c1561af3a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:06.025048 24224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926dce38ed89423898a8cd9ca37e1f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.031229 24221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd592b9cef049dfbfa3d0ee1ab44c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.035775 24298 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7d5de1a9b448969e2db6601b724c9c (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:06.038122 24216 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7d5de1a9b448969e2db6601b724c9c (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:06.038142 24298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7d5de1a9b448969e2db6601b724c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.044237 24367 tablet_service.cc:1511] Processing CreateTablet for tablet 965a2d41972049e2975015ab66773956 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:06.048823 24366 tablet_service.cc:1511] Processing CreateTablet for tablet c29861adc1e34aeb8b9916d115af5f9b (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:06.037860 24218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965a2d41972049e2975015ab66773956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.049559 24365 tablet_service.cc:1511] Processing CreateTablet for tablet bb6f84753e2b4220a883363c1561af3a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:06.051030 24223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6350c1629234440b97877600cb50d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.052450 24367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965a2d41972049e2975015ab66773956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.052850 24364 tablet_service.cc:1511] Processing CreateTablet for tablet fc15fe782c914a21a8001515c189022a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:06.054495 24217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6f84753e2b4220a883363c1561af3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.054590 24364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc15fe782c914a21a8001515c189022a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.060966 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e20ad9ccb7d416fb78ca24817f25f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.065471 24219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f87db850ae4d62b879e989d7572ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.079469 24365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6f84753e2b4220a883363c1561af3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.082819 24366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29861adc1e34aeb8b9916d115af5f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.086330 24220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfb70981888a450ca715b1ed427ba95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.106287 24148 tablet_service.cc:1511] Processing CreateTablet for tablet fc15fe782c914a21a8001515c189022a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:06.108354 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc15fe782c914a21a8001515c189022a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.113628 24216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7d5de1a9b448969e2db6601b724c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.131786 24428 tablet_bootstrap.cc:492] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:06.164286 24428 tablet_bootstrap.cc:654] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:06.181587 24224 tablet_service.cc:1511] Processing CreateTablet for tablet fc15fe782c914a21a8001515c189022a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:06.183207 24224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc15fe782c914a21a8001515c189022a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.211194 24430 tablet_bootstrap.cc:492] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:06.217911 24295 tablet_service.cc:1511] Processing CreateTablet for tablet ae2833e9ae264f259ce3c2967ad5bc2d (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:06.220129 24295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2833e9ae264f259ce3c2967ad5bc2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.228171 24185 heartbeater.cc:499] Master 127.15.242.126:42991 was elected leader, sending a full tablet report...
I20260709 13:21:06.244971 24428 tablet_bootstrap.cc:492] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:06.245831 24428 ts_tablet_manager.cc:1403] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.115s	user 0.033s	sys 0.031s
I20260709 13:21:06.247470 24373 tablet_service.cc:1511] Processing CreateTablet for tablet ae2833e9ae264f259ce3c2967ad5bc2d (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:06.248962 24373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2833e9ae264f259ce3c2967ad5bc2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.250698 24429 tablet_bootstrap.cc:492] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:06.251055 24428 raft_consensus.cc:359] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:06.253298 24428 raft_consensus.cc:385] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:06.254129 24428 raft_consensus.cc:740] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:06.255858 24428 consensus_queue.cc:260] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:06.260841 24364 tablet_service.cc:1511] Processing CreateTablet for tablet b5e41c560ee74f5c860ed22ba1487d2d (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:06.260161 24143 tablet_service.cc:1511] Processing CreateTablet for tablet ae2833e9ae264f259ce3c2967ad5bc2d (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:06.263545 24294 tablet_service.cc:1511] Processing CreateTablet for tablet b5e41c560ee74f5c860ed22ba1487d2d (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:06.264573 24143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2833e9ae264f259ce3c2967ad5bc2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.265077 24294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e41c560ee74f5c860ed22ba1487d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.274574 24364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e41c560ee74f5c860ed22ba1487d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.274483 24144 tablet_service.cc:1511] Processing CreateTablet for tablet 449b9227c5fd46caa8fb8daa040867e9 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:06.276166 24144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449b9227c5fd46caa8fb8daa040867e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.279310 24217 tablet_service.cc:1511] Processing CreateTablet for tablet b5e41c560ee74f5c860ed22ba1487d2d (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:06.280978 24217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e41c560ee74f5c860ed22ba1487d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.289633 24430 tablet_bootstrap.cc:654] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:06.294627 24429 tablet_bootstrap.cc:654] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:06.308233 24428 ts_tablet_manager.cc:1434] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.062s	user 0.015s	sys 0.012s
I20260709 13:21:06.309240 24334 heartbeater.cc:499] Master 127.15.242.126:42991 was elected leader, sending a full tablet report...
I20260709 13:21:06.309558 24428 tablet_bootstrap.cc:492] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:06.316790 24428 tablet_bootstrap.cc:654] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:06.316708 24216 tablet_service.cc:1511] Processing CreateTablet for tablet 449b9227c5fd46caa8fb8daa040867e9 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:06.318497 24216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449b9227c5fd46caa8fb8daa040867e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.322938 24298 tablet_service.cc:1511] Processing CreateTablet for tablet 449b9227c5fd46caa8fb8daa040867e9 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:06.324465 24298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449b9227c5fd46caa8fb8daa040867e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.322906 24431 tablet_bootstrap.cc:492] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:06.343400 24260 heartbeater.cc:499] Master 127.15.242.126:42991 was elected leader, sending a full tablet report...
I20260709 13:21:06.349277 24369 tablet_service.cc:1511] Processing CreateTablet for tablet b5172214c61f4935bce32538470f1ef8 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:06.351073 24369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5172214c61f4935bce32538470f1ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.364017 24430 tablet_bootstrap.cc:492] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:06.365646 24431 tablet_bootstrap.cc:654] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:06.369030 24430 ts_tablet_manager.cc:1403] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.158s	user 0.025s	sys 0.017s
I20260709 13:21:06.388466 24430 raft_consensus.cc:359] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:06.390213 24430 raft_consensus.cc:385] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:06.390122 24143 tablet_service.cc:1511] Processing CreateTablet for tablet b5172214c61f4935bce32538470f1ef8 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:06.390659 24430 raft_consensus.cc:740] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:06.391687 24143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5172214c61f4935bce32538470f1ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.391604 24430 consensus_queue.cc:260] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:06.393958 24365 tablet_service.cc:1511] Processing CreateTablet for tablet f41cf4b67fba4c29b17c18984f51368f (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:06.395859 24365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f41cf4b67fba4c29b17c18984f51368f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.396865 24294 tablet_service.cc:1511] Processing CreateTablet for tablet f41cf4b67fba4c29b17c18984f51368f (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:06.398983 24294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f41cf4b67fba4c29b17c18984f51368f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.403505 24218 tablet_service.cc:1511] Processing CreateTablet for tablet b5172214c61f4935bce32538470f1ef8 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:06.405596 24218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5172214c61f4935bce32538470f1ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.410135 24150 tablet_service.cc:1511] Processing CreateTablet for tablet f41cf4b67fba4c29b17c18984f51368f (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:06.412057 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f41cf4b67fba4c29b17c18984f51368f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:06.435418 24335 tablet.cc:2406] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:06.435776 24222 tablet_service.cc:1511] Processing CreateTablet for tablet c67fd67822294670b224a43c149b126f (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:06.437278 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67fd67822294670b224a43c149b126f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.446403 24429 tablet_bootstrap.cc:492] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:06.447052 24429 ts_tablet_manager.cc:1403] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.197s	user 0.013s	sys 0.024s
I20260709 13:21:06.450385 24429 raft_consensus.cc:359] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:06.451189 24429 raft_consensus.cc:385] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:06.451524 24429 raft_consensus.cc:740] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:06.452499 24429 consensus_queue.cc:260] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:06.453975 24295 tablet_service.cc:1511] Processing CreateTablet for tablet c67fd67822294670b224a43c149b126f (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:06.454768 24431 tablet_bootstrap.cc:492] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:06.455291 24431 ts_tablet_manager.cc:1403] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.027s
I20260709 13:21:06.455374 24295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67fd67822294670b224a43c149b126f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.458457 24431 raft_consensus.cc:359] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:06.459316 24431 raft_consensus.cc:385] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:06.459669 24431 raft_consensus.cc:740] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:06.460709 24431 consensus_queue.cc:260] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:06.485512 24430 ts_tablet_manager.cc:1434] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.116s	user 0.014s	sys 0.034s
I20260709 13:21:06.491626 24430 tablet_bootstrap.cc:492] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:06.492551 24428 tablet_bootstrap.cc:492] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:06.493160 24428 ts_tablet_manager.cc:1403] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.184s	user 0.020s	sys 0.020s
I20260709 13:21:06.503098 24144 tablet_service.cc:1511] Processing CreateTablet for tablet 96813b389fd14d7890c804a06966b952 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:06.503582 24364 tablet_service.cc:1511] Processing CreateTablet for tablet c67fd67822294670b224a43c149b126f (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:06.505069 24144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96813b389fd14d7890c804a06966b952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.505206 24364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67fd67822294670b224a43c149b126f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.504774 24428 raft_consensus.cc:359] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:06.505785 24428 raft_consensus.cc:385] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:06.513478 24408 heartbeater.cc:499] Master 127.15.242.126:42991 was elected leader, sending a full tablet report...
I20260709 13:21:06.514302 24439 raft_consensus.cc:493] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.514873 24439 raft_consensus.cc:515] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:06.516285 24430 tablet_bootstrap.cc:654] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:06.521467 24295 tablet_service.cc:1511] Processing CreateTablet for tablet 96813b389fd14d7890c804a06966b952 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:06.523164 24295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96813b389fd14d7890c804a06966b952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.524479 24369 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfc3f1f066843e382fa402c8d4ec110 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:06.512346 24428 raft_consensus.cc:740] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:06.526556 24369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfc3f1f066843e382fa402c8d4ec110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.526809 24428 consensus_queue.cc:260] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:06.533738 24428 ts_tablet_manager.cc:1434] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 13:21:06.534919 24428 tablet_bootstrap.cc:492] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:06.536679 24433 raft_consensus.cc:493] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.537231 24433 raft_consensus.cc:515] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:06.566721 24217 tablet_service.cc:1511] Processing CreateTablet for tablet 96813b389fd14d7890c804a06966b952 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:06.568482 24217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96813b389fd14d7890c804a06966b952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.542196 24433 leader_election.cc:290] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:06.551276 24439 leader_election.cc:290] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:06.581604 24216 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfc3f1f066843e382fa402c8d4ec110 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:06.583216 24216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfc3f1f066843e382fa402c8d4ec110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.584491 24372 tablet_service.cc:1511] Processing CreateTablet for tablet feff48c38ffe40ec83c61e469590bab2 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:06.586171 24429 ts_tablet_manager.cc:1434] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.135s	user 0.011s	sys 0.006s
I20260709 13:21:06.581643 24141 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfc3f1f066843e382fa402c8d4ec110 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:06.587440 24429 tablet_bootstrap.cc:492] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:06.587677 24141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfc3f1f066843e382fa402c8d4ec110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.596065 24372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feff48c38ffe40ec83c61e469590bab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.602814 24431 ts_tablet_manager.cc:1434] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.147s	user 0.010s	sys 0.014s
I20260709 13:21:06.604215 24431 tablet_bootstrap.cc:492] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:06.605870 24428 tablet_bootstrap.cc:654] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:06.586081 24150 tablet_service.cc:1511] Processing CreateTablet for tablet feff48c38ffe40ec83c61e469590bab2 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:06.627058 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feff48c38ffe40ec83c61e469590bab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.647513 24431 tablet_bootstrap.cc:654] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:06.649957 24433 raft_consensus.cc:493] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.650729 24433 raft_consensus.cc:515] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:06.654649 24433 leader_election.cc:290] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:06.654814 24438 raft_consensus.cc:493] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.658406 24438 raft_consensus.cc:515] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:06.678315 24438 leader_election.cc:290] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:06.678404 24145 tablet_service.cc:1511] Processing CreateTablet for tablet f4118ee5e16a4387ac189a181756ba0b (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:06.679957 24145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4118ee5e16a4387ac189a181756ba0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.680464 24373 tablet_service.cc:1511] Processing CreateTablet for tablet 8336ccf163c04dfa94f4eb0109695563 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:06.680830 24367 tablet_service.cc:1511] Processing CreateTablet for tablet 1022101d02354929a4335f20304fdcb0 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:06.681937 24373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8336ccf163c04dfa94f4eb0109695563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.691612 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965a2d41972049e2975015ab66773956" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:06.693634 24218 tablet_service.cc:1511] Processing CreateTablet for tablet 8336ccf163c04dfa94f4eb0109695563 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
W20260709 13:21:06.695245 24125 leader_election.cc:343] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:06.695429 24218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8336ccf163c04dfa94f4eb0109695563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.707916 24148 tablet_service.cc:1511] Processing CreateTablet for tablet 1022101d02354929a4335f20304fdcb0 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:06.709522 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1022101d02354929a4335f20304fdcb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.710435 24366 tablet_service.cc:1511] Processing CreateTablet for tablet 94b95f5240b5450d968047f65e13d4ea (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:06.712196 24147 tablet_service.cc:1511] Processing CreateTablet for tablet d768d2f1ef2449b5b035c41ed3fa15bd (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:06.713606 24147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d768d2f1ef2449b5b035c41ed3fa15bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.720373 24429 tablet_bootstrap.cc:654] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:06.704090 24367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1022101d02354929a4335f20304fdcb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.722957 24366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b95f5240b5450d968047f65e13d4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.725453 24428 tablet_bootstrap.cc:492] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:06.697189 24222 tablet_service.cc:1511] Processing CreateTablet for tablet f4118ee5e16a4387ac189a181756ba0b (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:06.726365 24428 ts_tablet_manager.cc:1403] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.192s	user 0.028s	sys 0.010s
I20260709 13:21:06.726974 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4118ee5e16a4387ac189a181756ba0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.730248 24428 raft_consensus.cc:359] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:06.737013 24428 raft_consensus.cc:385] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:06.738533 24428 raft_consensus.cc:740] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:06.739451 24428 consensus_queue.cc:260] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:06.742224 24428 ts_tablet_manager.cc:1434] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:21:06.743374 24428 tablet_bootstrap.cc:492] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:06.714022 24430 tablet_bootstrap.cc:492] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:06.754225 24369 tablet_service.cc:1511] Processing CreateTablet for tablet d768d2f1ef2449b5b035c41ed3fa15bd (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:06.756134 24369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d768d2f1ef2449b5b035c41ed3fa15bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.757412 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0814205560524ce18e70c58645190dcd" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:06.759976 24274 leader_election.cc:343] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:06.762573 24221 tablet_service.cc:1511] Processing CreateTablet for tablet 1022101d02354929a4335f20304fdcb0 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:06.763494 24430 ts_tablet_manager.cc:1403] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.274s	user 0.015s	sys 0.015s
I20260709 13:21:06.763689 24142 tablet_service.cc:1511] Processing CreateTablet for tablet dbb065e24bd14e7f86badfbb68d51325 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:06.764276 24221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1022101d02354929a4335f20304fdcb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.765021 24142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb065e24bd14e7f86badfbb68d51325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.771665 24294 tablet_service.cc:1511] Processing CreateTablet for tablet feff48c38ffe40ec83c61e469590bab2 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:06.772619 24299 tablet_service.cc:1511] Processing CreateTablet for tablet d768d2f1ef2449b5b035c41ed3fa15bd (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:06.773202 24294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feff48c38ffe40ec83c61e469590bab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.774346 24291 tablet_service.cc:1511] Processing CreateTablet for tablet 94b95f5240b5450d968047f65e13d4ea (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:06.775674 24291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b95f5240b5450d968047f65e13d4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.775480 24296 tablet_service.cc:1511] Processing CreateTablet for tablet f4118ee5e16a4387ac189a181756ba0b (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:06.776782 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4118ee5e16a4387ac189a181756ba0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.786789 24299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d768d2f1ef2449b5b035c41ed3fa15bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.792609 24430 raft_consensus.cc:359] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:06.793567 24292 tablet_service.cc:1511] Processing CreateTablet for tablet dbb065e24bd14e7f86badfbb68d51325 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:06.795125 24292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb065e24bd14e7f86badfbb68d51325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.773128 24298 tablet_service.cc:1511] Processing CreateTablet for tablet 8336ccf163c04dfa94f4eb0109695563 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:06.796315 24298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8336ccf163c04dfa94f4eb0109695563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.793567 24430 raft_consensus.cc:385] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:06.796898 24430 raft_consensus.cc:740] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:06.800308 24430 consensus_queue.cc:260] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:06.806844 24430 ts_tablet_manager.cc:1434] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.003s
I20260709 13:21:06.808005 24430 tablet_bootstrap.cc:492] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:06.816783 24428 tablet_bootstrap.cc:654] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:06.876793 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6350c1629234440b97877600cb50d2a" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
W20260709 13:21:06.878520 24274 leader_election.cc:343] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:06.884811 24373 tablet_service.cc:1511] Processing CreateTablet for tablet 95192d3963414bdfac891aba6df47f7c (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:06.888108 24373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95192d3963414bdfac891aba6df47f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.895632 24150 tablet_service.cc:1511] Processing CreateTablet for tablet 95192d3963414bdfac891aba6df47f7c (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:06.900822 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95192d3963414bdfac891aba6df47f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.935094 24366 tablet_service.cc:1511] Processing CreateTablet for tablet d13a5255f4d444b984355f509d3a7918 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:06.937958 24366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13a5255f4d444b984355f509d3a7918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.943606 24148 tablet_service.cc:1511] Processing CreateTablet for tablet d13a5255f4d444b984355f509d3a7918 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:06.948685 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965a2d41972049e2975015ab66773956" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:06.950387 24440 raft_consensus.cc:493] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.950007 24217 tablet_service.cc:1511] Processing CreateTablet for tablet 94b95f5240b5450d968047f65e13d4ea (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:06.952092 24217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b95f5240b5450d968047f65e13d4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.951395 24440 raft_consensus.cc:515] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
W20260709 13:21:06.952700 24123 leader_election.cc:343] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:06.953205 24123 leader_election.cc:304] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:06.954115 24439 raft_consensus.cc:2749] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:06.945905 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13a5255f4d444b984355f509d3a7918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.931551 24291 tablet_service.cc:1511] Processing CreateTablet for tablet d13a5255f4d444b984355f509d3a7918 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:06.962898 24291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13a5255f4d444b984355f509d3a7918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.963435 24220 tablet_service.cc:1511] Processing CreateTablet for tablet 95192d3963414bdfac891aba6df47f7c (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:06.966480 24220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95192d3963414bdfac891aba6df47f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.950135 24216 tablet_service.cc:1511] Processing CreateTablet for tablet dbb065e24bd14e7f86badfbb68d51325 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:06.977382 24440 leader_election.cc:290] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:06.987679 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0814205560524ce18e70c58645190dcd" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:06.983228 24216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb065e24bd14e7f86badfbb68d51325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:06.993597 24235 raft_consensus.cc:2468] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 0.
I20260709 13:21:07.006605 24272 leader_election.cc:304] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:07.007740 24433 raft_consensus.cc:2804] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:07.008226 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6350c1629234440b97877600cb50d2a" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:07.008265 24433 raft_consensus.cc:493] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.010233 24433 raft_consensus.cc:3060] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:07.039229 24428 tablet_bootstrap.cc:492] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:07.045535 24428 ts_tablet_manager.cc:1403] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.302s	user 0.017s	sys 0.024s
I20260709 13:21:07.050635 24218 tablet_service.cc:1511] Processing CreateTablet for tablet c64b5ba5e5d84dd78ae3c83e7c375709 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:07.052744 24218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64b5ba5e5d84dd78ae3c83e7c375709. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:07.061823 24106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:07.069097 24365 tablet_service.cc:1511] Processing CreateTablet for tablet c64b5ba5e5d84dd78ae3c83e7c375709 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:07.070843 24431 tablet_bootstrap.cc:492] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:07.071432 24431 ts_tablet_manager.cc:1403] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.467s	user 0.028s	sys 0.014s
W20260709 13:21:07.070128 24272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:34445, user_credentials={real_user=slave}} blocked reactor thread for 63811.8us
I20260709 13:21:07.072006 24141 tablet_service.cc:1511] Processing CreateTablet for tablet 619d34e00ecc47839c94d82bacd2add7 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 13:21:07.072403 24272 leader_election.cc:343] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.073050 24272 leader_election.cc:304] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:07.073477 24365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64b5ba5e5d84dd78ae3c83e7c375709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.076375 24461 raft_consensus.cc:2749] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:07.077585 24141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619d34e00ecc47839c94d82bacd2add7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.078316 24429 tablet_bootstrap.cc:492] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:07.078887 24429 ts_tablet_manager.cc:1403] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.492s	user 0.085s	sys 0.044s
I20260709 13:21:07.082655 24430 tablet_bootstrap.cc:700] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent opening tablet: real 0.168s	user 0.002s	sys 0.003s
I20260709 13:21:07.083498 24430 tablet_bootstrap.cc:654] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.088382 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0814205560524ce18e70c58645190dcd" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:07.088639 24431 raft_consensus.cc:359] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:07.089432 24431 raft_consensus.cc:385] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.089735 24431 raft_consensus.cc:740] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.090692 24438 raft_consensus.cc:493] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.091189 24438 raft_consensus.cc:515] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:07.092712 24433 raft_consensus.cc:515] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:07.093731 24438 leader_election.cc:290] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:07.090523 24431 consensus_queue.cc:260] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
W20260709 13:21:07.095073 24200 leader_election.cc:343] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.096681 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926dce38ed89423898a8cd9ca37e1f7e" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:07.102495 24200 leader_election.cc:343] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.103013 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0814205560524ce18e70c58645190dcd" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:07.103911 24309 raft_consensus.cc:2393] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e96a35df00e4646b9c6e356c6fb4bba in current term 1: Already voted for candidate b8c6aaf55421432a91a73360865771d3 in this term.
I20260709 13:21:07.105351 24198 leader_election.cc:304] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba; no voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:07.106268 24438 raft_consensus.cc:3060] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:07.107563 24221 tablet_service.cc:1511] Processing CreateTablet for tablet 619d34e00ecc47839c94d82bacd2add7 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:07.107925 24428 raft_consensus.cc:359] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:07.108801 24428 raft_consensus.cc:385] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.108989 24221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619d34e00ecc47839c94d82bacd2add7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.109194 24428 raft_consensus.cc:740] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.109072 24292 tablet_service.cc:1511] Processing CreateTablet for tablet c64b5ba5e5d84dd78ae3c83e7c375709 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:07.110630 24292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64b5ba5e5d84dd78ae3c83e7c375709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.111522 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926dce38ed89423898a8cd9ca37e1f7e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:07.113405 24348 leader_election.cc:343] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.123682 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926dce38ed89423898a8cd9ca37e1f7e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:07.110425 24428 consensus_queue.cc:260] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:07.124480 24235 raft_consensus.cc:2468] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:07.126109 24346 leader_election.cc:304] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:07.132858 24296 tablet_service.cc:1511] Processing CreateTablet for tablet 619d34e00ecc47839c94d82bacd2add7 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:07.134044 24440 raft_consensus.cc:2804] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:07.134294 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619d34e00ecc47839c94d82bacd2add7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.134470 24440 raft_consensus.cc:493] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.134869 24440 raft_consensus.cc:3060] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:07.138229 24222 tablet_service.cc:1511] Processing CreateTablet for tablet 3863e0f41bbc4ace93654a83e2578032 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:07.138972 24369 tablet_service.cc:1511] Processing CreateTablet for tablet 3863e0f41bbc4ace93654a83e2578032 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:07.139726 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3863e0f41bbc4ace93654a83e2578032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.140126 24428 ts_tablet_manager.cc:1434] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.089s	user 0.002s	sys 0.006s
I20260709 13:21:07.140372 24369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3863e0f41bbc4ace93654a83e2578032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.148479 24429 raft_consensus.cc:359] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:07.149398 24429 raft_consensus.cc:385] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.130470 24438 raft_consensus.cc:2749] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:07.149463 24431 ts_tablet_manager.cc:1434] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 13:21:07.149925 24429 raft_consensus.cc:740] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.152362 24461 raft_consensus.cc:493] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.155059 24428 tablet_bootstrap.cc:492] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:07.162458 24461 raft_consensus.cc:515] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:07.153955 24440 raft_consensus.cc:515] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:07.166654 24145 tablet_service.cc:1511] Processing CreateTablet for tablet 3863e0f41bbc4ace93654a83e2578032 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:07.167989 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f87db850ae4d62b879e989d7572ad8" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:07.168298 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926dce38ed89423898a8cd9ca37e1f7e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:07.169019 24235 raft_consensus.cc:3060] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:07.169502 24274 leader_election.cc:343] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.169891 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926dce38ed89423898a8cd9ca37e1f7e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:07.170823 24461 leader_election.cc:290] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:07.162147 24298 tablet_service.cc:1511] Processing CreateTablet for tablet 21208eaee0f548318b6d3fd6edb3e12f (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:07.173214 24298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21208eaee0f548318b6d3fd6edb3e12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.168267 24145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3863e0f41bbc4ace93654a83e2578032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.176954 24440 leader_election.cc:290] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:07.160851 24431 tablet_bootstrap.cc:492] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:07.179194 24440 raft_consensus.cc:493] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.179729 24440 raft_consensus.cc:515] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:07.160141 24430 tablet_bootstrap.cc:492] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:07.182451 24430 ts_tablet_manager.cc:1403] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.375s	user 0.015s	sys 0.005s
I20260709 13:21:07.184091 24366 tablet_service.cc:1511] Processing CreateTablet for tablet 21208eaee0f548318b6d3fd6edb3e12f (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:07.187276 24366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21208eaee0f548318b6d3fd6edb3e12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.163072 24429 consensus_queue.cc:260] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:07.192777 24429 ts_tablet_manager.cc:1434] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.114s	user 0.004s	sys 0.003s
I20260709 13:21:07.193913 24429 tablet_bootstrap.cc:492] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:07.200882 24429 tablet_bootstrap.cc:654] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.202631 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f87db850ae4d62b879e989d7572ad8" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:07.210382 24431 tablet_bootstrap.cc:654] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.203361 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:07.207209 24433 leader_election.cc:290] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:07.211647 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0814205560524ce18e70c58645190dcd" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
W20260709 13:21:07.212423 24346 leader_election.cc:343] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.208905 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0814205560524ce18e70c58645190dcd" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:07.213270 24160 raft_consensus.cc:3060] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:07.190407 24430 raft_consensus.cc:359] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:07.214953 24430 raft_consensus.cc:385] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.215303 24430 raft_consensus.cc:740] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.217032 24430 consensus_queue.cc:260] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:07.218058 24234 raft_consensus.cc:2468] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 0.
I20260709 13:21:07.220780 24233 raft_consensus.cc:2468] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 1.
I20260709 13:21:07.222900 24430 ts_tablet_manager.cc:1434] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:21:07.224063 24141 tablet_service.cc:1511] Processing CreateTablet for tablet 21208eaee0f548318b6d3fd6edb3e12f (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:07.225407 24141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21208eaee0f548318b6d3fd6edb3e12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.225997 24430 tablet_bootstrap.cc:492] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:07.227643 24220 tablet_service.cc:1511] Processing CreateTablet for tablet 4206794ab99d4bc2b0573743d29d74ca (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:07.228965 24220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4206794ab99d4bc2b0573743d29d74ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.240661 24430 tablet_bootstrap.cc:654] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.244982 24428 tablet_bootstrap.cc:654] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.193032 24235 raft_consensus.cc:2468] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:07.245420 24365 tablet_service.cc:1511] Processing CreateTablet for tablet 4206794ab99d4bc2b0573743d29d74ca (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:07.246938 24365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4206794ab99d4bc2b0573743d29d74ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.246822 24346 leader_election.cc:304] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:07.222422 24272 leader_election.cc:304] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:07.248770 24433 raft_consensus.cc:2804] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:07.249305 24433 raft_consensus.cc:493] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.249749 24433 raft_consensus.cc:3060] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:07.263777 24160 raft_consensus.cc:2468] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 1.
I20260709 13:21:07.267459 24274 leader_election.cc:304] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:07.267903 24148 tablet_service.cc:1511] Processing CreateTablet for tablet e0bbda74ba444fd2bd1ad847ca18463d (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:07.268481 24461 raft_consensus.cc:2804] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:07.273788 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bbda74ba444fd2bd1ad847ca18463d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:07.274434 24272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:34445, user_credentials={real_user=slave}} blocked reactor thread for 52097.3us
I20260709 13:21:07.275156 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926dce38ed89423898a8cd9ca37e1f7e" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:07.276077 24383 raft_consensus.cc:2393] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e96a35df00e4646b9c6e356c6fb4bba in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:07.277736 24291 tablet_service.cc:1511] Processing CreateTablet for tablet 4206794ab99d4bc2b0573743d29d74ca (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:07.279156 24291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4206794ab99d4bc2b0573743d29d74ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.281329 24200 leader_election.cc:304] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:07.282608 24438 raft_consensus.cc:2749] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:07.300863 24440 leader_election.cc:290] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:07.301787 24440 raft_consensus.cc:2804] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:07.302374 24440 raft_consensus.cc:697] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:07.303470 24440 consensus_queue.cc:237] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:07.331331 24461 raft_consensus.cc:697] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:07.341005 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:07.341101 24222 tablet_service.cc:1511] Processing CreateTablet for tablet e0bbda74ba444fd2bd1ad847ca18463d (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:07.342726 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bbda74ba444fd2bd1ad847ca18463d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.344275 24430 tablet_bootstrap.cc:492] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:07.344816 24430 ts_tablet_manager.cc:1403] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.119s	user 0.014s	sys 0.008s
W20260709 13:21:07.338311 24348 leader_election.cc:343] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.355639 24431 tablet_bootstrap.cc:492] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:07.355307 24296 tablet_service.cc:1511] Processing CreateTablet for tablet e0bbda74ba444fd2bd1ad847ca18463d (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:07.356211 24431 ts_tablet_manager.cc:1403] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.196s	user 0.015s	sys 0.008s
I20260709 13:21:07.356791 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bbda74ba444fd2bd1ad847ca18463d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.356911 24366 tablet_service.cc:1511] Processing CreateTablet for tablet 1d7fdf5436a3408eb7a2074f0d4f48f5 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:07.358830 24366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d7fdf5436a3408eb7a2074f0d4f48f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.359474 24431 raft_consensus.cc:359] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:07.360260 24431 raft_consensus.cc:385] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.360555 24431 raft_consensus.cc:740] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.361413 24431 consensus_queue.cc:260] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:07.363904 24431 ts_tablet_manager.cc:1434] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:07.365145 24431 tablet_bootstrap.cc:492] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:07.370290 24433 raft_consensus.cc:515] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:07.370666 24430 raft_consensus.cc:359] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:07.371513 24148 tablet_service.cc:1511] Processing CreateTablet for tablet 1d7fdf5436a3408eb7a2074f0d4f48f5 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:07.373560 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d7fdf5436a3408eb7a2074f0d4f48f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.373811 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f87db850ae4d62b879e989d7572ad8" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:07.374218 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f87db850ae4d62b879e989d7572ad8" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:07.374841 24235 raft_consensus.cc:3060] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:07.375494 24274 leader_election.cc:343] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.376704 24431 tablet_bootstrap.cc:654] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.377364 24429 tablet_bootstrap.cc:492] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
W20260709 13:21:07.386482 24348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:39703, user_credentials={real_user=slave}} blocked reactor thread for 50696.2us
W20260709 13:21:07.387620 24348 leader_election.cc:343] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.388880 24461 consensus_queue.cc:237] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:07.390960 24428 tablet_bootstrap.cc:492] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:07.394899 24428 ts_tablet_manager.cc:1403] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.240s	user 0.008s	sys 0.013s
I20260709 13:21:07.397567 24291 tablet_service.cc:1511] Processing CreateTablet for tablet b1ea9e8d8e234a52956bc1fc72b80c6e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:07.388180 24348 leader_election.cc:304] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:07.398056 24433 leader_election.cc:290] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:07.391603 24220 tablet_service.cc:1511] Processing CreateTablet for tablet 1d7fdf5436a3408eb7a2074f0d4f48f5 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:07.399416 24145 tablet_service.cc:1511] Processing CreateTablet for tablet b1ea9e8d8e234a52956bc1fc72b80c6e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:07.400043 24220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d7fdf5436a3408eb7a2074f0d4f48f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.400717 24145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ea9e8d8e234a52956bc1fc72b80c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.401275 24298 tablet_service.cc:1511] Processing CreateTablet for tablet b2f81314f6f14fa9a2c432de6bddcb21 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:07.403573 24428 raft_consensus.cc:359] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:07.404469 24428 raft_consensus.cc:385] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.404855 24428 raft_consensus.cc:740] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.404693 24217 tablet_service.cc:1511] Processing CreateTablet for tablet b2f81314f6f14fa9a2c432de6bddcb21 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:07.398965 24291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ea9e8d8e234a52956bc1fc72b80c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.371529 24430 raft_consensus.cc:385] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.408068 24430 raft_consensus.cc:740] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.377954 24429 ts_tablet_manager.cc:1403] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.184s	user 0.019s	sys 0.027s
I20260709 13:21:07.405514 24365 tablet_service.cc:1511] Processing CreateTablet for tablet b1ea9e8d8e234a52956bc1fc72b80c6e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:07.406585 24463 raft_consensus.cc:2749] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:07.407109 24217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f81314f6f14fa9a2c432de6bddcb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.403602 24369 tablet_service.cc:1511] Processing CreateTablet for tablet b2f81314f6f14fa9a2c432de6bddcb21 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:07.408958 24430 consensus_queue.cc:260] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:07.417132 24369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f81314f6f14fa9a2c432de6bddcb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.416980 24141 tablet_service.cc:1511] Processing CreateTablet for tablet 135602f434b34156a908d7dea9da6594 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:07.418404 24141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135602f434b34156a908d7dea9da6594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.422411 24365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ea9e8d8e234a52956bc1fc72b80c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.430414 24058 catalog_manager.cc:5697] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:07.431087 24348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:39703, user_credentials={real_user=slave}} blocked reactor thread for 43522.8us
I20260709 13:21:07.431257 24428 consensus_queue.cc:260] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:07.440383 24428 ts_tablet_manager.cc:1434] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.002s
I20260709 13:21:07.431453 24235 raft_consensus.cc:2468] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 1.
I20260709 13:21:07.443656 24272 leader_election.cc:304] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:07.444849 24433 raft_consensus.cc:2804] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:07.445048 24298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f81314f6f14fa9a2c432de6bddcb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.445395 24433 raft_consensus.cc:697] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:07.446565 24433 consensus_queue.cc:237] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:07.450405 24428 tablet_bootstrap.cc:492] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:07.451728 24430 ts_tablet_manager.cc:1434] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.107s	user 0.008s	sys 0.003s
I20260709 13:21:07.423542 24429 raft_consensus.cc:359] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:07.458141 24292 tablet_service.cc:1511] Processing CreateTablet for tablet 135602f434b34156a908d7dea9da6594 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:07.458827 24366 tablet_service.cc:1511] Processing CreateTablet for tablet b9e21b3c9af648169d5786fe63dd5df7 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:07.459830 24292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135602f434b34156a908d7dea9da6594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.460119 24366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e21b3c9af648169d5786fe63dd5df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.459888 24218 tablet_service.cc:1511] Processing CreateTablet for tablet 135602f434b34156a908d7dea9da6594 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:07.461483 24218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135602f434b34156a908d7dea9da6594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.454698 24429 raft_consensus.cc:385] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.466048 24429 raft_consensus.cc:740] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.469264 24430 tablet_bootstrap.cc:492] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:07.469985 24056 catalog_manager.cc:5697] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.475342 24431 tablet_bootstrap.cc:492] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:07.475914 24431 ts_tablet_manager.cc:1403] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.012s
I20260709 13:21:07.477406 24150 tablet_service.cc:1511] Processing CreateTablet for tablet b9e21b3c9af648169d5786fe63dd5df7 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:07.478955 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e21b3c9af648169d5786fe63dd5df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.500751 24222 tablet_service.cc:1511] Processing CreateTablet for tablet b9e21b3c9af648169d5786fe63dd5df7 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:07.505302 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e21b3c9af648169d5786fe63dd5df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.506878 24428 tablet_bootstrap.cc:654] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.503638 24431 raft_consensus.cc:359] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:07.510893 24461 raft_consensus.cc:493] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.511439 24461 raft_consensus.cc:515] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:07.514236 24429 consensus_queue.cc:260] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:07.516706 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e20ad9ccb7d416fb78ca24817f25f01" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:07.515445 24461 leader_election.cc:290] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:07.516664 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e20ad9ccb7d416fb78ca24817f25f01" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:07.518621 24429 ts_tablet_manager.cc:1434] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.000s
W20260709 13:21:07.518996 24272 leader_election.cc:343] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:07.519791 24274 leader_election.cc:343] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.520313 24274 leader_election.cc:304] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:07.521139 24461 raft_consensus.cc:2749] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:07.522338 24429 tablet_bootstrap.cc:492] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:07.522084 24296 tablet_service.cc:1511] Processing CreateTablet for tablet bd488127e8e5406e956c1118ed2ffbbc (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:07.523613 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd488127e8e5406e956c1118ed2ffbbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.514221 24430 tablet_bootstrap.cc:654] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.535308 24373 tablet_service.cc:1511] Processing CreateTablet for tablet bd488127e8e5406e956c1118ed2ffbbc (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:07.536258 24431 raft_consensus.cc:385] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.536773 24431 raft_consensus.cc:740] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.536952 24373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd488127e8e5406e956c1118ed2ffbbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.537765 24431 consensus_queue.cc:260] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:07.540738 24431 ts_tablet_manager.cc:1434] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.004s
I20260709 13:21:07.541910 24431 tablet_bootstrap.cc:492] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:07.552075 24440 raft_consensus.cc:493] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.552660 24440 raft_consensus.cc:515] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:07.554994 24440 leader_election.cc:290] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:07.556933 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15fe782c914a21a8001515c189022a" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:07.557826 24235 raft_consensus.cc:2468] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:07.529897 24429 tablet_bootstrap.cc:654] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.556923 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15fe782c914a21a8001515c189022a" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:07.561404 24346 leader_election.cc:304] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
W20260709 13:21:07.562007 24348 leader_election.cc:343] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.564617 24440 raft_consensus.cc:2804] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:07.566475 24440 raft_consensus.cc:493] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.566833 24440 raft_consensus.cc:3060] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:07.568043 24142 tablet_service.cc:1511] Processing CreateTablet for tablet bd488127e8e5406e956c1118ed2ffbbc (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:07.569370 24142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd488127e8e5406e956c1118ed2ffbbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.577291 24217 tablet_service.cc:1511] Processing CreateTablet for tablet 17f8ed631e60464e98c97b58568b708d (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:07.582106 24217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f8ed631e60464e98c97b58568b708d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.580896 24428 tablet_bootstrap.cc:492] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:07.586457 24428 ts_tablet_manager.cc:1403] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.001s
I20260709 13:21:07.589463 24431 tablet_bootstrap.cc:654] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.594224 24428 raft_consensus.cc:359] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:07.599205 24428 raft_consensus.cc:385] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.595705 24365 tablet_service.cc:1511] Processing CreateTablet for tablet 17f8ed631e60464e98c97b58568b708d (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:07.599988 24145 tablet_service.cc:1511] Processing CreateTablet for tablet 33ca7353f12e4915a607cd21f4492c2e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:07.600706 24365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f8ed631e60464e98c97b58568b708d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.605966 24222 tablet_service.cc:1511] Processing CreateTablet for tablet 33ca7353f12e4915a607cd21f4492c2e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:07.603004 24428 raft_consensus.cc:740] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.612282 24145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ca7353f12e4915a607cd21f4492c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.619331 24430 tablet_bootstrap.cc:492] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:07.619935 24430 ts_tablet_manager.cc:1403] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.154s	user 0.005s	sys 0.012s
I20260709 13:21:07.620399 24428 consensus_queue.cc:260] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:07.618736 24296 tablet_service.cc:1511] Processing CreateTablet for tablet 33ca7353f12e4915a607cd21f4492c2e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:07.624879 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ca7353f12e4915a607cd21f4492c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.631400 24430 raft_consensus.cc:359] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:07.632472 24430 raft_consensus.cc:385] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.632797 24430 raft_consensus.cc:740] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.637666 24366 tablet_service.cc:1511] Processing CreateTablet for tablet cbbd9769488e4db0bf3addb6ae875e51 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:07.639081 24366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbbd9769488e4db0bf3addb6ae875e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.642611 24292 tablet_service.cc:1511] Processing CreateTablet for tablet 17f8ed631e60464e98c97b58568b708d (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:07.644116 24292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f8ed631e60464e98c97b58568b708d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.633585 24430 consensus_queue.cc:260] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:07.656821 24461 raft_consensus.cc:493] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.657732 24461 raft_consensus.cc:515] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:07.660419 24428 ts_tablet_manager.cc:1434] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.003s
I20260709 13:21:07.661949 24428 tablet_bootstrap.cc:492] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:07.662209 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6f84753e2b4220a883363c1561af3a" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:07.666484 24272 leader_election.cc:343] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.671991 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ca7353f12e4915a607cd21f4492c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.678711 24461 leader_election.cc:290] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:07.680138 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6f84753e2b4220a883363c1561af3a" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:07.680562 24430 ts_tablet_manager.cc:1434] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.060s	user 0.011s	sys 0.005s
W20260709 13:21:07.681885 24274 leader_election.cc:343] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.682556 24274 leader_election.cc:304] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:07.682796 24440 raft_consensus.cc:515] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:07.685773 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15fe782c914a21a8001515c189022a" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:07.687979 24218 tablet_service.cc:1511] Processing CreateTablet for tablet cbbd9769488e4db0bf3addb6ae875e51 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:07.690474 24218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbbd9769488e4db0bf3addb6ae875e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.693285 24365 tablet_service.cc:1511] Processing CreateTablet for tablet d48bb74e965d44649059c6cbae8878b9 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:07.691023 24298 tablet_service.cc:1511] Processing CreateTablet for tablet d48bb74e965d44649059c6cbae8878b9 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:07.696111 24298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48bb74e965d44649059c6cbae8878b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.696789 24291 tablet_service.cc:1511] Processing CreateTablet for tablet be7f93cd2c1042aa9ce8434973e4e95a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:07.698141 24291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be7f93cd2c1042aa9ce8434973e4e95a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:07.698452 24348 leader_election.cc:343] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.701109 24369 tablet_service.cc:1511] Processing CreateTablet for tablet be7f93cd2c1042aa9ce8434973e4e95a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:07.685775 24142 tablet_service.cc:1511] Processing CreateTablet for tablet cbbd9769488e4db0bf3addb6ae875e51 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:07.702469 24369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be7f93cd2c1042aa9ce8434973e4e95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.702870 24220 tablet_service.cc:1511] Processing CreateTablet for tablet 4105e0d91861411cab1b9ed694694e6a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:07.703325 24142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbbd9769488e4db0bf3addb6ae875e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.703135 24141 tablet_service.cc:1511] Processing CreateTablet for tablet d48bb74e965d44649059c6cbae8878b9 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:07.704135 24220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4105e0d91861411cab1b9ed694694e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.704392 24141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48bb74e965d44649059c6cbae8878b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.705317 24150 tablet_service.cc:1511] Processing CreateTablet for tablet 4105e0d91861411cab1b9ed694694e6a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:07.706655 24365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48bb74e965d44649059c6cbae8878b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.706794 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4105e0d91861411cab1b9ed694694e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.707567 24294 tablet_service.cc:1511] Processing CreateTablet for tablet 4105e0d91861411cab1b9ed694694e6a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:07.709095 24294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4105e0d91861411cab1b9ed694694e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.710917 24367 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf4040b9d0747039fdf29b8fa99d02c (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:07.712157 24367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf4040b9d0747039fdf29b8fa99d02c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.695214 24217 tablet_service.cc:1511] Processing CreateTablet for tablet be7f93cd2c1042aa9ce8434973e4e95a (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:07.727290 24217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be7f93cd2c1042aa9ce8434973e4e95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.729110 24148 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf4040b9d0747039fdf29b8fa99d02c (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:07.730190 24461 raft_consensus.cc:2749] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:07.730557 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf4040b9d0747039fdf29b8fa99d02c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.730755 24221 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf4040b9d0747039fdf29b8fa99d02c (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:07.732190 24221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf4040b9d0747039fdf29b8fa99d02c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.681790 24430 tablet_bootstrap.cc:492] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:07.743671 24431 tablet_bootstrap.cc:492] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:07.744338 24431 ts_tablet_manager.cc:1403] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.203s	user 0.008s	sys 0.008s
I20260709 13:21:07.749729 24299 tablet_service.cc:1511] Processing CreateTablet for tablet 2a82f5a216984c39907a5b48bbd3b560 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:07.751132 24299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a82f5a216984c39907a5b48bbd3b560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.757329 24463 raft_consensus.cc:493] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.757889 24463 raft_consensus.cc:515] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:07.762182 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b184e3a09204b16a54a19c799fe3491" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:07.762590 24440 leader_election.cc:290] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
W20260709 13:21:07.764261 24346 leader_election.cc:343] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.765671 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15fe782c914a21a8001515c189022a" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:07.766392 24235 raft_consensus.cc:3060] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:07.773388 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b184e3a09204b16a54a19c799fe3491" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:07.777585 24348 leader_election.cc:343] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.778426 24348 leader_election.cc:304] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:07.775609 24463 leader_election.cc:290] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:07.780465 24463 raft_consensus.cc:2749] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:07.780864 24056 catalog_manager.cc:5697] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.784399 24235 raft_consensus.cc:2468] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:07.786521 24429 tablet_bootstrap.cc:492] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:07.786489 24346 leader_election.cc:304] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:07.787247 24429 ts_tablet_manager.cc:1403] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.265s	user 0.011s	sys 0.004s
I20260709 13:21:07.787855 24463 raft_consensus.cc:2804] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:07.788370 24463 raft_consensus.cc:697] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:07.789196 24463 consensus_queue.cc:237] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:07.790184 24439 raft_consensus.cc:493] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.790724 24439 raft_consensus.cc:515] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:07.793076 24439 leader_election.cc:290] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:07.794207 24461 consensus_queue.cc:1048] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:07.794565 24429 raft_consensus.cc:359] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:07.795426 24429 raft_consensus.cc:385] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.795729 24429 raft_consensus.cc:740] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.796515 24429 consensus_queue.cc:260] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:07.799292 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd592b9cef049dfbfa3d0ee1ab44c41" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:07.800915 24123 leader_election.cc:343] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.776019 24431 raft_consensus.cc:359] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:07.802309 24431 raft_consensus.cc:385] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:07.802613 24431 raft_consensus.cc:740] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:07.803776 24431 consensus_queue.cc:260] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:07.813539 24433 consensus_queue.cc:1048] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:07.796546 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd592b9cef049dfbfa3d0ee1ab44c41" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
W20260709 13:21:07.824457 24125 leader_election.cc:343] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.823123 24431 ts_tablet_manager.cc:1434] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 13:21:07.824961 24125 leader_election.cc:304] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:07.833474 24430 tablet_bootstrap.cc:654] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.836244 24440 consensus_queue.cc:1048] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:07.836833 24369 tablet_service.cc:1511] Processing CreateTablet for tablet 2a82f5a216984c39907a5b48bbd3b560 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:07.838694 24369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a82f5a216984c39907a5b48bbd3b560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.841631 24439 raft_consensus.cc:2749] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:07.854970 24145 tablet_service.cc:1511] Processing CreateTablet for tablet 2a82f5a216984c39907a5b48bbd3b560 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:07.860702 24291 tablet_service.cc:1511] Processing CreateTablet for tablet b80418d8094044258597b8ab9021a04e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:07.860818 24222 tablet_service.cc:1511] Processing CreateTablet for tablet b80418d8094044258597b8ab9021a04e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:07.862087 24431 tablet_bootstrap.cc:492] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:07.862458 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80418d8094044258597b8ab9021a04e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.863930 24058 catalog_manager.cc:5697] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:07.864825 24147 tablet_service.cc:1511] Processing CreateTablet for tablet bacd8d22901e4b63b728d0d94e835a27 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:07.865927 24220 tablet_service.cc:1511] Processing CreateTablet for tablet bacd8d22901e4b63b728d0d94e835a27 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:07.867300 24220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bacd8d22901e4b63b728d0d94e835a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.865804 24429 ts_tablet_manager.cc:1434] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.001s
I20260709 13:21:07.868803 24366 tablet_service.cc:1511] Processing CreateTablet for tablet b80418d8094044258597b8ab9021a04e (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:07.883740 24296 tablet_service.cc:1511] Processing CreateTablet for tablet bacd8d22901e4b63b728d0d94e835a27 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:07.885170 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bacd8d22901e4b63b728d0d94e835a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.886935 24147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bacd8d22901e4b63b728d0d94e835a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.888322 24429 tablet_bootstrap.cc:492] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:07.896342 24373 tablet_service.cc:1511] Processing CreateTablet for tablet 2789a7bb0565468ebd309763754a3d4c (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:07.901216 24291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80418d8094044258597b8ab9021a04e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:07.905848 24274 consensus_peers.cc:597] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:07.907972 24431 tablet_bootstrap.cc:654] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.896374 24145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a82f5a216984c39907a5b48bbd3b560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.910228 24461 raft_consensus.cc:493] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.910844 24461 raft_consensus.cc:515] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:07.913348 24461 leader_election.cc:290] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:07.915634 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29861adc1e34aeb8b9916d115af5f9b" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:07.916499 24366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80418d8094044258597b8ab9021a04e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.917305 24373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2789a7bb0565468ebd309763754a3d4c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:07.918486 24274 leader_election.cc:343] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.918185 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29861adc1e34aeb8b9916d115af5f9b" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:07.917487 24428 tablet_bootstrap.cc:654] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:07.951681 24429 tablet_bootstrap.cc:654] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:07.941180 24274 leader_election.cc:343] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:07.959692 24150 tablet_service.cc:1511] Processing CreateTablet for tablet 2789a7bb0565468ebd309763754a3d4c (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:07.984911 24217 tablet_service.cc:1511] Processing CreateTablet for tablet 2789a7bb0565468ebd309763754a3d4c (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:07.985759 24438 raft_consensus.cc:493] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.959596 24159 raft_consensus.cc:3060] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:07.966403 24274 leader_election.cc:304] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:07.986364 24438 raft_consensus.cc:515] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:07.985420 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2789a7bb0565468ebd309763754a3d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:07.955016 24461 consensus_queue.cc:1048] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 13:21:08.015957 24222 tablet_service.cc:1511] Processing CreateTablet for tablet 7de7548eaeb146eeb29df319abe407f5 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:08.017910 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de7548eaeb146eeb29df319abe407f5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:08.039817 24274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:39703, user_credentials={real_user=slave}} blocked reactor thread for 98682.8us
I20260709 13:21:07.969724 24294 tablet_service.cc:1511] Processing CreateTablet for tablet dc10ce2783b74de384326c27984c7e92 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:07.974472 24372 tablet_service.cc:1511] Processing CreateTablet for tablet dc10ce2783b74de384326c27984c7e92 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:08.047408 24294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc10ce2783b74de384326c27984c7e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.048420 24430 tablet_bootstrap.cc:492] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:08.066339 24430 ts_tablet_manager.cc:1403] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.385s	user 0.020s	sys 0.009s
I20260709 13:21:08.068181 24428 tablet_bootstrap.cc:492] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:08.068885 24428 ts_tablet_manager.cc:1403] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.407s	user 0.017s	sys 0.007s
I20260709 13:21:08.050537 24431 tablet_bootstrap.cc:492] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:08.070657 24431 ts_tablet_manager.cc:1403] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.221s	user 0.027s	sys 0.017s
I20260709 13:21:08.071058 24438 leader_election.cc:290] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:08.073267 24292 tablet_service.cc:1511] Processing CreateTablet for tablet 7de7548eaeb146eeb29df319abe407f5 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:08.075114 24372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc10ce2783b74de384326c27984c7e92. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:08.075965 24106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:08.075846 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6350c1629234440b97877600cb50d2a" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:08.077239 24309 raft_consensus.cc:2468] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:08.044729 24217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2789a7bb0565468ebd309763754a3d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.077958 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6350c1629234440b97877600cb50d2a" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:07.982919 24141 tablet_service.cc:1511] Processing CreateTablet for tablet dc10ce2783b74de384326c27984c7e92 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:08.069416 24430 raft_consensus.cc:359] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.040012 24492 raft_consensus.cc:2749] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:08.073658 24431 raft_consensus.cc:359] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.084575 24141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc10ce2783b74de384326c27984c7e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.084884 24367 tablet_service.cc:1511] Processing CreateTablet for tablet 7de7548eaeb146eeb29df319abe407f5 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:08.088150 24292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de7548eaeb146eeb29df319abe407f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.088023 24148 tablet_service.cc:1511] Processing CreateTablet for tablet e9b893af727e4323b5c5f832d0b543a0 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:08.093075 24198 leader_election.cc:304] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:08.093513 24299 tablet_service.cc:1511] Processing CreateTablet for tablet e9b893af727e4323b5c5f832d0b543a0 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:08.094719 24220 tablet_service.cc:1511] Processing CreateTablet for tablet e9b893af727e4323b5c5f832d0b543a0 (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:08.095963 24430 raft_consensus.cc:385] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.073596 24428 raft_consensus.cc:359] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
W20260709 13:21:08.109702 24200 leader_election.cc:343] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.121524 24220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b893af727e4323b5c5f832d0b543a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.122131 24428 raft_consensus.cc:385] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.122756 24428 raft_consensus.cc:740] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.123574 24428 consensus_queue.cc:260] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.117909 24367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de7548eaeb146eeb29df319abe407f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.118660 24299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b893af727e4323b5c5f832d0b543a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.126680 24296 tablet_service.cc:1511] Processing CreateTablet for tablet 9c8d5d925cdf4b799f067f0763e2b3af (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:08.128131 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8d5d925cdf4b799f067f0763e2b3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.132537 24147 tablet_service.cc:1511] Processing CreateTablet for tablet aa056dad41df4537ab48328b7221c6cc (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:08.133384 24366 tablet_service.cc:1511] Processing CreateTablet for tablet 9c8d5d925cdf4b799f067f0763e2b3af (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:08.113651 24438 raft_consensus.cc:2804] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:08.133934 24147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa056dad41df4537ab48328b7221c6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.134231 24438 raft_consensus.cc:493] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.134869 24438 raft_consensus.cc:3060] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.134945 24430 raft_consensus.cc:740] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.136000 24430 consensus_queue.cc:260] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.138480 24430 ts_tablet_manager.cc:1434] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:21:08.138223 24142 tablet_service.cc:1511] Processing CreateTablet for tablet 9c8d5d925cdf4b799f067f0763e2b3af (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:08.139583 24142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8d5d925cdf4b799f067f0763e2b3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.142287 24430 tablet_bootstrap.cc:492] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:08.144799 24438 raft_consensus.cc:515] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.132558 24373 tablet_service.cc:1511] Processing CreateTablet for tablet aa056dad41df4537ab48328b7221c6cc (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:08.098296 24431 raft_consensus.cc:385] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.149058 24431 raft_consensus.cc:740] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.134863 24366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8d5d925cdf4b799f067f0763e2b3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.149897 24431 consensus_queue.cc:260] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.152505 24431 ts_tablet_manager.cc:1434] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.000s
I20260709 13:21:08.153496 24431 tablet_bootstrap.cc:492] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:08.159121 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6350c1629234440b97877600cb50d2a" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:08.160041 24309 raft_consensus.cc:3060] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.162307 24463 consensus_queue.cc:1048] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:08.168808 24309 raft_consensus.cc:2468] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:08.170279 24198 leader_election.cc:304] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:08.174919 24222 tablet_service.cc:1511] Processing CreateTablet for tablet aa056dad41df4537ab48328b7221c6cc (DEFAULT_TABLE table=test-workload [id=7bfa6f5708cc4673bc570cba14c661ec]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:08.176154 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa056dad41df4537ab48328b7221c6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.178256 24373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa056dad41df4537ab48328b7221c6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.176982 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b893af727e4323b5c5f832d0b543a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.185266 24463 raft_consensus.cc:493] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.185794 24463 raft_consensus.cc:515] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.199879 24494 raft_consensus.cc:2804] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:08.200534 24494 raft_consensus.cc:697] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:08.201987 24430 tablet_bootstrap.cc:654] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.203313 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd592b9cef049dfbfa3d0ee1ab44c41" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:08.204237 24159 raft_consensus.cc:2468] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:08.205796 24348 leader_election.cc:304] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:08.211632 24440 raft_consensus.cc:2804] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:08.212131 24440 raft_consensus.cc:493] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.212538 24440 raft_consensus.cc:3060] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.213662 24428 ts_tablet_manager.cc:1434] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.144s	user 0.010s	sys 0.002s
I20260709 13:21:08.215325 24428 tablet_bootstrap.cc:492] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:08.219570 24438 leader_election.cc:290] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:08.222122 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6350c1629234440b97877600cb50d2a" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:08.201397 24494 consensus_queue.cc:237] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.233484 24463 leader_election.cc:290] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:08.244333 24498 raft_consensus.cc:493] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.245658 24429 tablet_bootstrap.cc:492] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
W20260709 13:21:08.239038 24200 leader_election.cc:343] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:08.233520 24198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:46833, user_credentials={real_user=slave}} blocked reactor thread for 63346.9us
I20260709 13:21:08.253655 24497 raft_consensus.cc:493] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.266499 24497 raft_consensus.cc:515] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.269068 24497 leader_election.cc:290] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:08.270285 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6f84753e2b4220a883363c1561af3a" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:08.259583 24429 ts_tablet_manager.cc:1403] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.372s	user 0.025s	sys 0.030s
W20260709 13:21:08.273417 24200 leader_election.cc:343] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.263710 24463 raft_consensus.cc:493] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:08.274667 24348 consensus_peers.cc:597] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:08.274830 24463 raft_consensus.cc:515] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.277184 24463 leader_election.cc:290] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:08.278378 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb70981888a450ca715b1ed427ba95e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
W20260709 13:21:08.280205 24346 leader_election.cc:343] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.280903 24429 raft_consensus.cc:359] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.281664 24429 raft_consensus.cc:385] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.284924 24431 tablet_bootstrap.cc:654] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.290172 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd592b9cef049dfbfa3d0ee1ab44c41" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:08.291842 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb70981888a450ca715b1ed427ba95e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:08.293862 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6f84753e2b4220a883363c1561af3a" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:08.294551 24309 raft_consensus.cc:2468] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
W20260709 13:21:08.296216 24346 leader_election.cc:343] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:08.297539 24346 leader_election.cc:343] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.297994 24346 leader_election.cc:304] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:08.299364 24463 raft_consensus.cc:2749] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:08.300616 24198 leader_election.cc:304] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:08.257351 24498 raft_consensus.cc:515] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.309953 24498 leader_election.cc:290] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
W20260709 13:21:08.310979 24496 log.cc:927] Time spent T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:21:08.312901 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b184e3a09204b16a54a19c799fe3491" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:08.313771 24383 raft_consensus.cc:2468] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 0.
I20260709 13:21:08.315104 24274 leader_election.cc:304] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:08.312800 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b184e3a09204b16a54a19c799fe3491" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:08.316967 24274 leader_election.cc:343] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.281944 24429 raft_consensus.cc:740] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.317898 24498 raft_consensus.cc:2804] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:08.318399 24498 raft_consensus.cc:493] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.318779 24498 raft_consensus.cc:3060] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.318557 24429 consensus_queue.cc:260] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.320916 24429 ts_tablet_manager.cc:1434] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.000s
I20260709 13:21:08.324812 24440 raft_consensus.cc:515] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.327467 24440 leader_election.cc:290] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:08.328229 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd592b9cef049dfbfa3d0ee1ab44c41" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:08.328866 24158 raft_consensus.cc:3060] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.321960 24429 tablet_bootstrap.cc:492] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:08.330035 24428 tablet_bootstrap.cc:654] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.330749 24497 raft_consensus.cc:2804] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:08.339478 24497 raft_consensus.cc:493] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.339867 24497 raft_consensus.cc:3060] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.344971 24498 raft_consensus.cc:515] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.347935 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b184e3a09204b16a54a19c799fe3491" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
W20260709 13:21:08.349268 24274 leader_election.cc:343] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.353648 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b184e3a09204b16a54a19c799fe3491" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:08.354278 24383 raft_consensus.cc:3060] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.363312 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd592b9cef049dfbfa3d0ee1ab44c41" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:08.367116 24430 tablet_bootstrap.cc:492] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:08.367727 24430 ts_tablet_manager.cc:1403] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.226s	user 0.011s	sys 0.010s
W20260709 13:21:08.367933 24346 leader_election.cc:343] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.370880 24430 raft_consensus.cc:359] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.371657 24430 raft_consensus.cc:385] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.371941 24430 raft_consensus.cc:740] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.374099 24430 consensus_queue.cc:260] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.376089 24383 raft_consensus.cc:2468] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 1.
I20260709 13:21:08.356470 24498 leader_election.cc:290] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:08.369510 24497 raft_consensus.cc:515] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.379648 24274 leader_election.cc:304] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:08.378371 24158 raft_consensus.cc:2468] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:08.375479 24500 consensus_queue.cc:1048] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:21:08.391525 24498 raft_consensus.cc:2804] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:08.393208 24428 tablet_bootstrap.cc:492] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:08.393772 24428 ts_tablet_manager.cc:1403] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.179s	user 0.012s	sys 0.008s
I20260709 13:21:08.397735 24348 leader_election.cc:304] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:08.398782 24428 raft_consensus.cc:359] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.399634 24428 raft_consensus.cc:385] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.395977 24429 tablet_bootstrap.cc:654] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.400007 24428 raft_consensus.cc:740] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.401014 24428 consensus_queue.cc:260] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.403414 24500 raft_consensus.cc:2804] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:08.404568 24500 raft_consensus.cc:697] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:08.404789 24430 ts_tablet_manager.cc:1434] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.003s
I20260709 13:21:08.405305 24428 ts_tablet_manager.cc:1434] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:21:08.405391 24500 consensus_queue.cc:237] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.406453 24428 tablet_bootstrap.cc:492] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:08.408757 24431 tablet_bootstrap.cc:492] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:08.409719 24431 ts_tablet_manager.cc:1403] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.256s	user 0.006s	sys 0.013s
I20260709 13:21:08.413268 24428 tablet_bootstrap.cc:654] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.413009 24431 raft_consensus.cc:359] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.395205 24498 raft_consensus.cc:697] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:08.413920 24431 raft_consensus.cc:385] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.414458 24431 raft_consensus.cc:740] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.415161 24498 consensus_queue.cc:237] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.415335 24431 consensus_queue.cc:260] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.423064 24428 tablet_bootstrap.cc:492] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:08.425791 24497 leader_election.cc:290] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:08.423771 24428 ts_tablet_manager.cc:1403] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.002s
I20260709 13:21:08.430127 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6f84753e2b4220a883363c1561af3a" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:08.430832 24309 raft_consensus.cc:3060] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.434247 24431 ts_tablet_manager.cc:1434] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:21:08.435491 24431 tablet_bootstrap.cc:492] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:08.436667 24057 catalog_manager.cc:5697] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.437464 24428 raft_consensus.cc:359] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.438207 24428 raft_consensus.cc:385] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.438508 24428 raft_consensus.cc:740] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.440586 24428 consensus_queue.cc:260] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.440073 24430 tablet_bootstrap.cc:492] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:08.444860 24428 ts_tablet_manager.cc:1434] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:21:08.445981 24428 tablet_bootstrap.cc:492] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:08.438235 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6f84753e2b4220a883363c1561af3a" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:08.448897 24055 catalog_manager.cc:5697] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:08.452675 24200 leader_election.cc:343] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.462606 24309 raft_consensus.cc:2468] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:08.464044 24198 leader_election.cc:304] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:08.464972 24431 tablet_bootstrap.cc:654] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.465411 24497 raft_consensus.cc:2804] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:08.466005 24497 raft_consensus.cc:697] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:08.466938 24497 consensus_queue.cc:237] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.471066 24430 tablet_bootstrap.cc:654] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.471231 24428 tablet_bootstrap.cc:654] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.462937 24058 catalog_manager.cc:5697] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.479708 24500 raft_consensus.cc:493] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.481374 24500 raft_consensus.cc:515] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.484611 24429 tablet_bootstrap.cc:492] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:08.484944 24500 leader_election.cc:290] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:08.485234 24429 ts_tablet_manager.cc:1403] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.163s	user 0.016s	sys 0.006s
I20260709 13:21:08.487358 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6350c1629234440b97877600cb50d2a" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:08.488708 24429 raft_consensus.cc:359] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.489495 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6350c1629234440b97877600cb50d2a" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:08.490784 24309 raft_consensus.cc:2393] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96be869fbe4e464a99c0d5aa3d90dbfb in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
I20260709 13:21:08.492156 24346 leader_election.cc:304] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:08.493568 24500 raft_consensus.cc:3060] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.496510 24428 tablet_bootstrap.cc:492] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:08.497076 24428 ts_tablet_manager.cc:1403] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.007s
I20260709 13:21:08.500033 24428 raft_consensus.cc:359] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.500707 24428 raft_consensus.cc:385] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.489728 24429 raft_consensus.cc:385] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.500972 24428 raft_consensus.cc:740] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.501240 24429 raft_consensus.cc:740] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.501725 24428 consensus_queue.cc:260] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.502048 24429 consensus_queue.cc:260] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.503919 24428 ts_tablet_manager.cc:1434] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:08.504129 24429 ts_tablet_manager.cc:1434] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:21:08.504880 24428 tablet_bootstrap.cc:492] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:08.505633 24500 raft_consensus.cc:2749] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:08.509773 24429 tablet_bootstrap.cc:492] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:08.511480 24431 tablet_bootstrap.cc:492] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:08.512069 24431 ts_tablet_manager.cc:1403] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.000s
I20260709 13:21:08.514940 24428 tablet_bootstrap.cc:654] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.515530 24431 raft_consensus.cc:359] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.516847 24431 raft_consensus.cc:385] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.517211 24431 raft_consensus.cc:740] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.518548 24431 consensus_queue.cc:260] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.520882 24431 ts_tablet_manager.cc:1434] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:21:08.522001 24431 tablet_bootstrap.cc:492] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:08.523509 24430 tablet_bootstrap.cc:492] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:08.524291 24430 ts_tablet_manager.cc:1403] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.011s
I20260709 13:21:08.524338 24429 tablet_bootstrap.cc:654] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.528077 24430 raft_consensus.cc:359] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.528964 24431 tablet_bootstrap.cc:654] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.546465 24430 raft_consensus.cc:385] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.547933 24430 raft_consensus.cc:740] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.550637 24428 tablet_bootstrap.cc:492] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:08.550594 24430 consensus_queue.cc:260] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.551390 24428 ts_tablet_manager.cc:1403] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.009s
I20260709 13:21:08.555332 24430 ts_tablet_manager.cc:1434] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:21:08.556504 24430 tablet_bootstrap.cc:492] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:08.557740 24431 tablet_bootstrap.cc:492] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:08.558434 24431 ts_tablet_manager.cc:1403] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.003s
I20260709 13:21:08.558805 24498 raft_consensus.cc:493] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.559355 24498 raft_consensus.cc:515] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.561795 24498 leader_election.cc:290] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:08.563094 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb70981888a450ca715b1ed427ba95e" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:08.563818 24383 raft_consensus.cc:2468] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 0.
I20260709 13:21:08.564970 24430 tablet_bootstrap.cc:654] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.565110 24274 leader_election.cc:304] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:08.566071 24498 raft_consensus.cc:2804] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:08.566440 24498 raft_consensus.cc:493] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.566797 24498 raft_consensus.cc:3060] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.567698 24428 raft_consensus.cc:359] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.568411 24428 raft_consensus.cc:385] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.568670 24428 raft_consensus.cc:740] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.569324 24428 consensus_queue.cc:260] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.570336 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb70981888a450ca715b1ed427ba95e" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:08.570991 24431 raft_consensus.cc:359] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.571712 24431 raft_consensus.cc:385] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.571974 24431 raft_consensus.cc:740] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.572715 24431 consensus_queue.cc:260] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.574828 24431 ts_tablet_manager.cc:1434] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:21:08.575875 24431 tablet_bootstrap.cc:492] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:08.576483 24428 ts_tablet_manager.cc:1434] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.005s
I20260709 13:21:08.577414 24428 tablet_bootstrap.cc:492] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:08.574620 24498 raft_consensus.cc:515] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
W20260709 13:21:08.578928 24272 leader_election.cc:343] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.580844 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb70981888a450ca715b1ed427ba95e" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:08.581441 24383 raft_consensus.cc:3060] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.581879 24431 tablet_bootstrap.cc:654] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.581835 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb70981888a450ca715b1ed427ba95e" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
W20260709 13:21:08.587821 24272 leader_election.cc:343] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.593870 24431 tablet_bootstrap.cc:492] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:08.594537 24431 ts_tablet_manager.cc:1403] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:21:08.596746 24428 tablet_bootstrap.cc:654] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.597426 24498 leader_election.cc:290] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:08.597581 24431 raft_consensus.cc:359] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.598389 24431 raft_consensus.cc:385] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.598695 24431 raft_consensus.cc:740] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.599427 24431 consensus_queue.cc:260] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.599742 24383 raft_consensus.cc:2468] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 1.
I20260709 13:21:08.601442 24274 leader_election.cc:304] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:08.602332 24498 raft_consensus.cc:2804] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:08.602823 24498 raft_consensus.cc:697] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:08.603705 24498 consensus_queue.cc:237] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.604598 24431 ts_tablet_manager.cc:1434] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:08.605588 24431 tablet_bootstrap.cc:492] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:08.612917 24431 tablet_bootstrap.cc:654] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.613566 24429 tablet_bootstrap.cc:492] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:08.614229 24429 ts_tablet_manager.cc:1403] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.023s
I20260709 13:21:08.615061 24057 catalog_manager.cc:5697] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.616259 24497 raft_consensus.cc:493] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.616860 24497 raft_consensus.cc:515] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.619477 24497 leader_election.cc:290] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:08.623039 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7d5de1a9b448969e2db6601b724c9c" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:08.623850 24309 raft_consensus.cc:2468] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:08.623970 24429 raft_consensus.cc:359] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.626324 24429 raft_consensus.cc:385] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.626649 24429 raft_consensus.cc:740] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.627717 24428 tablet_bootstrap.cc:492] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:08.628528 24428 ts_tablet_manager.cc:1403] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.005s
I20260709 13:21:08.629195 24429 consensus_queue.cc:260] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.630599 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7d5de1a9b448969e2db6601b724c9c" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:08.632826 24200 leader_election.cc:343] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.633783 24429 ts_tablet_manager.cc:1434] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
I20260709 13:21:08.633665 24428 raft_consensus.cc:359] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.634459 24428 raft_consensus.cc:385] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.634279 24198 leader_election.cc:304] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:08.634789 24428 raft_consensus.cc:740] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.635028 24429 tablet_bootstrap.cc:492] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:08.635694 24497 raft_consensus.cc:2804] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:08.635573 24428 consensus_queue.cc:260] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.636142 24497 raft_consensus.cc:493] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.636646 24497 raft_consensus.cc:3060] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.638823 24431 tablet_bootstrap.cc:492] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:08.639048 24428 ts_tablet_manager.cc:1434] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:21:08.639302 24431 ts_tablet_manager.cc:1403] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.034s	user 0.027s	sys 0.000s
I20260709 13:21:08.639954 24428 tablet_bootstrap.cc:492] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:08.641582 24500 raft_consensus.cc:493] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.642083 24500 raft_consensus.cc:515] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.646180 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29861adc1e34aeb8b9916d115af5f9b" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:08.647065 24309 raft_consensus.cc:2468] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:08.648298 24346 leader_election.cc:304] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:08.648375 24431 raft_consensus.cc:359] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.649190 24431 raft_consensus.cc:385] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.649356 24440 raft_consensus.cc:2804] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:08.649562 24431 raft_consensus.cc:740] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.649839 24440 raft_consensus.cc:493] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.650295 24440 raft_consensus.cc:3060] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.656288 24500 leader_election.cc:290] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:08.656965 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29861adc1e34aeb8b9916d115af5f9b" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:08.657830 24158 raft_consensus.cc:2468] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:08.656947 24431 consensus_queue.cc:260] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.661289 24428 tablet_bootstrap.cc:654] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.662402 24431 ts_tablet_manager.cc:1434] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.003s
I20260709 13:21:08.663642 24431 tablet_bootstrap.cc:492] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:08.662622 24429 tablet_bootstrap.cc:654] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.670149 24431 tablet_bootstrap.cc:654] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.669965 24440 raft_consensus.cc:515] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.673662 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29861adc1e34aeb8b9916d115af5f9b" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:08.674577 24309 raft_consensus.cc:3060] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.662364 24056 catalog_manager.cc:5697] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.690954 24500 raft_consensus.cc:493] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.691527 24500 raft_consensus.cc:515] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.693943 24500 leader_election.cc:290] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:08.695144 24430 tablet_bootstrap.cc:492] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:08.695720 24430 ts_tablet_manager.cc:1403] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.139s	user 0.033s	sys 0.053s
I20260709 13:21:08.695797 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965a2d41972049e2975015ab66773956" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:08.696604 24158 raft_consensus.cc:2468] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:08.699023 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965a2d41972049e2975015ab66773956" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:08.699378 24348 leader_election.cc:304] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:08.699005 24430 raft_consensus.cc:359] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.700892 24500 raft_consensus.cc:2804] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:08.701150 24430 raft_consensus.cc:385] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.701411 24500 raft_consensus.cc:493] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.701589 24430 raft_consensus.cc:740] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.701865 24500 raft_consensus.cc:3060] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:08.700901 24346 leader_election.cc:343] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.703186 24430 consensus_queue.cc:260] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.705574 24440 leader_election.cc:290] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:08.706753 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29861adc1e34aeb8b9916d115af5f9b" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:08.707036 24430 ts_tablet_manager.cc:1434] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:21:08.707369 24158 raft_consensus.cc:3060] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.707540 24309 raft_consensus.cc:2468] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:08.708796 24346 leader_election.cc:304] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:08.709651 24440 raft_consensus.cc:2804] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:08.709918 24430 tablet_bootstrap.cc:492] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:08.710143 24440 raft_consensus.cc:697] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:08.711134 24440 consensus_queue.cc:237] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.716586 24430 tablet_bootstrap.cc:654] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.722190 24158 raft_consensus.cc:2468] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:08.725353 24497 raft_consensus.cc:515] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.729306 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7d5de1a9b448969e2db6601b724c9c" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:08.729839 24429 tablet_bootstrap.cc:492] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:08.730429 24429 ts_tablet_manager.cc:1403] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.022s
W20260709 13:21:08.731220 24200 leader_election.cc:343] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.721418 24500 raft_consensus.cc:515] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.735095 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965a2d41972049e2975015ab66773956" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
W20260709 13:21:08.736929 24346 leader_election.cc:343] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.737947 24497 leader_election.cc:290] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:08.739053 24429 raft_consensus.cc:359] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.739936 24429 raft_consensus.cc:385] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.740232 24429 raft_consensus.cc:740] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.740916 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7d5de1a9b448969e2db6601b724c9c" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:08.737978 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965a2d41972049e2975015ab66773956" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:08.741662 24309 raft_consensus.cc:3060] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.741919 24158 raft_consensus.cc:3060] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.741062 24429 consensus_queue.cc:260] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.746995 24498 raft_consensus.cc:493] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.729249 24428 tablet_bootstrap.cc:492] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:08.747527 24498 raft_consensus.cc:515] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.748158 24428 ts_tablet_manager.cc:1403] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.003s
I20260709 13:21:08.749878 24498 leader_election.cc:290] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:08.747529 24429 ts_tablet_manager.cc:1434] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 13:21:08.751825 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2833e9ae264f259ce3c2967ad5bc2d" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:08.752548 24429 tablet_bootstrap.cc:492] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:08.752446 24383 raft_consensus.cc:2468] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 0.
I20260709 13:21:08.753818 24274 leader_election.cc:304] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:08.754703 24498 raft_consensus.cc:2804] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:08.754581 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2833e9ae264f259ce3c2967ad5bc2d" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:08.755290 24498 raft_consensus.cc:493] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.755708 24498 raft_consensus.cc:3060] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:08.757370 24274 leader_election.cc:343] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.759119 24429 tablet_bootstrap.cc:654] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.766177 24500 leader_election.cc:290] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:08.751112 24428 raft_consensus.cc:359] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.771219 24428 raft_consensus.cc:385] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.771642 24428 raft_consensus.cc:740] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.772660 24428 consensus_queue.cc:260] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.780975 24158 raft_consensus.cc:2468] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:08.782745 24348 leader_election.cc:304] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:08.784623 24500 raft_consensus.cc:2804] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:08.785537 24500 raft_consensus.cc:697] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:08.786356 24498 raft_consensus.cc:515] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.786623 24500 consensus_queue.cc:237] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.788673 24498 leader_election.cc:290] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:08.793628 24428 ts_tablet_manager.cc:1434] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:21:08.795603 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2833e9ae264f259ce3c2967ad5bc2d" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:08.798134 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2833e9ae264f259ce3c2967ad5bc2d" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:08.799610 24383 raft_consensus.cc:3060] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.808472 24431 tablet_bootstrap.cc:492] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:08.809074 24431 ts_tablet_manager.cc:1403] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.146s	user 0.038s	sys 0.030s
I20260709 13:21:08.811892 24431 raft_consensus.cc:359] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.812589 24431 raft_consensus.cc:385] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.812911 24431 raft_consensus.cc:740] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.813532 24431 consensus_queue.cc:260] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
W20260709 13:21:08.814831 24274 leader_election.cc:343] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.815922 24431 ts_tablet_manager.cc:1434] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:08.816692 24158 raft_consensus.cc:3060] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.816978 24431 tablet_bootstrap.cc:492] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
W20260709 13:21:08.820766 24274 consensus_peers.cc:597] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:08.823555 24431 tablet_bootstrap.cc:654] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.827184 24309 raft_consensus.cc:2468] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:08.828958 24198 leader_election.cc:304] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:08.829926 24383 raft_consensus.cc:2468] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 1.
I20260709 13:21:08.831061 24497 raft_consensus.cc:2804] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:08.832481 24428 tablet_bootstrap.cc:492] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:08.840101 24274 leader_election.cc:304] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:08.843901 24498 raft_consensus.cc:2804] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:08.844796 24498 raft_consensus.cc:697] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:08.845870 24498 consensus_queue.cc:237] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.849560 24430 tablet_bootstrap.cc:492] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:08.851552 24430 ts_tablet_manager.cc:1403] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.142s	user 0.036s	sys 0.045s
I20260709 13:21:08.852675 24482 raft_consensus.cc:493] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.853252 24482 raft_consensus.cc:515] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.855814 24482 leader_election.cc:290] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:08.856683 24430 raft_consensus.cc:359] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.857388 24430 raft_consensus.cc:385] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.857667 24430 raft_consensus.cc:740] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.858501 24430 consensus_queue.cc:260] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.859510 24494 consensus_queue.cc:1048] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:08.863682 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:08.864405 24382 raft_consensus.cc:2468] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 0.
I20260709 13:21:08.869532 24494 consensus_queue.cc:1048] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:08.870954 24125 leader_election.cc:304] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:08.873869 24482 raft_consensus.cc:2804] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:08.874960 24429 tablet_bootstrap.cc:492] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:08.875607 24429 ts_tablet_manager.cc:1403] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.123s	user 0.029s	sys 0.018s
I20260709 13:21:08.875025 24482 raft_consensus.cc:493] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.876837 24482 raft_consensus.cc:3060] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.877364 24491 raft_consensus.cc:493] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.866609 24497 raft_consensus.cc:697] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:08.877933 24491 raft_consensus.cc:515] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:08.878949 24429 raft_consensus.cc:359] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.879858 24429 raft_consensus.cc:385] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.880184 24429 raft_consensus.cc:740] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.882416 24429 consensus_queue.cc:260] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.886780 24430 ts_tablet_manager.cc:1434] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.006s
I20260709 13:21:08.892637 24428 tablet_bootstrap.cc:654] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.896123 24494 raft_consensus.cc:493] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.900352 24429 ts_tablet_manager.cc:1434] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.003s
I20260709 13:21:08.886788 24497 consensus_queue.cc:237] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.902449 24429 tablet_bootstrap.cc:492] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:08.910784 24430 tablet_bootstrap.cc:492] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:08.912711 24055 catalog_manager.cc:5697] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.902781 24494 raft_consensus.cc:515] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:08.914876 24491 leader_election.cc:290] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:08.915235 24055 catalog_manager.cc:5697] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.916332 24494 leader_election.cc:290] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:08.918283 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd592b9cef049dfbfa3d0ee1ab44c41" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:08.918504 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd592b9cef049dfbfa3d0ee1ab44c41" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:08.917179 24430 tablet_bootstrap.cc:654] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.924306 24160 raft_consensus.cc:2393] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e96a35df00e4646b9c6e356c6fb4bba in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:08.927565 24200 leader_election.cc:304] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:08.928371 24537 raft_consensus.cc:3060] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.930519 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:08.931226 24383 raft_consensus.cc:2468] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 0.
I20260709 13:21:08.932827 24274 leader_election.cc:304] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:08.934247 24491 raft_consensus.cc:2804] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:08.934795 24491 raft_consensus.cc:493] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.935225 24491 raft_consensus.cc:3060] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.939014 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:08.940157 24500 consensus_queue.cc:1048] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:08.949642 24433 raft_consensus.cc:493] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.955657 24430 tablet_bootstrap.cc:492] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:08.957577 24431 tablet_bootstrap.cc:492] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:08.960224 24430 ts_tablet_manager.cc:1403] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.003s
I20260709 13:21:08.960304 24431 ts_tablet_manager.cc:1403] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.010s
I20260709 13:21:08.949867 24429 tablet_bootstrap.cc:654] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:08.952958 24433 raft_consensus.cc:515] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:08.965178 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449b9227c5fd46caa8fb8daa040867e9" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:08.978854 24482 raft_consensus.cc:515] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
W20260709 13:21:08.979200 24274 leader_election.cc:343] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:08.982975 24160 raft_consensus.cc:2393] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c6aaf55421432a91a73360865771d3 in current term 1: Already voted for candidate 97e577a376c948bfac33665f06a4bb98 in this term.
I20260709 13:21:08.986107 24482 leader_election.cc:290] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:08.986728 24431 raft_consensus.cc:359] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:08.988392 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:08.990943 24433 leader_election.cc:290] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:08.991163 24383 raft_consensus.cc:3060] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:08.990971 24431 raft_consensus.cc:385] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:08.991909 24431 raft_consensus.cc:740] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:08.992378 24544 raft_consensus.cc:493] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.989053 24537 raft_consensus.cc:2749] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:08.992985 24431 consensus_queue.cc:260] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.001760 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449b9227c5fd46caa8fb8daa040867e9" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:08.951406 24491 raft_consensus.cc:515] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.018715 24431 ts_tablet_manager.cc:1434] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.003s
I20260709 13:21:09.020131 24431 tablet_bootstrap.cc:492] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:09.024773 24430 raft_consensus.cc:359] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:09.026916 24430 raft_consensus.cc:385] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.027552 24430 raft_consensus.cc:740] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.028870 24430 consensus_queue.cc:260] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
W20260709 13:21:09.023204 24272 leader_election.cc:343] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.034629 24430 ts_tablet_manager.cc:1434] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 13:21:09.015192 24544 raft_consensus.cc:515] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.043411 24428 tablet_bootstrap.cc:492] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:09.045554 24428 ts_tablet_manager.cc:1403] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.213s	user 0.028s	sys 0.011s
I20260709 13:21:09.036329 24272 leader_election.cc:304] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:09.048791 24433 raft_consensus.cc:2749] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.050313 24440 consensus_queue.cc:1048] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:09.051371 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:09.052356 24308 raft_consensus.cc:2393] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate b8c6aaf55421432a91a73360865771d3 in this term.
I20260709 13:21:09.052564 24428 raft_consensus.cc:359] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.053300 24428 raft_consensus.cc:385] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.053640 24428 raft_consensus.cc:740] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.054736 24428 consensus_queue.cc:260] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.053615 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:09.060294 24307 raft_consensus.cc:2393] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate b8c6aaf55421432a91a73360865771d3 in this term.
I20260709 13:21:09.043473 24494 raft_consensus.cc:493] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.064992 24537 raft_consensus.cc:493] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.065335 24497 consensus_queue.cc:1048] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:09.065543 24537 raft_consensus.cc:515] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.065860 24430 tablet_bootstrap.cc:492] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:09.067757 24537 leader_election.cc:290] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:09.069051 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e20ad9ccb7d416fb78ca24817f25f01" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:09.070014 24309 raft_consensus.cc:2468] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:09.069589 24057 catalog_manager.cc:5697] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:09.070920 24440 raft_consensus.cc:493] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.071343 24198 leader_election.cc:304] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:09.071411 24440 raft_consensus.cc:515] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.072461 24537 raft_consensus.cc:2804] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:09.072932 24537 raft_consensus.cc:493] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.073318 24537 raft_consensus.cc:3060] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.073407 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e20ad9ccb7d416fb78ca24817f25f01" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:09.073740 24440 leader_election.cc:290] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:09.074177 24158 raft_consensus.cc:2468] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:09.065860 24431 tablet_bootstrap.cc:654] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.084476 24498 raft_consensus.cc:493] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.084270 24537 raft_consensus.cc:515] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.085119 24498 raft_consensus.cc:515] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.086265 24430 tablet_bootstrap.cc:654] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.088817 24428 ts_tablet_manager.cc:1434] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:21:09.085866 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6f84753e2b4220a883363c1561af3a" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:09.090312 24428 tablet_bootstrap.cc:492] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:09.095803 24498 leader_election.cc:290] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:09.097450 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e41c560ee74f5c860ed22ba1487d2d" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:09.098369 24428 tablet_bootstrap.cc:654] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:09.099054 24272 leader_election.cc:343] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.099386 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6f84753e2b4220a883363c1561af3a" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:09.076290 24494 raft_consensus.cc:515] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.100183 24309 raft_consensus.cc:2393] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96be869fbe4e464a99c0d5aa3d90dbfb in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
I20260709 13:21:09.100889 24383 raft_consensus.cc:2468] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 1.
I20260709 13:21:09.102051 24346 leader_election.cc:304] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:09.095610 24380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:09.107183 24537 leader_election.cc:290] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:09.107826 24235 raft_consensus.cc:3060] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.108736 24491 leader_election.cc:290] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:09.102752 24544 leader_election.cc:290] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:09.111781 24429 tablet_bootstrap.cc:492] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:09.105353 24440 raft_consensus.cc:3060] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.113921 24429 ts_tablet_manager.cc:1403] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.212s	user 0.021s	sys 0.004s
I20260709 13:21:09.115841 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e20ad9ccb7d416fb78ca24817f25f01" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:09.126816 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:09.127954 24158 raft_consensus.cc:2393] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c6aaf55421432a91a73360865771d3 in current term 1: Already voted for candidate 97e577a376c948bfac33665f06a4bb98 in this term.
I20260709 13:21:09.125660 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e20ad9ccb7d416fb78ca24817f25f01" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:09.130400 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e20ad9ccb7d416fb78ca24817f25f01" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:09.130847 24233 raft_consensus.cc:2393] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
I20260709 13:21:09.131019 24308 raft_consensus.cc:3060] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.119745 24125 leader_election.cc:304] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: b8c6aaf55421432a91a73360865771d3
W20260709 13:21:09.129426 24106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:09.132956 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e41c560ee74f5c860ed22ba1487d2d" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:09.133898 24381 raft_consensus.cc:2468] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 0.
I20260709 13:21:09.132958 24431 tablet_bootstrap.cc:492] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:09.123157 24380 raft_consensus.cc:2393] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c6aaf55421432a91a73360865771d3 in current term 1: Already voted for candidate 97e577a376c948bfac33665f06a4bb98 in this term.
I20260709 13:21:09.130257 24159 raft_consensus.cc:3060] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.135310 24054 catalog_manager.cc:5697] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:09.121939 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb70981888a450ca715b1ed427ba95e" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:09.139755 24491 consensus_queue.cc:1048] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:09.135479 24431 ts_tablet_manager.cc:1403] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.009s
I20260709 13:21:09.150818 24380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb70981888a450ca715b1ed427ba95e" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:09.151684 24380 raft_consensus.cc:2393] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e96a35df00e4646b9c6e356c6fb4bba in current term 1: Already voted for candidate b8c6aaf55421432a91a73360865771d3 in this term.
I20260709 13:21:09.152681 24429 raft_consensus.cc:359] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.152940 24200 leader_election.cc:304] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:09.153439 24429 raft_consensus.cc:385] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.153746 24429 raft_consensus.cc:740] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.154568 24429 consensus_queue.cc:260] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.142973 24494 leader_election.cc:290] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:09.159940 24431 raft_consensus.cc:359] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:09.160758 24428 tablet_bootstrap.cc:492] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:09.160935 24431 raft_consensus.cc:385] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.161487 24431 raft_consensus.cc:740] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.161607 24428 ts_tablet_manager.cc:1403] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.004s
I20260709 13:21:09.162611 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e20ad9ccb7d416fb78ca24817f25f01" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:09.163858 24551 consensus_queue.cc:1048] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:09.166422 24274 leader_election.cc:304] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:09.167124 24429 ts_tablet_manager.cc:1434] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:21:09.167460 24551 raft_consensus.cc:2804] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:09.168011 24551 raft_consensus.cc:493] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.168498 24429 tablet_bootstrap.cc:492] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:09.168669 24551 raft_consensus.cc:3060] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.169384 24428 raft_consensus.cc:359] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.171541 24428 raft_consensus.cc:385] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.172595 24428 raft_consensus.cc:740] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.174399 24428 consensus_queue.cc:260] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.171038 24431 consensus_queue.cc:260] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:09.143141 24544 raft_consensus.cc:2804] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:09.170939 24274 leader_election.cc:304] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:09.180791 24428 ts_tablet_manager.cc:1434] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:21:09.181710 24537 raft_consensus.cc:2749] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.182476 24498 raft_consensus.cc:2749] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.182072 24544 raft_consensus.cc:697] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 1 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:09.184012 24544 consensus_queue.cc:237] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.184417 24123 leader_election.cc:304] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:09.185020 24429 tablet_bootstrap.cc:654] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.185556 24440 raft_consensus.cc:2749] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.187738 24308 raft_consensus.cc:2468] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:09.182080 24428 tablet_bootstrap.cc:492] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:09.191457 24198 leader_election.cc:304] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:09.192179 24551 raft_consensus.cc:515] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.192902 24494 raft_consensus.cc:2804] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:09.193392 24494 raft_consensus.cc:697] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:09.194314 24494 consensus_queue.cc:237] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.194846 24551 leader_election.cc:290] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:09.195418 24551 consensus_queue.cc:1048] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:09.180711 24159 raft_consensus.cc:2468] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:09.202876 24431 ts_tablet_manager.cc:1434] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.001s
I20260709 13:21:09.205018 24431 tablet_bootstrap.cc:492] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:09.203058 24482 raft_consensus.cc:2749] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.211290 24428 tablet_bootstrap.cc:654] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.226585 24544 raft_consensus.cc:493] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.208943 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e41c560ee74f5c860ed22ba1487d2d" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:09.204258 24463 consensus_queue.cc:1048] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:21:09.243909 24430 tablet_bootstrap.cc:492] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:09.244417 24430 ts_tablet_manager.cc:1403] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.179s	user 0.022s	sys 0.005s
I20260709 13:21:09.248123 24498 raft_consensus.cc:493] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.248726 24498 raft_consensus.cc:515] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.252444 24498 leader_election.cc:290] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
W20260709 13:21:09.252600 24272 leader_election.cc:343] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.253784 24532 raft_consensus.cc:493] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.254586 24532 raft_consensus.cc:515] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:09.255730 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:09.257494 24532 leader_election.cc:290] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:09.244220 24380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e41c560ee74f5c860ed22ba1487d2d" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:09.260098 24547 consensus_queue.cc:1048] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:09.261027 24380 raft_consensus.cc:3060] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.232796 24544 raft_consensus.cc:515] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.267906 24544 leader_election.cc:290] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:09.282722 24430 raft_consensus.cc:359] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.283581 24430 raft_consensus.cc:385] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.283862 24430 raft_consensus.cc:740] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.284621 24430 consensus_queue.cc:260] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.287902 24430 ts_tablet_manager.cc:1434] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:21:09.289072 24430 tablet_bootstrap.cc:492] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:09.291519 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5172214c61f4935bce32538470f1ef8" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:09.292892 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
W20260709 13:21:09.293885 24348 leader_election.cc:343] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.294602 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5172214c61f4935bce32538470f1ef8" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:09.297271 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f87db850ae4d62b879e989d7572ad8" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:09.295533 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f87db850ae4d62b879e989d7572ad8" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:09.296542 24274 leader_election.cc:343] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:09.301141 24274 leader_election.cc:343] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.301775 24274 leader_election.cc:304] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:09.302832 24491 raft_consensus.cc:2749] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.303612 24123 leader_election.cc:304] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:09.304093 24431 tablet_bootstrap.cc:654] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.307737 24494 raft_consensus.cc:493] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.307753 24567 raft_consensus.cc:2749] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.313908 24494 raft_consensus.cc:515] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:09.318006 24380 raft_consensus.cc:2468] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 1.
I20260709 13:21:09.319857 24494 leader_election.cc:290] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:09.320413 24428 tablet_bootstrap.cc:492] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:09.320941 24428 ts_tablet_manager.cc:1403] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.006s
I20260709 13:21:09.320842 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965a2d41972049e2975015ab66773956" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
W20260709 13:21:09.330065 24346 leader_election.cc:343] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.330201 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965a2d41972049e2975015ab66773956" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:09.333806 24430 tablet_bootstrap.cc:654] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.340221 24158 raft_consensus.cc:2393] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e96a35df00e4646b9c6e356c6fb4bba in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:09.343642 24428 raft_consensus.cc:359] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.346172 24428 raft_consensus.cc:385] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.346630 24428 raft_consensus.cc:740] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.344458 24346 leader_election.cc:304] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:09.352005 24200 leader_election.cc:304] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:09.353534 24537 raft_consensus.cc:3060] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.354121 24494 raft_consensus.cc:493] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.354621 24428 consensus_queue.cc:260] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.355196 24274 leader_election.cc:304] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:09.357782 24569 raft_consensus.cc:2804] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:09.358474 24569 raft_consensus.cc:697] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:09.359612 24569 consensus_queue.cc:237] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.354663 24494 raft_consensus.cc:515] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.367136 24573 raft_consensus.cc:2749] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.372836 24560 consensus_queue.cc:1048] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:09.375881 24428 ts_tablet_manager.cc:1434] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 13:21:09.378822 24498 raft_consensus.cc:493] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.379369 24498 raft_consensus.cc:515] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.381299 24428 tablet_bootstrap.cc:492] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:09.383167 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67fd67822294670b224a43c149b126f" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:09.384698 24272 leader_election.cc:343] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.386206 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67fd67822294670b224a43c149b126f" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
W20260709 13:21:09.387715 24274 leader_election.cc:343] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.388170 24429 tablet_bootstrap.cc:492] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:09.388147 24274 leader_election.cc:304] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:09.388840 24429 ts_tablet_manager.cc:1403] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.221s	user 0.014s	sys 0.024s
I20260709 13:21:09.389055 24433 raft_consensus.cc:2749] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.381569 24498 leader_election.cc:290] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:09.397684 24440 consensus_queue.cc:1048] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:09.396808 24346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:34445, user_credentials={real_user=slave}} blocked reactor thread for 66836.2us
I20260709 13:21:09.396842 24429 raft_consensus.cc:359] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.408073 24429 raft_consensus.cc:385] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.408977 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449b9227c5fd46caa8fb8daa040867e9" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:09.409474 24430 tablet_bootstrap.cc:492] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:09.409986 24430 ts_tablet_manager.cc:1403] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.121s	user 0.018s	sys 0.003s
I20260709 13:21:09.408517 24429 raft_consensus.cc:740] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
W20260709 13:21:09.410658 24200 leader_election.cc:343] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.411372 24537 raft_consensus.cc:2749] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.414695 24430 raft_consensus.cc:359] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.418526 24428 tablet_bootstrap.cc:654] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.411562 24429 consensus_queue.cc:260] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.422456 24429 ts_tablet_manager.cc:1434] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.002s
I20260709 13:21:09.419848 24494 leader_election.cc:290] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:09.423408 24429 tablet_bootstrap.cc:492] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:09.426654 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449b9227c5fd46caa8fb8daa040867e9" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:09.427439 24308 raft_consensus.cc:2468] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:09.430672 24198 leader_election.cc:304] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:09.431490 24537 raft_consensus.cc:2804] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:09.431720 24160 raft_consensus.cc:3060] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.431900 24537 raft_consensus.cc:493] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.432319 24537 raft_consensus.cc:3060] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.436703 24429 tablet_bootstrap.cc:654] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.437005 24440 consensus_queue.cc:1048] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:09.441656 24494 consensus_queue.cc:1048] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:09.443943 24430 raft_consensus.cc:385] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.444830 24430 raft_consensus.cc:740] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.427626 24431 tablet_bootstrap.cc:492] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:09.448657 24431 ts_tablet_manager.cc:1403] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.244s	user 0.041s	sys 0.032s
I20260709 13:21:09.450484 24430 consensus_queue.cc:260] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.459424 24537 raft_consensus.cc:515] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.460021 24158 raft_consensus.cc:3060] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.462073 24537 leader_election.cc:290] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:09.448021 24057 catalog_manager.cc:5697] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:09.471169 24430 ts_tablet_manager.cc:1434] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:21:09.473326 24433 raft_consensus.cc:493] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.473950 24433 raft_consensus.cc:515] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.474710 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449b9227c5fd46caa8fb8daa040867e9" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:09.479090 24433 leader_election.cc:290] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:09.480276 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96813b389fd14d7890c804a06966b952" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:09.482209 24272 leader_election.cc:343] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.482698 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "449b9227c5fd46caa8fb8daa040867e9" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:09.483340 24307 raft_consensus.cc:3060] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:09.486523 24200 leader_election.cc:343] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.488634 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96813b389fd14d7890c804a06966b952" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:09.491847 24544 raft_consensus.cc:493] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.492344 24544 raft_consensus.cc:515] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.494504 24544 leader_election.cc:290] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:09.497181 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b184e3a09204b16a54a19c799fe3491" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:09.499935 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b184e3a09204b16a54a19c799fe3491" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:09.500576 24430 tablet_bootstrap.cc:492] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
W20260709 13:21:09.501320 24274 leader_election.cc:343] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.501179 24056 catalog_manager.cc:5697] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.510234 24430 tablet_bootstrap.cc:654] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.501922 24274 leader_election.cc:304] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:09.503340 24055 catalog_manager.cc:5697] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:09.516881 24307 raft_consensus.cc:2468] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:09.518445 24198 leader_election.cc:304] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:09.519790 24537 raft_consensus.cc:2804] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:09.506358 24433 consensus_queue.cc:1048] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:21:09.521409 24431 raft_consensus.cc:359] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.522219 24431 raft_consensus.cc:385] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.522496 24431 raft_consensus.cc:740] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.523312 24431 consensus_queue.cc:260] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.521473 24537 raft_consensus.cc:697] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:09.525308 24431 ts_tablet_manager.cc:1434] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:21:09.525035 24537 consensus_queue.cc:237] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.526332 24431 tablet_bootstrap.cc:492] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:09.530876 24123 leader_election.cc:304] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:09.532071 24544 raft_consensus.cc:2749] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.513676 24569 raft_consensus.cc:2749] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.537384 24497 consensus_queue.cc:1048] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:09.541635 24429 tablet_bootstrap.cc:492] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:09.542275 24429 ts_tablet_manager.cc:1403] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.004s
I20260709 13:21:09.548866 24428 tablet_bootstrap.cc:492] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:09.549574 24428 ts_tablet_manager.cc:1403] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.169s	user 0.023s	sys 0.016s
I20260709 13:21:09.561714 24431 tablet_bootstrap.cc:654] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:09.555492 24274 consensus_peers.cc:597] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:09.567176 24429 raft_consensus.cc:359] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.567957 24429 raft_consensus.cc:385] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.568574 24429 raft_consensus.cc:740] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.569311 24429 consensus_queue.cc:260] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.573215 24429 ts_tablet_manager.cc:1434] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:21:09.576998 24428 raft_consensus.cc:359] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.577775 24428 raft_consensus.cc:385] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.580468 24429 tablet_bootstrap.cc:492] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:09.578117 24428 raft_consensus.cc:740] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.585799 24428 consensus_queue.cc:260] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.592164 24428 ts_tablet_manager.cc:1434] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:21:09.593510 24428 tablet_bootstrap.cc:492] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:09.590425 24429 tablet_bootstrap.cc:654] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.602490 24428 tablet_bootstrap.cc:654] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.603762 24440 raft_consensus.cc:493] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.604866 24440 raft_consensus.cc:515] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:09.615643 24567 consensus_queue.cc:1048] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:21:09.623857 24537 raft_consensus.cc:493] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.624487 24537 raft_consensus.cc:515] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.628583 24428 tablet_bootstrap.cc:492] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:09.629258 24428 ts_tablet_manager.cc:1403] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.036s	user 0.001s	sys 0.015s
I20260709 13:21:09.632311 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e41c560ee74f5c860ed22ba1487d2d" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:09.633229 24440 leader_election.cc:290] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:09.633091 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc3f1f066843e382fa402c8d4ec110" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:09.634279 24537 leader_election.cc:290] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:09.634980 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc3f1f066843e382fa402c8d4ec110" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:09.635228 24348 leader_election.cc:343] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.637269 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e41c560ee74f5c860ed22ba1487d2d" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:09.638559 24381 raft_consensus.cc:2393] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e96a35df00e4646b9c6e356c6fb4bba in current term 1: Already voted for candidate b8c6aaf55421432a91a73360865771d3 in this term.
W20260709 13:21:09.640903 24346 leader_election.cc:343] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.641789 24428 raft_consensus.cc:359] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.642614 24428 raft_consensus.cc:385] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.642874 24428 raft_consensus.cc:740] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.643599 24428 consensus_queue.cc:260] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.644248 24430 tablet_bootstrap.cc:492] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:09.645047 24430 ts_tablet_manager.cc:1403] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.145s	user 0.021s	sys 0.005s
I20260709 13:21:09.646564 24200 leader_election.cc:304] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:09.641578 24346 leader_election.cc:304] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:09.649322 24560 raft_consensus.cc:493] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.650015 24560 raft_consensus.cc:515] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.652259 24537 raft_consensus.cc:3060] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.653420 24560 leader_election.cc:290] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:09.655941 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67fd67822294670b224a43c149b126f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:09.658846 24430 raft_consensus.cc:359] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.659564 24430 raft_consensus.cc:385] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.659807 24430 raft_consensus.cc:740] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.661629 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67fd67822294670b224a43c149b126f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:09.662358 24308 raft_consensus.cc:2468] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:09.662433 24440 raft_consensus.cc:2749] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.663509 24430 consensus_queue.cc:260] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.664399 24235 raft_consensus.cc:2468] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:09.666082 24346 leader_election.cc:304] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:09.669906 24428 ts_tablet_manager.cc:1434] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.002s
I20260709 13:21:09.670993 24428 tablet_bootstrap.cc:492] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:09.672269 24544 consensus_queue.cc:1048] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:09.675691 24057 catalog_manager.cc:5697] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:09.676718 24431 tablet_bootstrap.cc:492] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:09.678522 24431 ts_tablet_manager.cc:1403] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.152s	user 0.040s	sys 0.040s
I20260709 13:21:09.680740 24560 raft_consensus.cc:2804] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:09.681154 24560 raft_consensus.cc:493] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.681504 24560 raft_consensus.cc:3060] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.686447 24430 ts_tablet_manager.cc:1434] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.004s
I20260709 13:21:09.687659 24430 tablet_bootstrap.cc:492] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:09.681488 24431 raft_consensus.cc:359] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.691015 24431 raft_consensus.cc:385] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.691394 24431 raft_consensus.cc:740] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.691676 24537 raft_consensus.cc:2749] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.696410 24428 tablet_bootstrap.cc:654] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.696344 24431 consensus_queue.cc:260] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.698678 24431 ts_tablet_manager.cc:1434] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:21:09.699683 24431 tablet_bootstrap.cc:492] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:09.700380 24429 tablet_bootstrap.cc:492] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:09.700896 24429 ts_tablet_manager.cc:1403] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.121s	user 0.021s	sys 0.021s
I20260709 13:21:09.689754 24560 raft_consensus.cc:515] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.703334 24544 raft_consensus.cc:493] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.703491 24429 raft_consensus.cc:359] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.703817 24544 raft_consensus.cc:515] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.704208 24429 raft_consensus.cc:385] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.704499 24429 raft_consensus.cc:740] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.705962 24544 leader_election.cc:290] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:09.707132 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2833e9ae264f259ce3c2967ad5bc2d" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:09.707584 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2833e9ae264f259ce3c2967ad5bc2d" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:09.709314 24123 leader_election.cc:304] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:09.710474 24544 raft_consensus.cc:2749] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.710824 24430 tablet_bootstrap.cc:654] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.711840 24560 leader_election.cc:290] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:09.713346 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67fd67822294670b224a43c149b126f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:09.714010 24235 raft_consensus.cc:3060] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.716104 24431 tablet_bootstrap.cc:654] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.718878 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67fd67822294670b224a43c149b126f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:09.719681 24307 raft_consensus.cc:3060] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.720898 24428 tablet_bootstrap.cc:492] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:09.721580 24428 ts_tablet_manager.cc:1403] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.001s
I20260709 13:21:09.725109 24428 raft_consensus.cc:359] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.725775 24428 raft_consensus.cc:385] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.726058 24428 raft_consensus.cc:740] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.726996 24428 consensus_queue.cc:260] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.727981 24431 tablet_bootstrap.cc:492] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:09.728472 24431 ts_tablet_manager.cc:1403] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.009s
I20260709 13:21:09.731051 24431 raft_consensus.cc:359] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.731732 24431 raft_consensus.cc:385] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.732015 24431 raft_consensus.cc:740] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.731305 24235 raft_consensus.cc:2468] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:09.733270 24431 consensus_queue.cc:260] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.733587 24346 leader_election.cc:304] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:09.734679 24573 raft_consensus.cc:2804] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:09.735145 24573 raft_consensus.cc:697] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:09.735410 24431 ts_tablet_manager.cc:1434] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:09.735978 24573 consensus_queue.cc:237] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.737181 24431 tablet_bootstrap.cc:492] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:09.740710 24428 ts_tablet_manager.cc:1434] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:21:09.741353 24429 consensus_queue.cc:260] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.741717 24428 tablet_bootstrap.cc:492] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:09.746713 24307 raft_consensus.cc:2468] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:09.755460 24428 tablet_bootstrap.cc:654] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.755864 24431 tablet_bootstrap.cc:654] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.755518 24429 ts_tablet_manager.cc:1434] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.002s
I20260709 13:21:09.765235 24430 tablet_bootstrap.cc:492] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:09.765920 24430 ts_tablet_manager.cc:1403] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.000s
I20260709 13:21:09.766127 24429 tablet_bootstrap.cc:492] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:09.769445 24055 catalog_manager.cc:5697] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.774441 24430 raft_consensus.cc:359] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:09.775321 24430 raft_consensus.cc:385] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.775715 24430 raft_consensus.cc:740] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.776517 24430 consensus_queue.cc:260] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:09.784190 24430 ts_tablet_manager.cc:1434] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:21:09.785305 24430 tablet_bootstrap.cc:492] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:09.787729 24429 tablet_bootstrap.cc:654] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.793720 24498 raft_consensus.cc:493] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.794494 24498 raft_consensus.cc:515] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.795284 24539 consensus_queue.cc:1048] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:21:09.800148 24428 tablet_bootstrap.cc:492] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:09.800616 24498 leader_election.cc:290] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:09.800741 24428 ts_tablet_manager.cc:1403] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.012s
I20260709 13:21:09.803952 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feff48c38ffe40ec83c61e469590bab2" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:09.804759 24381 raft_consensus.cc:2468] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 0.
I20260709 13:21:09.803792 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feff48c38ffe40ec83c61e469590bab2" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:09.804795 24428 raft_consensus.cc:359] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.805929 24428 raft_consensus.cc:385] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.806339 24428 raft_consensus.cc:740] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.807164 24428 consensus_queue.cc:260] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:09.809717 24428 ts_tablet_manager.cc:1434] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:09.809945 24539 consensus_queue.cc:1048] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:09.814455 24428 tablet_bootstrap.cc:492] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
W20260709 13:21:09.816828 24274 leader_election.cc:343] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.818284 24274 leader_election.cc:304] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:09.819329 24491 consensus_queue.cc:1048] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:09.820883 24491 raft_consensus.cc:2804] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:09.821269 24491 raft_consensus.cc:493] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.821658 24491 raft_consensus.cc:3060] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.822046 24428 tablet_bootstrap.cc:654] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.843575 24430 tablet_bootstrap.cc:654] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.850353 24429 tablet_bootstrap.cc:492] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:09.851058 24429 ts_tablet_manager.cc:1403] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.005s
I20260709 13:21:09.854202 24429 raft_consensus.cc:359] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.854938 24429 raft_consensus.cc:385] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.855244 24429 raft_consensus.cc:740] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.855960 24551 raft_consensus.cc:493] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.856199 24429 consensus_queue.cc:260] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.856590 24551 raft_consensus.cc:515] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.859076 24551 leader_election.cc:290] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:09.860067 24544 raft_consensus.cc:493] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.860635 24544 raft_consensus.cc:515] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.866575 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
W20260709 13:21:09.868278 24125 leader_election.cc:343] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.869786 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b95f5240b5450d968047f65e13d4ea" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:09.872598 24429 ts_tablet_manager.cc:1434] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:21:09.873714 24429 tablet_bootstrap.cc:492] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:09.874775 24491 raft_consensus.cc:515] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
W20260709 13:21:09.875654 24272 leader_election.cc:343] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.864816 24544 leader_election.cc:290] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:09.881057 24431 tablet_bootstrap.cc:492] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:09.881892 24431 ts_tablet_manager.cc:1403] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.145s	user 0.030s	sys 0.037s
I20260709 13:21:09.881969 24429 tablet_bootstrap.cc:654] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.886395 24431 raft_consensus.cc:359] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.887518 24431 raft_consensus.cc:385] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.887912 24431 raft_consensus.cc:740] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.888926 24431 consensus_queue.cc:260] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:09.892091 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b95f5240b5450d968047f65e13d4ea" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:09.894253 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feff48c38ffe40ec83c61e469590bab2" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:09.894704 24498 raft_consensus.cc:493] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.895046 24379 raft_consensus.cc:3060] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.895570 24498 raft_consensus.cc:515] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.894214 24429 tablet_bootstrap.cc:492] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:09.905107 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:09.909706 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:09.911237 24429 ts_tablet_manager.cc:1403] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.000s
I20260709 13:21:09.911455 24306 raft_consensus.cc:2468] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 0.
I20260709 13:21:09.914667 24491 leader_election.cc:290] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:09.908854 24382 raft_consensus.cc:2468] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 0.
I20260709 13:21:09.909675 24431 ts_tablet_manager.cc:1434] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:21:09.916404 24379 raft_consensus.cc:2468] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 1.
I20260709 13:21:09.916729 24431 tablet_bootstrap.cc:492] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:09.898229 24498 leader_election.cc:290] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:09.919703 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:09.921900 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feff48c38ffe40ec83c61e469590bab2" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:09.919797 24123 leader_election.cc:304] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:09.924538 24544 raft_consensus.cc:2804] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:09.924985 24544 raft_consensus.cc:493] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.925513 24544 raft_consensus.cc:3060] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:09.926041 24274 leader_election.cc:343] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.928453 24274 leader_election.cc:304] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:09.926772 24429 raft_consensus.cc:359] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:09.934806 24429 raft_consensus.cc:385] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.935179 24429 raft_consensus.cc:740] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.935868 24429 consensus_queue.cc:260] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:09.937883 24491 raft_consensus.cc:2804] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:09.941325 24498 consensus_queue.cc:1048] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:09.941679 24429 ts_tablet_manager.cc:1434] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:21:09.943380 24274 leader_election.cc:304] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:09.948203 24551 raft_consensus.cc:2804] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:09.943817 24429 tablet_bootstrap.cc:492] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:09.949141 24551 raft_consensus.cc:493] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.949995 24551 raft_consensus.cc:3060] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.948104 24544 raft_consensus.cc:515] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:09.943801 24428 tablet_bootstrap.cc:492] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:09.953998 24430 tablet_bootstrap.cc:492] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:09.959205 24428 ts_tablet_manager.cc:1403] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.145s	user 0.031s	sys 0.033s
I20260709 13:21:09.959379 24430 ts_tablet_manager.cc:1403] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.174s	user 0.015s	sys 0.004s
I20260709 13:21:09.963555 24430 raft_consensus.cc:359] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:09.964466 24430 raft_consensus.cc:385] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.964834 24430 raft_consensus.cc:740] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.965647 24430 consensus_queue.cc:260] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:09.968014 24430 ts_tablet_manager.cc:1434] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:09.969141 24430 tablet_bootstrap.cc:492] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:09.969746 24497 consensus_queue.cc:1048] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:09.975445 24431 tablet_bootstrap.cc:654] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.975952 24430 tablet_bootstrap.cc:654] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:09.983371 24274 leader_election.cc:343] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.984354 24274 leader_election.cc:304] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:09.985868 24569 raft_consensus.cc:2749] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:09.988431 24274 leader_election.cc:343] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.994218 24544 leader_election.cc:290] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:09.984544 24157 raft_consensus.cc:3060] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.999444 24429 tablet_bootstrap.cc:654] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.006338 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
W20260709 13:21:10.008015 24125 leader_election.cc:343] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:09.999419 24272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:34445, user_credentials={real_user=slave}} blocked reactor thread for 60727.4us
I20260709 13:21:09.996833 24491 raft_consensus.cc:697] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:10.013952 24551 raft_consensus.cc:515] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.014359 24428 raft_consensus.cc:359] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.024117 24428 raft_consensus.cc:385] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.024482 24428 raft_consensus.cc:740] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.025329 24428 consensus_queue.cc:260] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.035327 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:10.036199 24307 raft_consensus.cc:3060] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.039894 24428 ts_tablet_manager.cc:1434] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:21:10.042757 24428 tablet_bootstrap.cc:492] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:10.018142 24491 consensus_queue.cc:237] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.053817 24431 tablet_bootstrap.cc:492] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:10.054490 24431 ts_tablet_manager.cc:1403] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.138s	user 0.020s	sys 0.005s
I20260709 13:21:10.058943 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b95f5240b5450d968047f65e13d4ea" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:10.059703 24382 raft_consensus.cc:3060] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.059597 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b95f5240b5450d968047f65e13d4ea" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
W20260709 13:21:10.063663 24272 leader_election.cc:343] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.066996 24158 raft_consensus.cc:3060] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.067312 24159 raft_consensus.cc:3060] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.081591 24539 raft_consensus.cc:493] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.082455 24539 raft_consensus.cc:515] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.082764 24431 raft_consensus.cc:359] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.083603 24431 raft_consensus.cc:385] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.083935 24431 raft_consensus.cc:740] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.087082 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5172214c61f4935bce32538470f1ef8" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:10.087926 24379 raft_consensus.cc:2468] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:10.088850 24431 consensus_queue.cc:260] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.089694 24200 leader_election.cc:304] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:10.090706 24547 raft_consensus.cc:2804] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:10.091120 24547 raft_consensus.cc:493] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.091475 24547 raft_consensus.cc:3060] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.092738 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5172214c61f4935bce32538470f1ef8" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:10.094376 24155 raft_consensus.cc:2468] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:10.099145 24537 consensus_queue.cc:1048] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:10.102469 24539 leader_election.cc:290] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:10.107658 24431 ts_tablet_manager.cc:1434] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:21:10.056907 24551 leader_election.cc:290] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:10.109242 24431 tablet_bootstrap.cc:492] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:10.110564 24428 tablet_bootstrap.cc:654] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.109582 24307 raft_consensus.cc:2468] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 1.
I20260709 13:21:10.116389 24429 tablet_bootstrap.cc:492] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:10.117974 24123 leader_election.cc:304] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:10.124805 24429 ts_tablet_manager.cc:1403] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.017s
I20260709 13:21:10.125579 24544 raft_consensus.cc:2804] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.126140 24544 raft_consensus.cc:697] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 1 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:10.126977 24544 consensus_queue.cc:237] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.127859 24429 raft_consensus.cc:359] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.128564 24429 raft_consensus.cc:385] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.128870 24429 raft_consensus.cc:740] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.129743 24429 consensus_queue.cc:260] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.131287 24430 tablet_bootstrap.cc:492] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:10.131956 24430 ts_tablet_manager.cc:1403] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.163s	user 0.030s	sys 0.029s
I20260709 13:21:10.134552 24429 ts_tablet_manager.cc:1434] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:10.131675 24382 raft_consensus.cc:2468] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 1.
I20260709 13:21:10.135629 24429 tablet_bootstrap.cc:492] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:10.139812 24431 tablet_bootstrap.cc:654] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.137831 24430 raft_consensus.cc:359] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.141881 24430 raft_consensus.cc:385] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.142377 24430 raft_consensus.cc:740] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.143435 24430 consensus_queue.cc:260] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.130142 24547 raft_consensus.cc:515] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.156754 24274 leader_election.cc:304] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:10.163102 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5172214c61f4935bce32538470f1ef8" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:10.164080 24379 raft_consensus.cc:3060] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.147289 24572 raft_consensus.cc:493] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.168623 24572 raft_consensus.cc:515] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.171213 24572 leader_election.cc:290] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:10.172686 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:10.178484 24491 raft_consensus.cc:2804] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.179085 24491 raft_consensus.cc:697] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:10.179931 24491 consensus_queue.cc:237] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.188156 24572 raft_consensus.cc:493] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.189143 24572 raft_consensus.cc:515] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.192698 24430 ts_tablet_manager.cc:1434] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.060s	user 0.010s	sys 0.000s
I20260709 13:21:10.193694 24430 tablet_bootstrap.cc:492] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:10.198240 24547 leader_election.cc:290] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:10.202790 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5172214c61f4935bce32538470f1ef8" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:10.203578 24157 raft_consensus.cc:3060] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.208434 24428 tablet_bootstrap.cc:492] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:10.209003 24428 ts_tablet_manager.cc:1403] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.167s	user 0.012s	sys 0.002s
I20260709 13:21:10.210378 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:10.211339 24306 raft_consensus.cc:2393] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96be869fbe4e464a99c0d5aa3d90dbfb in current term 1: Already voted for candidate 97e577a376c948bfac33665f06a4bb98 in this term.
I20260709 13:21:10.212170 24428 raft_consensus.cc:359] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.213320 24428 raft_consensus.cc:385] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.213675 24428 raft_consensus.cc:740] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.214514 24428 consensus_queue.cc:260] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.216410 24346 leader_election.cc:304] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:10.217857 24428 ts_tablet_manager.cc:1434] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:10.218321 24573 raft_consensus.cc:3060] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.221381 24379 raft_consensus.cc:2468] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:10.227221 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8336ccf163c04dfa94f4eb0109695563" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:10.228099 24498 raft_consensus.cc:493] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.231122 24429 tablet_bootstrap.cc:654] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.233016 24498 raft_consensus.cc:515] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.233270 24200 leader_election.cc:304] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
W20260709 13:21:10.232892 24346 leader_election.cc:343] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.241278 24547 raft_consensus.cc:2804] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.241734 24498 leader_election.cc:290] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:10.241844 24547 raft_consensus.cc:697] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:10.242937 24572 leader_election.cc:290] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:10.242832 24547 consensus_queue.cc:237] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.244148 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb065e24bd14e7f86badfbb68d51325" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:10.249723 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb065e24bd14e7f86badfbb68d51325" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:10.251652 24428 tablet_bootstrap.cc:492] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:10.250366 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8336ccf163c04dfa94f4eb0109695563" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
W20260709 13:21:10.258510 24274 leader_election.cc:343] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:10.262506 24272 leader_election.cc:343] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.262980 24272 leader_election.cc:304] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:10.264325 24498 raft_consensus.cc:2749] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:10.252148 24572 consensus_queue.cc:1048] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:21:10.274621 24428 tablet_bootstrap.cc:654] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.275020 24057 catalog_manager.cc:5697] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.266507 24306 raft_consensus.cc:2468] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:10.270282 24497 raft_consensus.cc:493] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:10.288327 24106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:10.295753 24431 tablet_bootstrap.cc:492] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:10.301505 24431 ts_tablet_manager.cc:1403] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.193s	user 0.016s	sys 0.011s
I20260709 13:21:10.291162 24497 raft_consensus.cc:515] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.304277 24497 leader_election.cc:290] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
W20260709 13:21:10.307938 24622 log.cc:927] Time spent T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:21:10.312007 24497 raft_consensus.cc:493] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.312477 24346 leader_election.cc:304] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:10.312584 24497 raft_consensus.cc:515] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.312983 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc3f1f066843e382fa402c8d4ec110" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:10.313558 24560 raft_consensus.cc:2804] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:10.313926 24560 raft_consensus.cc:493] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.314283 24560 raft_consensus.cc:3060] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:10.314662 24200 leader_election.cc:343] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.314760 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc3f1f066843e382fa402c8d4ec110" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:10.315605 24379 raft_consensus.cc:2468] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:10.316576 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96813b389fd14d7890c804a06966b952" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:10.314904 24497 leader_election.cc:290] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
W20260709 13:21:10.318050 24200 leader_election.cc:343] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.318292 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96813b389fd14d7890c804a06966b952" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:10.318778 24200 leader_election.cc:304] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:10.318352 24157 raft_consensus.cc:2468] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:10.328022 24430 tablet_bootstrap.cc:654] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.328521 24428 tablet_bootstrap.cc:492] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:10.329207 24428 ts_tablet_manager.cc:1403] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.006s
I20260709 13:21:10.333103 24428 raft_consensus.cc:359] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.333995 24428 raft_consensus.cc:385] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.334677 24428 raft_consensus.cc:740] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.321175 24497 raft_consensus.cc:2804] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:10.319233 24307 raft_consensus.cc:2468] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:10.336958 24428 consensus_queue.cc:260] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.343528 24560 raft_consensus.cc:515] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.345364 24551 raft_consensus.cc:493] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.365842 24560 leader_election.cc:290] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:10.341640 24497 raft_consensus.cc:493] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.365366 24431 raft_consensus.cc:359] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.351002 24054 catalog_manager.cc:5697] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.367933 24431 raft_consensus.cc:385] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.368433 24431 raft_consensus.cc:740] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.369117 24431 consensus_queue.cc:260] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.373790 24431 ts_tablet_manager.cc:1434] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:21:10.373709 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8336ccf163c04dfa94f4eb0109695563" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:10.374610 24306 raft_consensus.cc:3060] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.374354 24198 leader_election.cc:304] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:10.378484 24431 tablet_bootstrap.cc:492] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:10.368578 24497 raft_consensus.cc:3060] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.384498 24573 raft_consensus.cc:2749] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:10.379824 24547 raft_consensus.cc:2804] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:10.385169 24547 raft_consensus.cc:493] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.385522 24547 raft_consensus.cc:3060] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.386230 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8336ccf163c04dfa94f4eb0109695563" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:10.365306 24551 raft_consensus.cc:515] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
W20260709 13:21:10.395601 24346 leader_election.cc:343] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.400976 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4118ee5e16a4387ac189a181756ba0b" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:10.407153 24551 leader_election.cc:290] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:10.420281 24428 ts_tablet_manager.cc:1434] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.091s	user 0.001s	sys 0.009s
I20260709 13:21:10.431325 24428 tablet_bootstrap.cc:492] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:10.438078 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4118ee5e16a4387ac189a181756ba0b" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:10.447890 24272 leader_election.cc:343] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.450699 24430 tablet_bootstrap.cc:492] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
W20260709 13:21:10.451041 24274 leader_election.cc:343] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.451300 24430 ts_tablet_manager.cc:1403] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.258s	user 0.015s	sys 0.011s
I20260709 13:21:10.451570 24274 leader_election.cc:304] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:10.453809 24429 tablet_bootstrap.cc:492] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:10.454383 24429 ts_tablet_manager.cc:1403] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.319s	user 0.005s	sys 0.017s
I20260709 13:21:10.454716 24431 tablet_bootstrap.cc:654] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.455583 24609 raft_consensus.cc:2749] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:10.456283 24306 raft_consensus.cc:2468] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:10.457538 24429 raft_consensus.cc:359] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.458446 24429 raft_consensus.cc:385] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.458647 24429 raft_consensus.cc:740] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.463126 24429 consensus_queue.cc:260] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.471863 24429 ts_tablet_manager.cc:1434] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:21:10.472977 24429 tablet_bootstrap.cc:492] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:10.473961 24628 consensus_queue.cc:1048] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.475864 24346 leader_election.cc:304] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:10.476832 24573 raft_consensus.cc:2804] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.477417 24573 raft_consensus.cc:697] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:10.478354 24430 raft_consensus.cc:359] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.479393 24430 raft_consensus.cc:385] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.478868 24573 consensus_queue.cc:237] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.463843 24497 raft_consensus.cc:515] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.484404 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc3f1f066843e382fa402c8d4ec110" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:10.485046 24382 raft_consensus.cc:3060] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.485705 24429 tablet_bootstrap.cc:654] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.496503 24610 consensus_queue.cc:1048] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:10.479663 24430 raft_consensus.cc:740] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.499786 24430 consensus_queue.cc:260] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.501603 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc3f1f066843e382fa402c8d4ec110" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:10.502674 24430 ts_tablet_manager.cc:1434] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
W20260709 13:21:10.503199 24200 leader_election.cc:343] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.504022 24430 tablet_bootstrap.cc:492] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:10.503978 24497 leader_election.cc:290] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:10.499037 24428 tablet_bootstrap.cc:654] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.515305 24544 raft_consensus.cc:493] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.515746 24430 tablet_bootstrap.cc:654] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.516110 24544 raft_consensus.cc:515] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.505282 24382 raft_consensus.cc:2468] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:10.519376 24547 raft_consensus.cc:515] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.531347 24200 leader_election.cc:304] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:10.538866 24634 raft_consensus.cc:2804] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.539263 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96813b389fd14d7890c804a06966b952" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:10.539631 24634 raft_consensus.cc:697] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:10.544559 24431 tablet_bootstrap.cc:492] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:10.545117 24431 ts_tablet_manager.cc:1403] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.167s	user 0.032s	sys 0.018s
I20260709 13:21:10.545730 24567 raft_consensus.cc:493] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.546285 24567 raft_consensus.cc:515] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.547947 24431 raft_consensus.cc:359] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.548586 24567 leader_election.cc:290] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:10.536562 24544 leader_election.cc:290] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:10.549178 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96813b389fd14d7890c804a06966b952" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:10.548736 24431 raft_consensus.cc:385] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.550140 24307 raft_consensus.cc:2468] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 0.
I20260709 13:21:10.550588 24431 raft_consensus.cc:740] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.550913 24234 raft_consensus.cc:2393] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
I20260709 13:21:10.551373 24431 consensus_queue.cc:260] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.551573 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:10.552608 24382 raft_consensus.cc:2468] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 0.
I20260709 13:21:10.553669 24431 ts_tablet_manager.cc:1434] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:21:10.555202 24125 leader_election.cc:304] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:10.556725 24431 tablet_bootstrap.cc:492] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:10.540599 24634 consensus_queue.cc:237] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.559638 24123 leader_election.cc:304] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:10.561627 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96813b389fd14d7890c804a06966b952" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:10.562282 24157 raft_consensus.cc:3060] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.563469 24547 leader_election.cc:290] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:10.558470 24544 raft_consensus.cc:2804] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:10.567622 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:10.564838 24544 raft_consensus.cc:493] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.568377 24306 raft_consensus.cc:2468] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 0.
I20260709 13:21:10.568507 24544 raft_consensus.cc:3060] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.573272 24429 tablet_bootstrap.cc:492] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:10.573906 24429 ts_tablet_manager.cc:1403] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.013s
I20260709 13:21:10.576758 24429 raft_consensus.cc:359] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.577433 24429 raft_consensus.cc:385] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.577702 24429 raft_consensus.cc:740] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.582665 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96813b389fd14d7890c804a06966b952" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:10.585163 24306 raft_consensus.cc:3060] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:10.587414 24272 consensus_peers.cc:597] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:10.604704 24055 catalog_manager.cc:5697] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.605916 24544 raft_consensus.cc:515] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.613135 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:10.613803 24307 raft_consensus.cc:3060] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.621811 24429 consensus_queue.cc:260] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.628124 24431 tablet_bootstrap.cc:654] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.638765 24428 tablet_bootstrap.cc:492] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:10.639401 24428 ts_tablet_manager.cc:1403] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.218s	user 0.026s	sys 0.004s
I20260709 13:21:10.648527 24307 raft_consensus.cc:2468] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 1.
I20260709 13:21:10.650133 24428 raft_consensus.cc:359] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.650434 24123 leader_election.cc:304] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:10.654605 24428 raft_consensus.cc:385] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.654974 24428 raft_consensus.cc:740] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.655675 24428 consensus_queue.cc:260] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.657958 24429 ts_tablet_manager.cc:1434] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 13:21:10.659260 24429 tablet_bootstrap.cc:492] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:10.660133 24564 raft_consensus.cc:2804] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.661028 24428 ts_tablet_manager.cc:1434] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:21:10.662243 24428 tablet_bootstrap.cc:492] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:10.660061 24055 catalog_manager.cc:5697] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.676951 24428 tablet_bootstrap.cc:654] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.679154 24306 raft_consensus.cc:2468] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:10.682111 24564 raft_consensus.cc:697] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 1 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:10.684655 24564 consensus_queue.cc:237] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.681064 24544 leader_election.cc:290] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:10.683627 24198 leader_election.cc:304] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:10.689574 24634 raft_consensus.cc:2804] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.690089 24634 raft_consensus.cc:697] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:10.691030 24430 tablet_bootstrap.cc:492] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:10.691567 24430 ts_tablet_manager.cc:1403] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.188s	user 0.021s	sys 0.010s
I20260709 13:21:10.693037 24428 tablet_bootstrap.cc:492] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:10.693547 24428 ts_tablet_manager.cc:1403] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:21:10.691045 24634 consensus_queue.cc:237] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.696117 24430 raft_consensus.cc:359] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.696691 24430 raft_consensus.cc:385] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.697046 24430 raft_consensus.cc:740] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.697609 24430 consensus_queue.cc:260] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.706749 24428 raft_consensus.cc:359] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.707603 24428 raft_consensus.cc:385] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.708524 24430 ts_tablet_manager.cc:1434] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:21:10.709558 24430 tablet_bootstrap.cc:492] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:10.707809 24058 catalog_manager.cc:5697] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:10.709837 24274 consensus_peers.cc:597] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:10.707707 24544 consensus_queue.cc:1048] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:21:10.707940 24428 raft_consensus.cc:740] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.715004 24431 tablet_bootstrap.cc:492] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:10.715528 24431 ts_tablet_manager.cc:1403] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.159s	user 0.020s	sys 0.003s
I20260709 13:21:10.715687 24428 consensus_queue.cc:260] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.718117 24428 ts_tablet_manager.cc:1434] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:21:10.715015 24157 raft_consensus.cc:2468] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:10.713001 24429 tablet_bootstrap.cc:654] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.719834 24497 raft_consensus.cc:493] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.720314 24497 raft_consensus.cc:515] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.721571 24431 raft_consensus.cc:359] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.722144 24567 raft_consensus.cc:2764] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:21:10.722309 24431 raft_consensus.cc:385] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.722476 24497 leader_election.cc:290] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:10.722890 24428 tablet_bootstrap.cc:492] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:10.725548 24430 tablet_bootstrap.cc:654] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.725883 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4118ee5e16a4387ac189a181756ba0b" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:10.726593 24307 raft_consensus.cc:2468] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:10.728760 24198 leader_election.cc:304] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:10.729583 24497 raft_consensus.cc:2804] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:10.729949 24497 raft_consensus.cc:493] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.730331 24497 raft_consensus.cc:3060] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.732936 24498 raft_consensus.cc:493] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.733743 24428 tablet_bootstrap.cc:654] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.733515 24498 raft_consensus.cc:515] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.737015 24498 leader_election.cc:290] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:10.738283 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:10.738361 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64b5ba5e5d84dd78ae3c83e7c375709" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:10.739778 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64b5ba5e5d84dd78ae3c83e7c375709" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:10.740115 24430 tablet_bootstrap.cc:492] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:10.740676 24430 ts_tablet_manager.cc:1403] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.000s
W20260709 13:21:10.741015 24272 leader_election.cc:343] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:10.742396 24274 leader_election.cc:343] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.742712 24379 raft_consensus.cc:3060] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.744973 24274 leader_election.cc:304] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:10.747364 24428 tablet_bootstrap.cc:492] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:10.747915 24428 ts_tablet_manager.cc:1403] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.003s
I20260709 13:21:10.748271 24430 raft_consensus.cc:359] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.749123 24430 raft_consensus.cc:385] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.749346 24567 consensus_queue.cc:1048] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.735360 24431 raft_consensus.cc:740] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.751024 24547 consensus_queue.cc:1048] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.751540 24610 raft_consensus.cc:2749] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:10.754210 24054 catalog_manager.cc:5697] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.750867 24431 consensus_queue.cc:260] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.749501 24430 raft_consensus.cc:740] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.765465 24428 raft_consensus.cc:359] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.767516 24428 raft_consensus.cc:385] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.768170 24498 consensus_queue.cc:1048] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.767817 24428 raft_consensus.cc:740] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.773036 24430 consensus_queue.cc:260] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.771757 24428 consensus_queue.cc:260] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.780318 24430 ts_tablet_manager.cc:1434] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.004s
I20260709 13:21:10.783116 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4118ee5e16a4387ac189a181756ba0b" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:10.783597 24628 raft_consensus.cc:493] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.784090 24628 raft_consensus.cc:515] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
W20260709 13:21:10.784605 24200 leader_election.cc:343] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.786326 24628 leader_election.cc:290] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:10.781172 24567 raft_consensus.cc:493] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.788445 24431 ts_tablet_manager.cc:1434] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:21:10.788486 24428 ts_tablet_manager.cc:1434] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:21:10.790470 24431 tablet_bootstrap.cc:492] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:10.793650 24428 tablet_bootstrap.cc:492] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:10.792594 24567 raft_consensus.cc:515] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.793011 24498 raft_consensus.cc:493] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.794009 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95192d3963414bdfac891aba6df47f7c" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:10.795945 24567 leader_election.cc:290] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
W20260709 13:21:10.796975 24346 leader_election.cc:343] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.794833 24498 raft_consensus.cc:515] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.798357 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc3f1f066843e382fa402c8d4ec110" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:10.799154 24383 raft_consensus.cc:2393] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
I20260709 13:21:10.812569 24430 tablet_bootstrap.cc:492] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:10.815102 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95192d3963414bdfac891aba6df47f7c" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:10.815449 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc3f1f066843e382fa402c8d4ec110" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:10.813953 24498 leader_election.cc:290] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:10.828954 24610 raft_consensus.cc:493] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.829540 24610 raft_consensus.cc:515] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.832957 24123 leader_election.cc:304] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
W20260709 13:21:10.836488 24348 leader_election.cc:343] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.837061 24348 leader_election.cc:304] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:10.837862 24628 raft_consensus.cc:2749] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:10.839082 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208eaee0f548318b6d3fd6edb3e12f" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:10.839200 24380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208eaee0f548318b6d3fd6edb3e12f" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:10.841712 24544 raft_consensus.cc:3060] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:10.845794 24274 leader_election.cc:343] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.849526 24544 raft_consensus.cc:2749] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:10.850274 24428 tablet_bootstrap.cc:654] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.851222 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13a5255f4d444b984355f509d3a7918" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:10.852923 24430 tablet_bootstrap.cc:654] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.834815 24497 raft_consensus.cc:515] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.855314 24610 leader_election.cc:290] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:10.856894 24057 catalog_manager.cc:5697] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.858337 24497 leader_election.cc:290] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:10.859331 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4118ee5e16a4387ac189a181756ba0b" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:10.859956 24306 raft_consensus.cc:3060] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.860668 24431 tablet_bootstrap.cc:654] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:10.866084 24274 leader_election.cc:343] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.866614 24274 leader_election.cc:304] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:10.867430 24306 raft_consensus.cc:2468] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:10.868958 24610 raft_consensus.cc:2749] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:10.869189 24379 raft_consensus.cc:2468] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 1.
I20260709 13:21:10.870102 24198 leader_election.cc:304] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:10.871203 24634 raft_consensus.cc:2804] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.888375 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13a5255f4d444b984355f509d3a7918" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:10.888604 24573 raft_consensus.cc:493] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.894732 24634 raft_consensus.cc:697] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:10.895970 24573 raft_consensus.cc:515] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.898185 24573 leader_election.cc:290] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:10.900149 24429 tablet_bootstrap.cc:492] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:10.900660 24429 ts_tablet_manager.cc:1403] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.242s	user 0.012s	sys 0.020s
W20260709 13:21:10.893172 24274 leader_election.cc:343] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.894814 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4118ee5e16a4387ac189a181756ba0b" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:10.903563 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1022101d02354929a4335f20304fdcb0" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:10.904845 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1022101d02354929a4335f20304fdcb0" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:10.906625 24233 raft_consensus.cc:2468] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
W20260709 13:21:10.907306 24348 leader_election.cc:343] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.908232 24346 leader_election.cc:304] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:10.909663 24573 raft_consensus.cc:2804] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:10.910081 24573 raft_consensus.cc:493] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.910444 24573 raft_consensus.cc:3060] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.910246 24058 catalog_manager.cc:5697] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:10.912485 24200 leader_election.cc:343] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.914425 24497 consensus_queue.cc:1048] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.896751 24634 consensus_queue.cc:237] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:10.930156 24233 raft_consensus.cc:3060] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.935174 24428 tablet_bootstrap.cc:492] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:10.935763 24428 ts_tablet_manager.cc:1403] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.146s	user 0.006s	sys 0.013s
I20260709 13:21:10.938184 24573 raft_consensus.cc:515] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
W20260709 13:21:10.939082 24274 leader_election.cc:343] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.939592 24274 leader_election.cc:304] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:10.940773 24573 leader_election.cc:290] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:10.941931 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1022101d02354929a4335f20304fdcb0" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:10.942641 24235 raft_consensus.cc:3060] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.942914 24428 raft_consensus.cc:359] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.943382 24428 raft_consensus.cc:385] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.943552 24428 raft_consensus.cc:740] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.944103 24428 consensus_queue.cc:260] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:10.945412 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1022101d02354929a4335f20304fdcb0" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:10.946797 24610 raft_consensus.cc:2749] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:10.947218 24431 tablet_bootstrap.cc:492] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:10.947882 24431 ts_tablet_manager.cc:1403] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.158s	user 0.013s	sys 0.009s
W20260709 13:21:10.949703 24348 leader_election.cc:343] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.954191 24431 raft_consensus.cc:359] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.954924 24431 raft_consensus.cc:385] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.955204 24431 raft_consensus.cc:740] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.955785 24235 raft_consensus.cc:2468] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:10.956163 24430 tablet_bootstrap.cc:492] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:10.956670 24430 ts_tablet_manager.cc:1403] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.000s
I20260709 13:21:10.957118 24346 leader_election.cc:304] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:10.955837 24431 consensus_queue.cc:260] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.959695 24429 raft_consensus.cc:359] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.962549 24560 consensus_queue.cc:1048] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.964022 24431 ts_tablet_manager.cc:1434] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 13:21:10.964327 24428 ts_tablet_manager.cc:1434] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.028s	user 0.000s	sys 0.007s
I20260709 13:21:10.963562 24429 raft_consensus.cc:385] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.965039 24431 tablet_bootstrap.cc:492] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:10.965044 24429 raft_consensus.cc:740] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.965425 24428 tablet_bootstrap.cc:492] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:10.960402 24573 raft_consensus.cc:2804] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.969152 24430 raft_consensus.cc:359] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.969835 24430 raft_consensus.cc:385] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.970261 24430 raft_consensus.cc:740] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.973291 24573 raft_consensus.cc:697] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:10.974615 24573 consensus_queue.cc:237] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.979929 24429 consensus_queue.cc:260] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:10.986814 24428 tablet_bootstrap.cc:654] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.987242 24431 tablet_bootstrap.cc:654] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.988508 24430 consensus_queue.cc:260] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:10.992933 24547 consensus_queue.cc:1048] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:11.008507 24429 ts_tablet_manager.cc:1434] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.108s	user 0.003s	sys 0.006s
I20260709 13:21:11.009685 24429 tablet_bootstrap.cc:492] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:11.011507 24430 ts_tablet_manager.cc:1434] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:21:11.013167 24430 tablet_bootstrap.cc:492] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:11.034157 24430 tablet_bootstrap.cc:654] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.042105 24431 tablet_bootstrap.cc:492] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:11.042632 24431 ts_tablet_manager.cc:1403] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.005s
I20260709 13:21:11.047084 24573 raft_consensus.cc:493] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.048040 24429 tablet_bootstrap.cc:654] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.047649 24573 raft_consensus.cc:515] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.050015 24428 tablet_bootstrap.cc:492] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:11.050341 24537 consensus_queue.cc:1048] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:11.066179 24573 leader_election.cc:290] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:11.055075 24431 raft_consensus.cc:359] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.066915 24431 raft_consensus.cc:385] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.067257 24431 raft_consensus.cc:740] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.067761 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13a5255f4d444b984355f509d3a7918" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:11.067941 24431 consensus_queue.cc:260] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.068912 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13a5255f4d444b984355f509d3a7918" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
W20260709 13:21:11.069239 24348 leader_election.cc:343] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.069765 24307 raft_consensus.cc:2468] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:11.058495 24055 catalog_manager.cc:5697] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.070662 24431 ts_tablet_manager.cc:1434] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:21:11.071617 24431 tablet_bootstrap.cc:492] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:11.071568 24346 leader_election.cc:304] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:11.060097 24628 consensus_queue.cc:1048] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:11.073293 24573 raft_consensus.cc:2804] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:11.073781 24573 raft_consensus.cc:493] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.074214 24573 raft_consensus.cc:3060] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.075500 24428 ts_tablet_manager.cc:1403] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.000s
I20260709 13:21:11.062394 24430 tablet_bootstrap.cc:492] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:11.078789 24430 ts_tablet_manager.cc:1403] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.004s
I20260709 13:21:11.081354 24428 raft_consensus.cc:359] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.082214 24428 raft_consensus.cc:385] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.082553 24428 raft_consensus.cc:740] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.082393 24430 raft_consensus.cc:359] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.083137 24430 raft_consensus.cc:385] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.083420 24430 raft_consensus.cc:740] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.083455 24428 consensus_queue.cc:260] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.084309 24430 consensus_queue.cc:260] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.087029 24430 ts_tablet_manager.cc:1434] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:11.088400 24430 tablet_bootstrap.cc:492] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:11.090000 24158 raft_consensus.cc:3060] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.096019 24609 raft_consensus.cc:493] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.096694 24609 raft_consensus.cc:515] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.099726 24430 tablet_bootstrap.cc:654] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.099910 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619d34e00ecc47839c94d82bacd2add7" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:11.100924 24609 leader_election.cc:290] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:11.095232 24056 catalog_manager.cc:5697] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.102818 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619d34e00ecc47839c94d82bacd2add7" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:11.103554 24233 raft_consensus.cc:2468] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 0.
I20260709 13:21:11.105185 24272 leader_election.cc:304] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
W20260709 13:21:11.106138 24274 leader_election.cc:343] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.107169 24609 raft_consensus.cc:2804] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:11.107511 24429 tablet_bootstrap.cc:492] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:11.107745 24609 raft_consensus.cc:493] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.108110 24429 ts_tablet_manager.cc:1403] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.004s
I20260709 13:21:11.108299 24609 raft_consensus.cc:3060] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.111598 24573 raft_consensus.cc:515] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.112610 24428 ts_tablet_manager.cc:1434] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.003s
I20260709 13:21:11.113894 24428 tablet_bootstrap.cc:492] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:11.117121 24429 raft_consensus.cc:359] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.117892 24429 raft_consensus.cc:385] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.118201 24429 raft_consensus.cc:740] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.120565 24431 tablet_bootstrap.cc:654] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.124147 24544 consensus_queue.cc:1048] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:11.125491 24609 raft_consensus.cc:515] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.127024 24429 consensus_queue.cc:260] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.131474 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619d34e00ecc47839c94d82bacd2add7" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:11.132125 24233 raft_consensus.cc:3060] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.132397 24428 tablet_bootstrap.cc:654] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.132409 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619d34e00ecc47839c94d82bacd2add7" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
W20260709 13:21:11.135622 24274 leader_election.cc:343] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.135689 24429 ts_tablet_manager.cc:1434] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:21:11.138151 24429 tablet_bootstrap.cc:492] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:11.144115 24233 raft_consensus.cc:2468] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 1.
I20260709 13:21:11.145496 24272 leader_election.cc:304] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:11.146087 24573 leader_election.cc:290] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:11.146531 24498 raft_consensus.cc:2804] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:11.147099 24498 raft_consensus.cc:697] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:11.147420 24544 raft_consensus.cc:493] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.147889 24544 raft_consensus.cc:515] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.147979 24498 consensus_queue.cc:237] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.150417 24544 leader_election.cc:290] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:11.146387 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13a5255f4d444b984355f509d3a7918" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:11.151031 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13a5255f4d444b984355f509d3a7918" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:11.151690 24307 raft_consensus.cc:3060] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.152251 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1022101d02354929a4335f20304fdcb0" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:11.153105 24235 raft_consensus.cc:2393] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:11.154662 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1022101d02354929a4335f20304fdcb0" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:11.156986 24125 leader_election.cc:304] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:11.160605 24544 raft_consensus.cc:3060] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.160696 24609 leader_election.cc:290] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
W20260709 13:21:11.161875 24348 leader_election.cc:343] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.164714 24307 raft_consensus.cc:2468] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:11.174554 24346 leader_election.cc:304] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:11.175915 24573 raft_consensus.cc:2804] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:11.176628 24573 raft_consensus.cc:697] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:11.177428 24573 consensus_queue.cc:237] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.193063 24430 tablet_bootstrap.cc:492] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:11.193636 24430 ts_tablet_manager.cc:1403] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.004s
I20260709 13:21:11.196449 24430 raft_consensus.cc:359] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.197675 24430 raft_consensus.cc:385] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.197958 24430 raft_consensus.cc:740] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.185493 24544 raft_consensus.cc:2749] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:11.198788 24430 consensus_queue.cc:260] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.200407 24430 ts_tablet_manager.cc:1434] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:11.201411 24430 tablet_bootstrap.cc:492] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:11.210728 24564 consensus_queue.cc:1048] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:11.212693 24430 tablet_bootstrap.cc:654] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.214869 24539 consensus_queue.cc:1048] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:11.224938 24429 tablet_bootstrap.cc:654] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.247511 24431 tablet_bootstrap.cc:492] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:11.248075 24431 ts_tablet_manager.cc:1403] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.177s	user 0.010s	sys 0.008s
I20260709 13:21:11.257828 24430 tablet_bootstrap.cc:492] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:11.258363 24430 ts_tablet_manager.cc:1403] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.025s
I20260709 13:21:11.257377 24058 catalog_manager.cc:5697] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:11.274951 24431 raft_consensus.cc:359] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.275743 24431 raft_consensus.cc:385] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.276033 24431 raft_consensus.cc:740] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.278731 24497 raft_consensus.cc:493] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.279217 24539 consensus_queue.cc:1048] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:11.279460 24497 raft_consensus.cc:515] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.282339 24431 consensus_queue.cc:260] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.284516 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95192d3963414bdfac891aba6df47f7c" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:11.285292 24381 raft_consensus.cc:2468] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:11.285439 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95192d3963414bdfac891aba6df47f7c" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:11.286547 24200 leader_election.cc:304] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:11.286720 24497 leader_election.cc:290] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:11.287364 24497 raft_consensus.cc:2804] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:11.287542 24200 leader_election.cc:343] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.287837 24497 raft_consensus.cc:493] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.288331 24497 raft_consensus.cc:3060] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.288523 24428 tablet_bootstrap.cc:492] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:11.289011 24428 ts_tablet_manager.cc:1403] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.175s	user 0.023s	sys 0.017s
I20260709 13:21:11.284583 24431 ts_tablet_manager.cc:1434] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:21:11.291009 24431 tablet_bootstrap.cc:492] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:11.302980 24498 raft_consensus.cc:493] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.303645 24498 raft_consensus.cc:515] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.307943 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4206794ab99d4bc2b0573743d29d74ca" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:11.309837 24272 leader_election.cc:343] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.310256 24498 leader_election.cc:290] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:11.309741 24497 raft_consensus.cc:515] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.312698 24497 leader_election.cc:290] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:11.313628 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95192d3963414bdfac891aba6df47f7c" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:11.314446 24379 raft_consensus.cc:3060] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.317276 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4206794ab99d4bc2b0573743d29d74ca" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
W20260709 13:21:11.319181 24274 leader_election.cc:343] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.319653 24274 leader_election.cc:304] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:11.324860 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95192d3963414bdfac891aba6df47f7c" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
W20260709 13:21:11.327184 24200 leader_election.cc:343] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.329586 24379 raft_consensus.cc:2468] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:11.326081 24498 raft_consensus.cc:2749] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:11.330212 24106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:11.331881 24200 leader_election.cc:304] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:11.321359 24430 raft_consensus.cc:359] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.332890 24497 raft_consensus.cc:2804] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:11.316028 24057 catalog_manager.cc:5697] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.333472 24497 raft_consensus.cc:697] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:11.334462 24497 consensus_queue.cc:237] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.335695 24429 tablet_bootstrap.cc:492] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:11.336493 24429 ts_tablet_manager.cc:1403] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.199s	user 0.011s	sys 0.003s
I20260709 13:21:11.339452 24430 raft_consensus.cc:385] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.339831 24430 raft_consensus.cc:740] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.340873 24429 raft_consensus.cc:359] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.341651 24429 raft_consensus.cc:385] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.341951 24429 raft_consensus.cc:740] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.342798 24430 consensus_queue.cc:260] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.347174 24431 tablet_bootstrap.cc:654] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.331609 24428 raft_consensus.cc:359] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.347821 24428 raft_consensus.cc:385] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.348151 24428 raft_consensus.cc:740] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.350209 24429 consensus_queue.cc:260] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.352592 24429 ts_tablet_manager.cc:1434] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:21:11.353113 24428 consensus_queue.cc:260] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.355242 24428 ts_tablet_manager.cc:1434] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:21:11.356712 24430 ts_tablet_manager.cc:1434] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.004s
I20260709 13:21:11.357769 24430 tablet_bootstrap.cc:492] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:11.358716 24429 tablet_bootstrap.cc:492] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:11.360080 24537 raft_consensus.cc:493] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.360653 24537 raft_consensus.cc:515] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.363874 24428 tablet_bootstrap.cc:492] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:11.366088 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64b5ba5e5d84dd78ae3c83e7c375709" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:11.366801 24379 raft_consensus.cc:2468] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:11.367334 24537 leader_election.cc:290] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:11.367518 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64b5ba5e5d84dd78ae3c83e7c375709" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:11.374351 24306 raft_consensus.cc:2468] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:11.367906 24200 leader_election.cc:304] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:11.371696 24057 catalog_manager.cc:5697] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:11.376026 24428 tablet_bootstrap.cc:654] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.376822 24537 raft_consensus.cc:2804] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:11.373009 24430 tablet_bootstrap.cc:654] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.380023 24431 tablet_bootstrap.cc:492] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:11.380527 24431 ts_tablet_manager.cc:1403] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.004s
I20260709 13:21:11.373202 24429 tablet_bootstrap.cc:654] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.377278 24537 raft_consensus.cc:493] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.381194 24537 raft_consensus.cc:3060] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.383153 24431 raft_consensus.cc:359] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.394158 24431 raft_consensus.cc:385] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.394516 24431 raft_consensus.cc:740] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.396974 24537 raft_consensus.cc:515] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.397636 24430 tablet_bootstrap.cc:492] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:11.398289 24430 ts_tablet_manager.cc:1403] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.008s
I20260709 13:21:11.398811 24428 tablet_bootstrap.cc:492] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:11.399353 24428 ts_tablet_manager.cc:1403] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:21:11.400367 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64b5ba5e5d84dd78ae3c83e7c375709" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:11.400985 24307 raft_consensus.cc:3060] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.401252 24430 raft_consensus.cc:359] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.395246 24431 consensus_queue.cc:260] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.402120 24430 raft_consensus.cc:385] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.402879 24430 raft_consensus.cc:740] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.403632 24430 consensus_queue.cc:260] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.404357 24429 tablet_bootstrap.cc:492] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:11.404899 24429 ts_tablet_manager.cc:1403] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.001s
I20260709 13:21:11.406213 24430 ts_tablet_manager.cc:1434] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:11.407262 24430 tablet_bootstrap.cc:492] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:11.408097 24429 raft_consensus.cc:359] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.409756 24429 raft_consensus.cc:385] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.402119 24428 raft_consensus.cc:359] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.410964 24431 ts_tablet_manager.cc:1434] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:21:11.411044 24428 raft_consensus.cc:385] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.411705 24428 raft_consensus.cc:740] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.412144 24431 tablet_bootstrap.cc:492] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:11.412401 24428 consensus_queue.cc:260] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.414283 24430 tablet_bootstrap.cc:654] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.414564 24428 ts_tablet_manager.cc:1434] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:21:11.415565 24428 tablet_bootstrap.cc:492] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:11.410181 24429 raft_consensus.cc:740] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.418790 24429 consensus_queue.cc:260] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.421674 24429 ts_tablet_manager.cc:1434] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.006s
I20260709 13:21:11.423774 24429 tablet_bootstrap.cc:492] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:11.425529 24307 raft_consensus.cc:2468] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:11.430120 24198 leader_election.cc:304] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:11.431216 24497 raft_consensus.cc:2804] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:11.431705 24497 raft_consensus.cc:697] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:11.432313 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64b5ba5e5d84dd78ae3c83e7c375709" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:11.433027 24379 raft_consensus.cc:3060] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.432538 24497 consensus_queue.cc:237] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.433957 24428 tablet_bootstrap.cc:654] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.428782 24537 leader_election.cc:290] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:11.436898 24429 tablet_bootstrap.cc:654] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.442641 24610 raft_consensus.cc:493] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.443181 24610 raft_consensus.cc:515] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
W20260709 13:21:11.444444 24200 consensus_peers.cc:597] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:11.445274 24610 leader_election.cc:290] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:11.446507 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:11.448150 24272 leader_election.cc:343] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.448988 24431 tablet_bootstrap.cc:654] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.470690 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:11.475719 24058 catalog_manager.cc:5697] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.477818 24573 consensus_queue.cc:1048] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:11.482211 24537 consensus_queue.cc:1048] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:11.483192 24430 tablet_bootstrap.cc:492] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:11.483690 24430 ts_tablet_manager.cc:1403] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.003s
I20260709 13:21:11.484405 24379 raft_consensus.cc:2468] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
W20260709 13:21:11.484598 24274 leader_election.cc:343] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.485244 24274 leader_election.cc:304] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:11.486598 24610 raft_consensus.cc:2749] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:11.487413 24429 tablet_bootstrap.cc:492] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:11.487910 24429 ts_tablet_manager.cc:1403] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.011s
I20260709 13:21:11.492693 24429 raft_consensus.cc:359] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.493289 24429 raft_consensus.cc:385] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.493521 24429 raft_consensus.cc:740] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.494002 24429 consensus_queue.cc:260] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.496009 24431 tablet_bootstrap.cc:492] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:11.499233 24431 ts_tablet_manager.cc:1403] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.010s
I20260709 13:21:11.496421 24429 ts_tablet_manager.cc:1434] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:21:11.502336 24429 tablet_bootstrap.cc:492] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:11.504276 24430 raft_consensus.cc:359] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.505033 24430 raft_consensus.cc:385] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.505307 24430 raft_consensus.cc:740] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.505954 24430 consensus_queue.cc:260] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.508041 24430 ts_tablet_manager.cc:1434] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:21:11.512035 24430 tablet_bootstrap.cc:492] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:11.513186 24429 tablet_bootstrap.cc:654] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.523439 24428 tablet_bootstrap.cc:492] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:11.524329 24428 ts_tablet_manager.cc:1403] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.109s	user 0.018s	sys 0.003s
I20260709 13:21:11.529120 24430 tablet_bootstrap.cc:654] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.542322 24572 raft_consensus.cc:493] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.544036 24431 raft_consensus.cc:359] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.544638 24431 raft_consensus.cc:385] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.544875 24431 raft_consensus.cc:740] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.543128 24572 raft_consensus.cc:515] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.547744 24431 consensus_queue.cc:260] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.551149 24572 leader_election.cc:290] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:11.552973 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3863e0f41bbc4ace93654a83e2578032" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:11.556092 24431 ts_tablet_manager.cc:1434] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 13:21:11.556944 24431 tablet_bootstrap.cc:492] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:11.558311 24233 raft_consensus.cc:2468] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:11.565133 24346 leader_election.cc:304] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:11.566234 24572 raft_consensus.cc:2804] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:11.566723 24572 raft_consensus.cc:493] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.567145 24572 raft_consensus.cc:3060] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.567303 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3863e0f41bbc4ace93654a83e2578032" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:11.567876 24430 tablet_bootstrap.cc:492] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:11.568406 24430 ts_tablet_manager.cc:1403] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.017s
I20260709 13:21:11.562937 24537 raft_consensus.cc:493] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.569687 24537 raft_consensus.cc:515] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.572131 24430 raft_consensus.cc:359] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.572945 24430 raft_consensus.cc:385] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.573266 24430 raft_consensus.cc:740] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.573921 24430 consensus_queue.cc:260] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.576284 24498 raft_consensus.cc:493] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.576843 24498 raft_consensus.cc:515] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.579092 24498 leader_election.cc:290] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:11.579875 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb065e24bd14e7f86badfbb68d51325" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:11.580619 24306 raft_consensus.cc:2468] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
W20260709 13:21:11.582182 24348 leader_election.cc:343] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.587779 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bbda74ba444fd2bd1ad847ca18463d" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:11.587779 24198 leader_election.cc:304] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:11.589483 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb065e24bd14e7f86badfbb68d51325" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:11.590145 24539 raft_consensus.cc:2804] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:11.590312 24159 raft_consensus.cc:2468] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:11.590626 24539 raft_consensus.cc:493] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.591054 24539 raft_consensus.cc:3060] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.572187 24537 leader_election.cc:290] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:11.593772 24428 raft_consensus.cc:359] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.594592 24428 raft_consensus.cc:385] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.594902 24428 raft_consensus.cc:740] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.595623 24428 consensus_queue.cc:260] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
W20260709 13:21:11.596580 24274 leader_election.cc:343] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:11.597543 24274 consensus_peers.cc:597] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:11.598958 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bbda74ba444fd2bd1ad847ca18463d" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:11.600689 24572 raft_consensus.cc:515] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
W20260709 13:21:11.603271 24272 leader_election.cc:343] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.603830 24272 leader_election.cc:304] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:11.606516 24430 ts_tablet_manager.cc:1434] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:21:11.607669 24430 tablet_bootstrap.cc:492] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:11.611186 24498 raft_consensus.cc:2749] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:11.613687 24428 ts_tablet_manager.cc:1434] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.001s
I20260709 13:21:11.614717 24428 tablet_bootstrap.cc:492] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:11.619393 24628 consensus_queue.cc:1048] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:11.623401 24430 tablet_bootstrap.cc:654] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.630589 24428 tablet_bootstrap.cc:654] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.634567 24431 tablet_bootstrap.cc:654] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.638761 24429 tablet_bootstrap.cc:492] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:11.639392 24429 ts_tablet_manager.cc:1403] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.137s	user 0.016s	sys 0.005s
I20260709 13:21:11.639343 24539 raft_consensus.cc:515] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.642401 24572 leader_election.cc:290] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:11.655711 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3863e0f41bbc4ace93654a83e2578032" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:11.656669 24233 raft_consensus.cc:3060] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:11.711714 24348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:39703, user_credentials={real_user=slave}} blocked reactor thread for 128442us
I20260709 13:21:11.672922 24564 raft_consensus.cc:493] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.725811 24564 raft_consensus.cc:515] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.726980 24572 raft_consensus.cc:493] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.727707 24572 raft_consensus.cc:515] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.729719 24572 leader_election.cc:290] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
W20260709 13:21:11.731034 24695 log.cc:927] Time spent T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3: Append to log took a long time: real 0.073s	user 0.003s	sys 0.008s
I20260709 13:21:11.731555 24430 tablet_bootstrap.cc:492] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:11.732040 24430 ts_tablet_manager.cc:1403] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.125s	user 0.011s	sys 0.000s
I20260709 13:21:11.735057 24431 tablet_bootstrap.cc:492] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:11.736338 24573 raft_consensus.cc:493] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.737012 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3863e0f41bbc4ace93654a83e2578032" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:11.736960 24573 raft_consensus.cc:515] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.742409 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95192d3963414bdfac891aba6df47f7c" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:11.742754 24564 leader_election.cc:290] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:11.743382 24381 raft_consensus.cc:2393] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
W20260709 13:21:11.744438 24348 leader_election.cc:343] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.746065 24431 ts_tablet_manager.cc:1403] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.179s	user 0.020s	sys 0.004s
I20260709 13:21:11.746686 24539 leader_election.cc:290] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:11.746726 24573 leader_election.cc:290] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:11.755105 24428 tablet_bootstrap.cc:492] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:11.755658 24428 ts_tablet_manager.cc:1403] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.141s	user 0.018s	sys 0.013s
I20260709 13:21:11.761277 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb065e24bd14e7f86badfbb68d51325" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:11.762185 24157 raft_consensus.cc:3060] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.764988 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4206794ab99d4bc2b0573743d29d74ca" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:11.765267 24430 raft_consensus.cc:359] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.765065 24431 raft_consensus.cc:359] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.765949 24234 raft_consensus.cc:2468] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:11.767766 24431 raft_consensus.cc:385] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.768055 24431 raft_consensus.cc:740] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.768360 24564 raft_consensus.cc:493] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.768828 24431 consensus_queue.cc:260] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.768903 24564 raft_consensus.cc:515] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.770568 24431 ts_tablet_manager.cc:1434] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:21:11.771724 24431 tablet_bootstrap.cc:492] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:11.767444 24430 raft_consensus.cc:385] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.772894 24430 raft_consensus.cc:740] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.773243 24346 leader_election.cc:304] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:11.773380 24233 raft_consensus.cc:2468] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:11.773742 24430 consensus_queue.cc:260] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.774372 24572 raft_consensus.cc:2804] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:11.774780 24572 raft_consensus.cc:493] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.775126 24572 raft_consensus.cc:3060] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.766808 24429 raft_consensus.cc:359] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.776845 24429 raft_consensus.cc:385] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.777148 24429 raft_consensus.cc:740] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.777400 24430 ts_tablet_manager.cc:1434] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:21:11.777846 24429 consensus_queue.cc:260] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.779528 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4118ee5e16a4387ac189a181756ba0b" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:11.780740 24429 ts_tablet_manager.cc:1434] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.141s	user 0.005s	sys 0.005s
I20260709 13:21:11.781385 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95192d3963414bdfac891aba6df47f7c" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:11.783093 24429 tablet_bootstrap.cc:492] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:11.785063 24572 raft_consensus.cc:515] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.786638 24346 leader_election.cc:304] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:11.788609 24564 leader_election.cc:290] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:11.789274 24157 raft_consensus.cc:2468] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:11.789515 24429 tablet_bootstrap.cc:654] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.791332 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208eaee0f548318b6d3fd6edb3e12f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:11.792877 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4206794ab99d4bc2b0573743d29d74ca" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:11.793500 24233 raft_consensus.cc:3060] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.793540 24572 leader_election.cc:290] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:11.793658 24498 raft_consensus.cc:493] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.794337 24498 raft_consensus.cc:515] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.795521 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4118ee5e16a4387ac189a181756ba0b" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:11.796283 24498 leader_election.cc:290] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:11.799785 24428 raft_consensus.cc:359] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.800505 24428 raft_consensus.cc:385] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.800763 24428 raft_consensus.cc:740] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.801352 24428 consensus_queue.cc:260] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.801944 24572 raft_consensus.cc:2804] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:11.803210 24572 raft_consensus.cc:697] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:11.803833 24428 ts_tablet_manager.cc:1434] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:21:11.804025 24572 consensus_queue.cc:237] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:11.804798 24428 tablet_bootstrap.cc:492] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:11.806317 24430 tablet_bootstrap.cc:492] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:11.807495 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4206794ab99d4bc2b0573743d29d74ca" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:11.808228 24306 raft_consensus.cc:2468] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:11.808708 24233 raft_consensus.cc:2468] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:11.810007 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208eaee0f548318b6d3fd6edb3e12f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:11.810724 24306 raft_consensus.cc:2468] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:11.810901 24346 leader_election.cc:304] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:11.811892 24498 raft_consensus.cc:493] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.812407 24498 raft_consensus.cc:515] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.815613 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4206794ab99d4bc2b0573743d29d74ca" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:11.816171 24697 raft_consensus.cc:2804] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:11.816646 24306 raft_consensus.cc:3060] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.818265 24697 raft_consensus.cc:697] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:11.819475 24697 consensus_queue.cc:237] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:11.825460 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb065e24bd14e7f86badfbb68d51325" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:11.826284 24307 raft_consensus.cc:3060] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.846513 24498 leader_election.cc:290] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:11.849817 24429 tablet_bootstrap.cc:492] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:11.850733 24429 ts_tablet_manager.cc:1403] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.008s
I20260709 13:21:11.853425 24429 raft_consensus.cc:359] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.855306 24429 raft_consensus.cc:385] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.855643 24429 raft_consensus.cc:740] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.856467 24429 consensus_queue.cc:260] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.857396 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea9e8d8e234a52956bc1fc72b80c6e" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:11.859899 24429 ts_tablet_manager.cc:1434] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:21:11.860925 24429 tablet_bootstrap.cc:492] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:11.868455 24430 tablet_bootstrap.cc:654] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.869393 24429 tablet_bootstrap.cc:654] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.869585 24431 tablet_bootstrap.cc:654] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.866364 24346 leader_election.cc:304] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:11.875590 24123 leader_election.cc:304] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:11.877446 24572 raft_consensus.cc:2804] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:11.877594 24564 raft_consensus.cc:2749] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:11.882671 24274 leader_election.cc:343] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.878085 24572 raft_consensus.cc:493] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.875953 24306 raft_consensus.cc:2468] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:11.890245 24572 raft_consensus.cc:3060] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.895342 24123 leader_election.cc:304] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:11.895838 24573 consensus_queue.cc:1048] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:11.897387 24564 raft_consensus.cc:3060] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:11.902004 24348 leader_election.cc:343] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.902796 24537 raft_consensus.cc:493] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.903358 24537 raft_consensus.cc:515] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.905427 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea9e8d8e234a52956bc1fc72b80c6e" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:11.905853 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f81314f6f14fa9a2c432de6bddcb21" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:11.908875 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f81314f6f14fa9a2c432de6bddcb21" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:11.909155 24235 raft_consensus.cc:3060] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.909015 24200 leader_election.cc:304] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:11.913745 24055 catalog_manager.cc:5697] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.905474 24537 leader_election.cc:290] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:11.917495 24429 tablet_bootstrap.cc:492] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:11.918210 24429 ts_tablet_manager.cc:1403] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.001s
I20260709 13:21:11.916817 24634 raft_consensus.cc:2804] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:11.927095 24159 raft_consensus.cc:3060] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.929543 24155 raft_consensus.cc:3060] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.921106 24305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bbda74ba444fd2bd1ad847ca18463d" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:11.930856 24305 raft_consensus.cc:2468] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:11.933324 24634 raft_consensus.cc:697] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:11.936517 24634 consensus_queue.cc:237] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:11.937233 24198 leader_election.cc:304] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:11.939013 24547 raft_consensus.cc:2804] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:11.939625 24547 raft_consensus.cc:493] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.939999 24547 raft_consensus.cc:3060] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:11.942687 24274 leader_election.cc:343] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.943341 24274 leader_election.cc:304] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:11.947008 24307 raft_consensus.cc:2468] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:11.947120 24564 raft_consensus.cc:2749] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:11.948529 24428 tablet_bootstrap.cc:654] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.951929 24431 tablet_bootstrap.cc:492] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:11.957466 24431 ts_tablet_manager.cc:1403] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.186s	user 0.013s	sys 0.005s
I20260709 13:21:11.952256 24429 raft_consensus.cc:359] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.958164 24429 raft_consensus.cc:385] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.955560 24430 tablet_bootstrap.cc:492] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
W20260709 13:21:11.958482 24274 leader_election.cc:343] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.958856 24430 ts_tablet_manager.cc:1403] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.019s
I20260709 13:21:11.957366 24609 raft_consensus.cc:2749] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:11.960775 24610 consensus_queue.cc:1048] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 13:21:11.972581 24272 leader_election.cc:343] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:11.973097 24272 leader_election.cc:304] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:11.964128 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bbda74ba444fd2bd1ad847ca18463d" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:11.958494 24429 raft_consensus.cc:740] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.977386 24429 consensus_queue.cc:260] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.976032 24610 raft_consensus.cc:2749] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:11.988276 24567 raft_consensus.cc:493] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.988644 24429 ts_tablet_manager.cc:1434] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.001s
I20260709 13:21:11.989790 24429 tablet_bootstrap.cc:492] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:11.989385 24567 raft_consensus.cc:515] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:11.999733 24429 tablet_bootstrap.cc:654] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.983237 24564 raft_consensus.cc:493] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.006706 24572 raft_consensus.cc:515] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:12.011155 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13a5255f4d444b984355f509d3a7918" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:12.024425 24572 leader_election.cc:290] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:12.002877 24567 leader_election.cc:290] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:12.024319 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13a5255f4d444b984355f509d3a7918" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:12.028376 24431 raft_consensus.cc:359] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:12.035090 24431 raft_consensus.cc:385] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.035427 24431 raft_consensus.cc:740] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.036309 24431 consensus_queue.cc:260] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:12.046202 24055 catalog_manager.cc:5697] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:12.067708 24431 ts_tablet_manager.cc:1434] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.110s	user 0.010s	sys 0.000s
I20260709 13:21:12.027344 24573 consensus_queue.cc:1048] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:21:12.074002 24430 raft_consensus.cc:359] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:12.075155 24430 raft_consensus.cc:385] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.075531 24430 raft_consensus.cc:740] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.077169 24431 tablet_bootstrap.cc:492] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:12.028059 24564 raft_consensus.cc:515] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:12.050369 24497 consensus_queue.cc:1048] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:21:12.007125 24547 raft_consensus.cc:515] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:12.061802 24567 raft_consensus.cc:493] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.076452 24430 consensus_queue.cc:260] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:12.079101 24572 raft_consensus.cc:493] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:12.098001 24200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:39703, user_credentials={real_user=slave}} blocked reactor thread for 63264.1us
W20260709 13:21:12.098915 24200 leader_election.cc:343] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:12.103224 24430 ts_tablet_manager.cc:1434] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.144s	user 0.009s	sys 0.000s
I20260709 13:21:12.097656 24610 raft_consensus.cc:493] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.104727 24610 raft_consensus.cc:515] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:12.108523 24634 consensus_queue.cc:1048] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:12.090114 24123 leader_election.cc:304] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:12.089957 24567 raft_consensus.cc:515] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:12.096967 24572 raft_consensus.cc:515] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:12.121654 24572 leader_election.cc:290] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:12.126782 24428 tablet_bootstrap.cc:492] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:12.127348 24428 ts_tablet_manager.cc:1403] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.323s	user 0.024s	sys 0.009s
I20260709 13:21:12.129165 24429 tablet_bootstrap.cc:492] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:12.129626 24428 raft_consensus.cc:359] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:12.130450 24428 raft_consensus.cc:385] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.130759 24428 raft_consensus.cc:740] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
W20260709 13:21:12.111967 24710 log.cc:927] Time spent T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3: Append to log took a long time: real 0.099s	user 0.003s	sys 0.000s
I20260709 13:21:12.121721 24564 leader_election.cc:290] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:12.099761 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208eaee0f548318b6d3fd6edb3e12f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:12.129870 24429 ts_tablet_manager.cc:1403] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.140s	user 0.014s	sys 0.004s
I20260709 13:21:12.144662 24713 raft_consensus.cc:2749] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:12.147086 24547 leader_election.cc:290] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:12.148391 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208eaee0f548318b6d3fd6edb3e12f" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:12.156294 24428 consensus_queue.cc:260] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:12.156159 24057 catalog_manager.cc:5697] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:12.163714 24200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:39703, user_credentials={real_user=slave}} blocked reactor thread for 63775.6us
I20260709 13:21:12.158731 24567 leader_election.cc:290] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:12.160374 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619d34e00ecc47839c94d82bacd2add7" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:12.162169 24307 raft_consensus.cc:3060] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.180769 24428 ts_tablet_manager.cc:1434] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:21:12.152338 24610 leader_election.cc:290] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:12.199410 24429 raft_consensus.cc:359] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:12.200040 24429 raft_consensus.cc:385] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.200340 24429 raft_consensus.cc:740] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.201164 24429 consensus_queue.cc:260] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:12.211671 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208eaee0f548318b6d3fd6edb3e12f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:12.212386 24158 raft_consensus.cc:3060] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.212774 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bbda74ba444fd2bd1ad847ca18463d" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:12.213407 24155 raft_consensus.cc:3060] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.218276 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619d34e00ecc47839c94d82bacd2add7" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:12.218621 24431 tablet_bootstrap.cc:654] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.221628 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bbda74ba444fd2bd1ad847ca18463d" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:12.222307 24308 raft_consensus.cc:3060] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.222371 24572 raft_consensus.cc:493] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.222962 24572 raft_consensus.cc:515] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:12.225183 24572 leader_election.cc:290] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
W20260709 13:21:12.226552 24711 log.cc:927] Time spent T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 13:21:12.227561 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208eaee0f548318b6d3fd6edb3e12f" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:12.228371 24382 raft_consensus.cc:2393] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:12.228956 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd488127e8e5406e956c1118ed2ffbbc" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:12.241663 24429 ts_tablet_manager.cc:1434] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.090s	user 0.002s	sys 0.005s
I20260709 13:21:12.245759 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:12.250381 24428 tablet_bootstrap.cc:492] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:12.251081 24123 leader_election.cc:304] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:12.253098 24497 raft_consensus.cc:493] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.253705 24497 raft_consensus.cc:515] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:12.255792 24722 raft_consensus.cc:2749] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:12.260778 24152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd488127e8e5406e956c1118ed2ffbbc" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:12.262840 24429 tablet_bootstrap.cc:492] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:12.268445 24430 tablet_bootstrap.cc:492] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:12.262197 24156 raft_consensus.cc:3060] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.286407 24308 raft_consensus.cc:2468] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:12.298697 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:12.299605 24232 raft_consensus.cc:2468] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
W20260709 13:21:12.300864 24274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:44365, user_credentials={real_user=slave}} blocked reactor thread for 76505us
W20260709 13:21:12.303757 24274 leader_election.cc:343] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:12.304773 24274 leader_election.cc:343] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:12.305136 24274 leader_election.cc:304] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:12.313751 24431 tablet_bootstrap.cc:492] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:12.314579 24431 ts_tablet_manager.cc:1403] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.246s	user 0.020s	sys 0.005s
W20260709 13:21:12.324324 24348 leader_election.cc:343] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:12.324994 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:12.325683 24383 raft_consensus.cc:2468] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:12.329231 24610 raft_consensus.cc:2749] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:12.348332 24431 raft_consensus.cc:359] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:12.349179 24431 raft_consensus.cc:385] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.349464 24431 raft_consensus.cc:740] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.362481 24497 leader_election.cc:290] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:12.363054 24346 leader_election.cc:304] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:12.366515 24723 raft_consensus.cc:2804] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:12.366921 24723 raft_consensus.cc:493] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:12.367241 24723 raft_consensus.cc:3060] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.374677 24125 leader_election.cc:304] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:12.385921 24431 consensus_queue.cc:260] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:12.388756 24431 ts_tablet_manager.cc:1434] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.003s
I20260709 13:21:12.389796 24431 tablet_bootstrap.cc:492] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:12.357606 24716 consensus_queue.cc:1048] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:21:12.391304 24155 raft_consensus.cc:2468] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
W20260709 13:21:12.394196 24274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.68:44365, user_credentials={real_user=slave}} blocked reactor thread for 89419.1us
I20260709 13:21:12.396588 24498 raft_consensus.cc:493] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.415246 24307 raft_consensus.cc:2468] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:12.416414 24158 raft_consensus.cc:2468] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:12.421236 24722 raft_consensus.cc:2749] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:12.397231 24498 raft_consensus.cc:515] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:12.426308 24430 tablet_bootstrap.cc:654] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.433216 24428 tablet_bootstrap.cc:654] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.453161 24498 leader_election.cc:290] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:12.477626 24723 raft_consensus.cc:515] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:12.469214 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f81314f6f14fa9a2c432de6bddcb21" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
W20260709 13:21:12.486766 24200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:44365, user_credentials={real_user=slave}} blocked reactor thread for 149976us
I20260709 13:21:12.490921 24200 leader_election.cc:304] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:12.458285 24348 leader_election.cc:304] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:12.503434 24723 leader_election.cc:290] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
W20260709 13:21:12.504434 24348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:39703, user_credentials={real_user=slave}} blocked reactor thread for 60917.8us
I20260709 13:21:12.507161 24628 raft_consensus.cc:2804] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:12.507427 24733 raft_consensus.cc:2804] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:12.507781 24628 raft_consensus.cc:697] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:12.507966 24733 raft_consensus.cc:493] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:12.508415 24733 raft_consensus.cc:3060] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.508841 24628 consensus_queue.cc:237] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:12.515764 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f81314f6f14fa9a2c432de6bddcb21" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:12.515966 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ca7353f12e4915a607cd21f4492c2e" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:12.519125 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:12.522146 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ca7353f12e4915a607cd21f4492c2e" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:12.527046 24431 tablet_bootstrap.cc:654] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.526834 24200 leader_election.cc:304] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:12.528610 24429 tablet_bootstrap.cc:654] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.529691 24721 raft_consensus.cc:2804] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:12.530241 24721 raft_consensus.cc:697] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:12.530337 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:12.531144 24721 consensus_queue.cc:237] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:12.496435 24308 raft_consensus.cc:2468] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
W20260709 13:21:12.544672 24200 leader_election.cc:343] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:12.561466 24348 leader_election.cc:343] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:12.575356 24346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:46833, user_credentials={real_user=slave}} blocked reactor thread for 106181us
W20260709 13:21:12.584560 24274 leader_election.cc:343] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:12.600117 24272 leader_election.cc:343] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:12.600672 24272 leader_election.cc:304] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:12.602999 24730 raft_consensus.cc:2749] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:12.608654 24346 leader_election.cc:343] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:12.611598 24733 raft_consensus.cc:515] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:12.616647 24431 tablet_bootstrap.cc:492] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:12.617051 24733 leader_election.cc:290] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:12.617276 24431 ts_tablet_manager.cc:1403] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.228s	user 0.016s	sys 0.002s
I20260709 13:21:12.627064 24430 tablet_bootstrap.cc:492] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:12.628135 24430 ts_tablet_manager.cc:1403] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.362s	user 0.005s	sys 0.014s
I20260709 13:21:12.628588 24346 leader_election.cc:304] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:12.616647 24428 tablet_bootstrap.cc:492] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:12.629551 24572 raft_consensus.cc:2804] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:12.630276 24697 consensus_queue.cc:1048] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:12.630261 24572 raft_consensus.cc:493] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:12.631524 24572 raft_consensus.cc:3060] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.630285 24428 ts_tablet_manager.cc:1403] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.380s	user 0.019s	sys 0.006s
I20260709 13:21:12.634258 24539 consensus_queue.cc:1048] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:12.634723 24431 raft_consensus.cc:359] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:12.636739 24431 raft_consensus.cc:385] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.637497 24431 raft_consensus.cc:740] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.640270 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:12.643605 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:12.644469 24381 raft_consensus.cc:2393] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e96a35df00e4646b9c6e356c6fb4bba in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
W20260709 13:21:12.651420 24348 consensus_peers.cc:597] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:12.651665 24709 consensus_queue.cc:1048] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:12.656329 24697 consensus_queue.cc:1048] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:12.659307 24200 leader_election.cc:343] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:12.659937 24723 consensus_queue.cc:1048] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:12.660398 24200 leader_election.cc:304] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:12.639266 24431 consensus_queue.cc:260] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
W20260709 13:21:12.664496 24274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:44365, user_credentials={real_user=slave}} blocked reactor thread for 50209.2us
I20260709 13:21:12.665122 24428 raft_consensus.cc:359] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:12.666383 24428 raft_consensus.cc:385] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.668049 24428 raft_consensus.cc:740] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.674003 24430 raft_consensus.cc:359] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:12.675053 24430 raft_consensus.cc:385] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.676417 24430 raft_consensus.cc:740] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.674715 24428 consensus_queue.cc:260] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:12.682936 24429 tablet_bootstrap.cc:492] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:12.683897 24429 ts_tablet_manager.cc:1403] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.423s	user 0.017s	sys 0.000s
I20260709 13:21:12.670944 24709 raft_consensus.cc:2749] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:12.677641 24430 consensus_queue.cc:260] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:12.699244 24428 ts_tablet_manager.cc:1434] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.003s
I20260709 13:21:12.700698 24428 tablet_bootstrap.cc:492] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:12.702725 24430 ts_tablet_manager.cc:1434] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.004s
I20260709 13:21:12.683812 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:12.704380 24431 ts_tablet_manager.cc:1434] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.006s
I20260709 13:21:12.706501 24431 tablet_bootstrap.cc:492] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
W20260709 13:21:12.709828 24106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:12.711705 24235 raft_consensus.cc:2393] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 96be869fbe4e464a99c0d5aa3d90dbfb in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
I20260709 13:21:12.702314 24628 raft_consensus.cc:493] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.713291 24628 raft_consensus.cc:515] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:12.715943 24628 leader_election.cc:290] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:12.716121 24428 tablet_bootstrap.cc:654] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.719352 24572 raft_consensus.cc:515] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:12.719646 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea9e8d8e234a52956bc1fc72b80c6e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:12.721164 24348 leader_election.cc:343] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:12.723110 24572 leader_election.cc:290] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:12.724480 24429 raft_consensus.cc:359] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:12.729548 24429 raft_consensus.cc:385] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.727916 24431 tablet_bootstrap.cc:654] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.730484 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f81314f6f14fa9a2c432de6bddcb21" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:12.727185 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea9e8d8e234a52956bc1fc72b80c6e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:12.734985 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f81314f6f14fa9a2c432de6bddcb21" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:12.736322 24430 tablet_bootstrap.cc:492] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:12.735612 24056 catalog_manager.cc:5697] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:12.746554 24429 raft_consensus.cc:740] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.753312 24429 consensus_queue.cc:260] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:12.760115 24429 ts_tablet_manager.cc:1434] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.003s
I20260709 13:21:12.763864 24428 tablet_bootstrap.cc:492] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:12.764405 24428 ts_tablet_manager.cc:1403] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.005s
I20260709 13:21:12.754895 24307 raft_consensus.cc:3060] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.781239 24346 leader_election.cc:304] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:12.758085 24306 raft_consensus.cc:2468] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:12.787554 24429 tablet_bootstrap.cc:492] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:12.765669 24235 raft_consensus.cc:3060] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.790778 24428 raft_consensus.cc:359] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:12.791790 24428 raft_consensus.cc:385] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.792186 24428 raft_consensus.cc:740] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.792989 24428 consensus_queue.cc:260] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:12.795938 24430 tablet_bootstrap.cc:654] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.805817 24428 ts_tablet_manager.cc:1434] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 13:21:12.791157 24723 raft_consensus.cc:2749] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:12.792899 24733 consensus_queue.cc:1048] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:21:12.826663 24428 tablet_bootstrap.cc:492] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:12.833613 24722 raft_consensus.cc:493] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.834263 24722 raft_consensus.cc:515] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:12.836731 24722 leader_election.cc:290] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
W20260709 13:21:12.820894 24751 log.cc:927] Time spent T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:21:12.845070 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3863e0f41bbc4ace93654a83e2578032" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:12.846493 24428 tablet_bootstrap.cc:654] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.846534 24346 leader_election.cc:304] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:12.851665 24572 raft_consensus.cc:2804] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:12.852104 24572 raft_consensus.cc:493] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:12.907622 24572 raft_consensus.cc:3060] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.910632 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3863e0f41bbc4ace93654a83e2578032" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:12.906294 24307 raft_consensus.cc:2468] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
W20260709 13:21:12.919410 24346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:46833, user_credentials={real_user=slave}} blocked reactor thread for 72972.1us
I20260709 13:21:12.927577 24429 tablet_bootstrap.cc:654] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.945866 24697 raft_consensus.cc:493] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.949605 24697 raft_consensus.cc:515] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:12.955684 24235 raft_consensus.cc:2468] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:12.956120 24431 tablet_bootstrap.cc:492] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:12.957929 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e21b3c9af648169d5786fe63dd5df7" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:12.958271 24431 ts_tablet_manager.cc:1403] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.252s	user 0.017s	sys 0.027s
I20260709 13:21:12.955683 24697 leader_election.cc:290] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
W20260709 13:21:12.960175 24348 leader_election.cc:343] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:12.960894 24726 raft_consensus.cc:493] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.961675 24726 raft_consensus.cc:515] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:12.964641 24726 leader_election.cc:290] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:12.919471 24572 raft_consensus.cc:515] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:12.969661 24428 tablet_bootstrap.cc:492] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:12.970289 24428 ts_tablet_manager.cc:1403] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.144s	user 0.033s	sys 0.031s
I20260709 13:21:12.970609 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea9e8d8e234a52956bc1fc72b80c6e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
W20260709 13:21:12.972223 24348 leader_election.cc:343] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:12.970762 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a82f5a216984c39907a5b48bbd3b560" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:12.974246 24431 raft_consensus.cc:359] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:12.974689 24346 leader_election.cc:304] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
W20260709 13:21:12.974865 24274 leader_election.cc:343] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:12.975572 24740 raft_consensus.cc:2804] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:12.976159 24740 raft_consensus.cc:697] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:12.977173 24740 consensus_queue.cc:237] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:12.975119 24431 raft_consensus.cc:385] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.978730 24430 tablet_bootstrap.cc:492] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:12.976271 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a82f5a216984c39907a5b48bbd3b560" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:12.979287 24431 raft_consensus.cc:740] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.979570 24430 ts_tablet_manager.cc:1403] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.246s	user 0.028s	sys 0.020s
I20260709 13:21:12.980121 24428 raft_consensus.cc:359] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:12.982263 24428 raft_consensus.cc:385] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.983042 24428 raft_consensus.cc:740] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.983964 24428 consensus_queue.cc:260] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:12.985806 24431 consensus_queue.cc:260] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:12.990185 24431 ts_tablet_manager.cc:1434] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.002s
I20260709 13:21:12.991705 24431 tablet_bootstrap.cc:492] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:12.992374 24430 raft_consensus.cc:359] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:12.993397 24430 raft_consensus.cc:385] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.993747 24430 raft_consensus.cc:740] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.981238 24572 leader_election.cc:290] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:12.995128 24430 consensus_queue.cc:260] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
W20260709 13:21:12.995898 24274 leader_election.cc:343] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:12.996904 24274 leader_election.cc:304] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:12.999094 24726 raft_consensus.cc:2749] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:12.999356 24428 ts_tablet_manager.cc:1434] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 13:21:13.000378 24428 tablet_bootstrap.cc:492] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:13.001895 24157 raft_consensus.cc:3060] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.982192 24123 leader_election.cc:304] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:13.014690 24733 consensus_queue.cc:1048] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:21:13.026656 24430 ts_tablet_manager.cc:1434] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:21:13.027817 24430 tablet_bootstrap.cc:492] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
W20260709 13:21:13.030727 24123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:34445, user_credentials={real_user=slave}} blocked reactor thread for 78757.2us
I20260709 13:21:13.035319 24305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ea9e8d8e234a52956bc1fc72b80c6e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:13.037359 24305 raft_consensus.cc:3060] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.041563 24431 tablet_bootstrap.cc:654] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.038130 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e21b3c9af648169d5786fe63dd5df7" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:13.045482 24233 raft_consensus.cc:2468] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:13.063097 24722 raft_consensus.cc:2749] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:13.066100 24346 leader_election.cc:304] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:13.067963 24428 tablet_bootstrap.cc:654] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.068903 24573 raft_consensus.cc:2804] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:13.069489 24573 raft_consensus.cc:493] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.069923 24573 raft_consensus.cc:3060] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.074419 24430 tablet_bootstrap.cc:654] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.073856 24305 raft_consensus.cc:2468] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:13.085892 24346 leader_election.cc:304] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:13.097823 24610 raft_consensus.cc:493] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.100346 24610 raft_consensus.cc:515] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.102790 24610 leader_election.cc:290] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:13.107406 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:13.088372 24740 raft_consensus.cc:2804] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:13.114492 24274 leader_election.cc:343] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.122808 24431 tablet_bootstrap.cc:492] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:13.123417 24431 ts_tablet_manager.cc:1403] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.132s	user 0.023s	sys 0.025s
I20260709 13:21:13.109364 24726 raft_consensus.cc:493] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.118897 24740 raft_consensus.cc:697] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:13.112697 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:13.136996 24272 leader_election.cc:343] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.137759 24429 tablet_bootstrap.cc:492] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:13.138346 24429 ts_tablet_manager.cc:1403] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.351s	user 0.021s	sys 0.003s
I20260709 13:21:13.130414 24573 raft_consensus.cc:515] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:13.137609 24272 leader_election.cc:304] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:13.148456 24430 tablet_bootstrap.cc:492] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:13.161578 24430 ts_tablet_manager.cc:1403] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.134s	user 0.029s	sys 0.012s
I20260709 13:21:13.161893 24715 raft_consensus.cc:2749] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:13.148928 24697 consensus_queue.cc:1048] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:13.154465 24709 consensus_queue.cc:1048] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:13.132406 24726 raft_consensus.cc:515] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:13.169552 24430 raft_consensus.cc:359] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:13.170689 24726 leader_election.cc:290] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:13.170701 24430 raft_consensus.cc:385] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.171627 24430 raft_consensus.cc:740] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.171353 24431 raft_consensus.cc:359] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.172232 24431 raft_consensus.cc:385] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.158236 24429 raft_consensus.cc:359] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:13.137092 24740 consensus_queue.cc:237] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.159711 24572 raft_consensus.cc:493] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.163110 24428 tablet_bootstrap.cc:492] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:13.163261 24573 leader_election.cc:290] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:13.163707 24058 catalog_manager.cc:5697] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:13.172587 24431 raft_consensus.cc:740] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.173144 24429 raft_consensus.cc:385] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.172556 24231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7f93cd2c1042aa9ce8434973e4e95a" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:13.174259 24726 raft_consensus.cc:493] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.178027 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e21b3c9af648169d5786fe63dd5df7" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:13.178077 24726 raft_consensus.cc:515] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
W20260709 13:21:13.178702 24272 leader_election.cc:343] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.179083 24232 raft_consensus.cc:3060] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.180596 24726 leader_election.cc:290] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:13.181210 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4105e0d91861411cab1b9ed694694e6a" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:13.182300 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7f93cd2c1042aa9ce8434973e4e95a" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
W20260709 13:21:13.182727 24274 leader_election.cc:343] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.184659 24231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4105e0d91861411cab1b9ed694694e6a" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:13.185730 24274 leader_election.cc:343] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.172991 24430 consensus_queue.cc:260] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:13.186216 24274 leader_election.cc:304] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:13.176868 24429 raft_consensus.cc:740] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.176790 24431 consensus_queue.cc:260] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.175813 24428 ts_tablet_manager.cc:1403] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.176s	user 0.011s	sys 0.014s
I20260709 13:21:13.190333 24429 consensus_queue.cc:260] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:13.196230 24429 ts_tablet_manager.cc:1434] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:21:13.197253 24429 tablet_bootstrap.cc:492] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:13.198011 24430 ts_tablet_manager.cc:1434] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:21:13.176787 24572 raft_consensus.cc:515] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:13.204747 24572 leader_election.cc:290] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
W20260709 13:21:13.205842 24272 leader_election.cc:343] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.216105 24272 leader_election.cc:304] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:13.190733 24726 raft_consensus.cc:2749] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:13.217458 24715 raft_consensus.cc:2749] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:13.207036 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f8ed631e60464e98c97b58568b708d" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:13.208195 24428 raft_consensus.cc:359] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:13.215260 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f8ed631e60464e98c97b58568b708d" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:13.229128 24428 raft_consensus.cc:385] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.229696 24428 raft_consensus.cc:740] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.230505 24233 raft_consensus.cc:2468] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:13.232887 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e21b3c9af648169d5786fe63dd5df7" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:13.230553 24428 consensus_queue.cc:260] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:13.235773 24306 raft_consensus.cc:2468] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:13.237619 24430 tablet_bootstrap.cc:492] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:13.237799 24346 leader_election.cc:304] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:13.239979 24428 ts_tablet_manager.cc:1434] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.049s	user 0.000s	sys 0.007s
I20260709 13:21:13.241132 24428 tablet_bootstrap.cc:492] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:13.249275 24429 tablet_bootstrap.cc:654] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.251999 24431 ts_tablet_manager.cc:1434] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.001s
W20260709 13:21:13.263624 24348 leader_election.cc:343] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.260438 24773 raft_consensus.cc:2804] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:13.264978 24773 raft_consensus.cc:493] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.265321 24572 consensus_queue.cc:1048] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:13.265372 24773 raft_consensus.cc:3060] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.274751 24431 tablet_bootstrap.cc:492] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:13.276022 24428 tablet_bootstrap.cc:654] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.279253 24232 raft_consensus.cc:2468] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:13.287474 24346 leader_election.cc:304] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:13.289287 24572 raft_consensus.cc:2804] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:13.289848 24572 raft_consensus.cc:697] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:13.292630 24572 consensus_queue.cc:237] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:13.301092 24430 tablet_bootstrap.cc:654] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.306254 24057 catalog_manager.cc:5697] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:13.308555 24057 catalog_manager.cc:5697] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:13.312134 24773 raft_consensus.cc:515] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:13.332830 24431 tablet_bootstrap.cc:654] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.335579 24773 leader_election.cc:290] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:13.340920 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f8ed631e60464e98c97b58568b708d" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:13.341727 24306 raft_consensus.cc:3060] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.345119 24429 tablet_bootstrap.cc:492] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:13.345916 24429 ts_tablet_manager.cc:1403] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.149s	user 0.011s	sys 0.009s
I20260709 13:21:13.349678 24429 raft_consensus.cc:359] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:13.350596 24429 raft_consensus.cc:385] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.350903 24429 raft_consensus.cc:740] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.351629 24429 consensus_queue.cc:260] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:13.351401 24231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f8ed631e60464e98c97b58568b708d" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:13.358345 24231 raft_consensus.cc:3060] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.368669 24429 ts_tablet_manager.cc:1434] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:21:13.372313 24429 tablet_bootstrap.cc:492] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
W20260709 13:21:13.366992 24779 log.cc:927] Time spent T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:21:13.386130 24431 tablet_bootstrap.cc:492] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:13.386674 24431 ts_tablet_manager.cc:1403] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.133s	user 0.021s	sys 0.009s
I20260709 13:21:13.388085 24429 tablet_bootstrap.cc:654] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.389478 24722 raft_consensus.cc:493] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.390100 24722 raft_consensus.cc:515] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:13.399068 24722 leader_election.cc:290] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:13.401046 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e21b3c9af648169d5786fe63dd5df7" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:13.401209 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e21b3c9af648169d5786fe63dd5df7" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:13.401965 24232 raft_consensus.cc:2393] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:13.402907 24428 tablet_bootstrap.cc:492] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:13.403496 24428 ts_tablet_manager.cc:1403] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.163s	user 0.021s	sys 0.004s
I20260709 13:21:13.404587 24123 leader_election.cc:304] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:13.406705 24428 raft_consensus.cc:359] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.407121 24306 raft_consensus.cc:2468] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:13.407580 24428 raft_consensus.cc:385] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.407930 24428 raft_consensus.cc:740] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.408783 24428 consensus_queue.cc:260] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.409785 24430 tablet_bootstrap.cc:492] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:13.410337 24430 ts_tablet_manager.cc:1403] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.200s	user 0.028s	sys 0.020s
I20260709 13:21:13.411259 24428 ts_tablet_manager.cc:1434] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:21:13.409215 24346 leader_election.cc:304] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:13.412258 24428 tablet_bootstrap.cc:492] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:13.413208 24430 raft_consensus.cc:359] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.413393 24773 consensus_queue.cc:1048] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:13.414112 24430 raft_consensus.cc:385] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.414503 24430 raft_consensus.cc:740] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.407771 24564 raft_consensus.cc:3060] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.413264 24740 raft_consensus.cc:2804] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:13.415611 24740 raft_consensus.cc:697] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:13.415390 24430 consensus_queue.cc:260] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.416462 24740 consensus_queue.cc:237] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:13.419302 24428 tablet_bootstrap.cc:654] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.420733 24431 raft_consensus.cc:359] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:13.421566 24431 raft_consensus.cc:385] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.421865 24431 raft_consensus.cc:740] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.422840 24431 consensus_queue.cc:260] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:13.429762 24431 ts_tablet_manager.cc:1434] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 13:21:13.432152 24431 tablet_bootstrap.cc:492] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:13.436507 24430 ts_tablet_manager.cc:1434] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:21:13.438091 24430 tablet_bootstrap.cc:492] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:13.444496 24231 raft_consensus.cc:2468] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:13.452531 24564 raft_consensus.cc:2749] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:13.457978 24430 tablet_bootstrap.cc:654] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.453691 24431 tablet_bootstrap.cc:654] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.424988 24054 catalog_manager.cc:5697] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:13.462615 24429 tablet_bootstrap.cc:492] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:13.463547 24429 ts_tablet_manager.cc:1403] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.011s
I20260709 13:21:13.464947 24572 raft_consensus.cc:493] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.465500 24572 raft_consensus.cc:515] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.467659 24572 leader_election.cc:290] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:13.468075 24429 raft_consensus.cc:359] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.469089 24429 raft_consensus.cc:385] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.469651 24429 raft_consensus.cc:740] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.469738 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd488127e8e5406e956c1118ed2ffbbc" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:13.471087 24429 consensus_queue.cc:260] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
W20260709 13:21:13.471735 24348 leader_election.cc:343] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.474184 24429 ts_tablet_manager.cc:1434] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:21:13.475802 24429 tablet_bootstrap.cc:492] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:13.477337 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd488127e8e5406e956c1118ed2ffbbc" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:13.478163 24307 raft_consensus.cc:2468] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:13.481204 24346 leader_election.cc:304] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:13.481658 24431 tablet_bootstrap.cc:492] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:13.482149 24572 raft_consensus.cc:2804] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:13.482368 24431 ts_tablet_manager.cc:1403] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.002s
I20260709 13:21:13.482654 24572 raft_consensus.cc:493] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.485244 24572 raft_consensus.cc:3060] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.486429 24431 raft_consensus.cc:359] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:13.487324 24431 raft_consensus.cc:385] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.487682 24431 raft_consensus.cc:740] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.489182 24431 consensus_queue.cc:260] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:13.490229 24773 consensus_queue.cc:1048] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:13.490757 24429 tablet_bootstrap.cc:654] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.491946 24431 ts_tablet_manager.cc:1434] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:13.493542 24431 tablet_bootstrap.cc:492] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:13.502238 24431 tablet_bootstrap.cc:654] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.510396 24057 catalog_manager.cc:5697] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:13.513738 24428 tablet_bootstrap.cc:492] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:13.514596 24428 ts_tablet_manager.cc:1403] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.018s
I20260709 13:21:13.533038 24773 raft_consensus.cc:493] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.533725 24773 raft_consensus.cc:515] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:13.534430 24428 raft_consensus.cc:359] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.535148 24428 raft_consensus.cc:385] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.535434 24428 raft_consensus.cc:740] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.536245 24428 consensus_queue.cc:260] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.536921 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd9769488e4db0bf3addb6ae875e51" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:13.538452 24348 leader_election.cc:343] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.538653 24428 ts_tablet_manager.cc:1434] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.005s
I20260709 13:21:13.539707 24428 tablet_bootstrap.cc:492] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:13.548036 24428 tablet_bootstrap.cc:654] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.539676 24773 leader_election.cc:290] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:13.562004 24740 raft_consensus.cc:493] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.566197 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd9769488e4db0bf3addb6ae875e51" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:13.590338 24346 leader_election.cc:343] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.590984 24346 leader_election.cc:304] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:13.592805 24573 raft_consensus.cc:2749] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:13.614529 24740 raft_consensus.cc:515] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:13.617609 24740 leader_election.cc:290] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:13.619813 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7f93cd2c1042aa9ce8434973e4e95a" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:13.621052 24348 consensus_peers.cc:597] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:13.636471 24572 raft_consensus.cc:515] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
W20260709 13:21:13.650800 24346 leader_election.cc:343] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.664917 24304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd488127e8e5406e956c1118ed2ffbbc" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:13.665644 24304 raft_consensus.cc:3060] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.657956 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7f93cd2c1042aa9ce8434973e4e95a" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:13.666551 24308 raft_consensus.cc:2468] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:13.655721 24709 raft_consensus.cc:493] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.663690 24572 leader_election.cc:290] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:13.669155 24346 leader_election.cc:304] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:13.673384 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd488127e8e5406e956c1118ed2ffbbc" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:13.671608 24773 raft_consensus.cc:2804] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:13.680351 24773 raft_consensus.cc:493] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.680763 24773 raft_consensus.cc:3060] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:13.678411 24348 leader_election.cc:343] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.670529 24709 raft_consensus.cc:515] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.707437 24430 tablet_bootstrap.cc:492] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:13.708047 24430 ts_tablet_manager.cc:1403] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.270s	user 0.013s	sys 0.020s
I20260709 13:21:13.708186 24709 leader_election.cc:290] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:13.710960 24431 tablet_bootstrap.cc:492] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:13.711544 24431 ts_tablet_manager.cc:1403] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.218s	user 0.059s	sys 0.129s
I20260709 13:21:13.711143 24430 raft_consensus.cc:359] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.711966 24430 raft_consensus.cc:385] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.712304 24430 raft_consensus.cc:740] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.713037 24430 consensus_queue.cc:260] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.711421 24773 raft_consensus.cc:515] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:13.761085 24429 tablet_bootstrap.cc:492] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:13.763365 24429 ts_tablet_manager.cc:1403] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.288s	user 0.024s	sys 0.002s
I20260709 13:21:13.771247 24429 raft_consensus.cc:359] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.772984 24429 raft_consensus.cc:385] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.773456 24429 raft_consensus.cc:740] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.780294 24428 tablet_bootstrap.cc:492] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:13.780790 24431 raft_consensus.cc:359] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.783185 24431 raft_consensus.cc:385] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.783636 24431 raft_consensus.cc:740] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.784754 24431 consensus_queue.cc:260] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.785979 24722 raft_consensus.cc:493] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.794639 24564 raft_consensus.cc:493] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.795961 24564 raft_consensus.cc:515] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.791623 24722 raft_consensus.cc:515] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:13.802279 24715 raft_consensus.cc:493] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.803196 24715 raft_consensus.cc:515] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.808269 24715 leader_election.cc:290] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:13.812402 24431 ts_tablet_manager.cc:1434] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.100s	user 0.012s	sys 0.005s
I20260709 13:21:13.815907 24429 consensus_queue.cc:260] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.818598 24564 leader_election.cc:290] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:13.832945 24431 tablet_bootstrap.cc:492] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:13.846962 24773 leader_election.cc:290] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:13.856035 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:13.857332 24307 raft_consensus.cc:2468] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:13.857442 24231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7f93cd2c1042aa9ce8434973e4e95a" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:13.862675 24198 leader_election.cc:304] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:13.865163 24709 raft_consensus.cc:2804] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:13.865717 24709 raft_consensus.cc:493] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.866106 24709 raft_consensus.cc:3060] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.868834 24304 raft_consensus.cc:2468] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:13.874495 24721 raft_consensus.cc:493] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.875149 24721 raft_consensus.cc:515] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.876123 24304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:13.880016 24304 raft_consensus.cc:2468] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 0.
I20260709 13:21:13.880795 24721 leader_election.cc:290] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:13.882496 24429 ts_tablet_manager.cc:1434] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.118s	user 0.013s	sys 0.019s
I20260709 13:21:13.882836 24431 tablet_bootstrap.cc:654] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.853303 24430 ts_tablet_manager.cc:1434] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.074s	user 0.011s	sys 0.000s
I20260709 13:21:13.888267 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacd8d22901e4b63b728d0d94e835a27" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:13.890810 24430 tablet_bootstrap.cc:492] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:13.895860 24772 consensus_queue.cc:1048] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:13.898344 24610 raft_consensus.cc:493] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.899207 24610 raft_consensus.cc:515] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.902356 24610 leader_election.cc:290] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:13.904322 24428 ts_tablet_manager.cc:1403] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.365s	user 0.021s	sys 0.010s
I20260709 13:21:13.906488 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacd8d22901e4b63b728d0d94e835a27" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:13.895916 24274 leader_election.cc:343] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.912189 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48bb74e965d44649059c6cbae8878b9" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:13.912549 24346 leader_election.cc:304] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:13.913288 24304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ca7353f12e4915a607cd21f4492c2e" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:13.914319 24304 raft_consensus.cc:2468] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:13.903297 24429 tablet_bootstrap.cc:492] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:13.915818 24198 leader_election.cc:304] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:13.917028 24795 raft_consensus.cc:2804] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:13.917450 24795 raft_consensus.cc:493] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.917817 24795 raft_consensus.cc:3060] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.918140 24722 leader_election.cc:290] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
W20260709 13:21:13.918542 24274 leader_election.cc:343] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.919584 24740 raft_consensus.cc:2804] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:13.921000 24740 raft_consensus.cc:697] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:13.922580 24740 consensus_queue.cc:237] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.924113 24428 raft_consensus.cc:359] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.924906 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:13.925856 24155 raft_consensus.cc:2468] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:13.927481 24429 tablet_bootstrap.cc:654] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.929283 24123 leader_election.cc:304] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:13.930718 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48bb74e965d44649059c6cbae8878b9" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:13.945999 24430 tablet_bootstrap.cc:654] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.950459 24379 raft_consensus.cc:2468] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 0.
I20260709 13:21:13.951741 24722 raft_consensus.cc:2804] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:13.952320 24722 raft_consensus.cc:493] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.953024 24722 raft_consensus.cc:3060] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.953675 24795 raft_consensus.cc:515] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:13.925074 24428 raft_consensus.cc:385] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.920629 24709 raft_consensus.cc:515] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
W20260709 13:21:13.954169 24272 leader_election.cc:343] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.961840 24428 raft_consensus.cc:740] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.973137 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:13.974732 24232 raft_consensus.cc:2393] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
I20260709 13:21:13.971029 24272 leader_election.cc:304] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:13.985261 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ca7353f12e4915a607cd21f4492c2e" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:13.986146 24610 raft_consensus.cc:2749] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:13.986944 24231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:13.989514 24428 consensus_queue.cc:260] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:13.994367 24231 raft_consensus.cc:2393] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
I20260709 13:21:14.003123 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ca7353f12e4915a607cd21f4492c2e" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:14.003975 24307 raft_consensus.cc:3060] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:13.992425 24346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:46833, user_credentials={real_user=slave}} blocked reactor thread for 80297.8us
I20260709 13:21:14.007341 24773 consensus_queue.cc:1048] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:14.011706 24709 leader_election.cc:290] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:14.012159 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:13.999133 24795 leader_election.cc:290] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:14.018069 24379 raft_consensus.cc:2393] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:14.023608 24274 leader_election.cc:304] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
W20260709 13:21:14.027693 24346 leader_election.cc:343] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.033666 24428 ts_tablet_manager.cc:1434] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.129s	user 0.009s	sys 0.000s
I20260709 13:21:14.034693 24573 consensus_queue.cc:1048] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:14.035980 24431 tablet_bootstrap.cc:492] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:14.036572 24431 ts_tablet_manager.cc:1403] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.204s	user 0.018s	sys 0.013s
I20260709 13:21:14.057034 24430 tablet_bootstrap.cc:492] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:14.057585 24430 ts_tablet_manager.cc:1403] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.167s	user 0.019s	sys 0.005s
I20260709 13:21:14.048578 24304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:14.042946 24722 raft_consensus.cc:515] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:14.066668 24794 raft_consensus.cc:2804] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:14.067162 24794 raft_consensus.cc:493] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:14.067552 24794 raft_consensus.cc:3060] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.072841 24431 raft_consensus.cc:359] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.078446 24431 raft_consensus.cc:385] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.079833 24431 raft_consensus.cc:740] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.086069 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ca7353f12e4915a607cd21f4492c2e" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:14.077039 24304 raft_consensus.cc:3060] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.091059 24123 leader_election.cc:304] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:14.093272 24797 raft_consensus.cc:3060] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.094537 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:14.096717 24428 tablet_bootstrap.cc:492] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:14.100080 24722 leader_election.cc:290] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:14.101418 24157 raft_consensus.cc:2393] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e96a35df00e4646b9c6e356c6fb4bba in current term 1: Already voted for candidate 97e577a376c948bfac33665f06a4bb98 in this term.
I20260709 13:21:14.101120 24430 raft_consensus.cc:359] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:14.103950 24430 raft_consensus.cc:385] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.104441 24430 raft_consensus.cc:740] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.107029 24155 raft_consensus.cc:3060] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.110756 24430 consensus_queue.cc:260] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
W20260709 13:21:14.117745 24799 log.cc:927] Time spent T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:21:14.126837 24796 consensus_queue.cc:1048] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:14.131317 24428 tablet_bootstrap.cc:654] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.131834 24307 raft_consensus.cc:2468] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:14.135486 24198 leader_election.cc:304] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:14.159417 24709 raft_consensus.cc:2804] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:14.160425 24709 raft_consensus.cc:697] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:14.135136 24429 tablet_bootstrap.cc:492] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:14.135051 24056 catalog_manager.cc:5697] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.162035 24430 ts_tablet_manager.cc:1434] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.001s
I20260709 13:21:14.148614 24794 raft_consensus.cc:515] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.162046 24429 ts_tablet_manager.cc:1403] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.259s	user 0.028s	sys 0.014s
I20260709 13:21:14.104465 24431 consensus_queue.cc:260] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.155999 24797 raft_consensus.cc:2749] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:14.168781 24304 raft_consensus.cc:2468] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:14.170132 24429 raft_consensus.cc:359] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.171106 24429 raft_consensus.cc:385] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.171533 24429 raft_consensus.cc:740] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
W20260709 13:21:14.174942 24274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:44365, user_credentials={real_user=slave}} blocked reactor thread for 123368us
I20260709 13:21:14.170622 24198 leader_election.cc:304] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:14.183247 24304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be7f93cd2c1042aa9ce8434973e4e95a" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:14.184154 24304 raft_consensus.cc:3060] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.198179 24431 ts_tablet_manager.cc:1434] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.161s	user 0.009s	sys 0.002s
I20260709 13:21:14.186836 24721 raft_consensus.cc:2804] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:14.198060 24429 consensus_queue.cc:260] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.204833 24430 tablet_bootstrap.cc:492] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:14.161449 24709 consensus_queue.cc:237] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:14.208861 24721 raft_consensus.cc:697] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:14.227203 24721 consensus_queue.cc:237] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:14.228219 24722 raft_consensus.cc:493] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.228777 24722 raft_consensus.cc:515] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.231065 24431 tablet_bootstrap.cc:492] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:14.232148 24428 tablet_bootstrap.cc:492] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:14.238104 24428 ts_tablet_manager.cc:1403] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.007s
I20260709 13:21:14.237900 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd488127e8e5406e956c1118ed2ffbbc" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:14.242482 24794 leader_election.cc:290] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:14.231137 24722 leader_election.cc:290] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
W20260709 13:21:14.267529 24200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:44365, user_credentials={real_user=slave}} blocked reactor thread for 116859us
I20260709 13:21:14.274780 24794 raft_consensus.cc:493] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.275518 24794 raft_consensus.cc:515] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.278996 24794 leader_election.cc:290] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:14.290365 24805 raft_consensus.cc:493] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.291234 24805 raft_consensus.cc:515] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:14.299284 24429 ts_tablet_manager.cc:1434] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.001s
I20260709 13:21:14.300827 24429 tablet_bootstrap.cc:492] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:14.308643 24428 raft_consensus.cc:359] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:14.309770 24428 raft_consensus.cc:385] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.310230 24428 raft_consensus.cc:740] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
W20260709 13:21:14.320868 24200 leader_election.cc:343] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.305573 24805 leader_election.cc:290] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:14.341553 24428 consensus_queue.cc:260] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
W20260709 13:21:14.346484 24200 leader_election.cc:343] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.369931 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:14.373363 24309 raft_consensus.cc:2393] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
I20260709 13:21:14.352849 24231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:14.377928 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4105e0d91861411cab1b9ed694694e6a" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:14.376442 24428 ts_tablet_manager.cc:1434] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.138s	user 0.009s	sys 0.000s
I20260709 13:21:14.378188 24715 raft_consensus.cc:493] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.382684 24715 raft_consensus.cc:515] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:14.384537 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48bb74e965d44649059c6cbae8878b9" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:14.385492 24381 raft_consensus.cc:3060] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.387202 24428 tablet_bootstrap.cc:492] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:14.381862 24431 tablet_bootstrap.cc:654] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.393709 24307 raft_consensus.cc:2468] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:14.394347 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48bb74e965d44649059c6cbae8878b9" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:14.395066 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd488127e8e5406e956c1118ed2ffbbc" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:14.396056 24306 raft_consensus.cc:2393] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:14.400611 24123 leader_election.cc:304] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:14.413542 24797 raft_consensus.cc:3060] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.415046 24796 consensus_queue.cc:1048] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:14.417443 24198 leader_election.cc:304] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:14.418259 24805 raft_consensus.cc:2804] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:14.441133 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8d5d925cdf4b799f067f0763e2b3af" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:14.439077 24805 raft_consensus.cc:493] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:14.443840 24805 raft_consensus.cc:3060] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.446143 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8d5d925cdf4b799f067f0763e2b3af" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:14.448082 24428 tablet_bootstrap.cc:654] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:14.448637 24274 leader_election.cc:343] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.451321 24430 tablet_bootstrap.cc:654] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:14.459592 24274 leader_election.cc:343] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:14.460464 24274 leader_election.cc:343] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.460824 24274 leader_election.cc:304] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:14.482513 24429 tablet_bootstrap.cc:654] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.485199 24381 raft_consensus.cc:2468] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 1.
I20260709 13:21:14.475646 24794 raft_consensus.cc:2749] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:14.489842 24715 leader_election.cc:290] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:14.503026 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4105e0d91861411cab1b9ed694694e6a" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:14.491461 24304 raft_consensus.cc:2468] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
W20260709 13:21:14.519536 24274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:39703, user_credentials={real_user=slave}} blocked reactor thread for 59083.6us
I20260709 13:21:14.527648 24431 tablet_bootstrap.cc:492] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:14.528254 24431 ts_tablet_manager.cc:1403] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.303s	user 0.016s	sys 0.006s
I20260709 13:21:14.528751 24797 raft_consensus.cc:2749] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:14.533237 24274 leader_election.cc:304] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:14.548949 24715 raft_consensus.cc:2804] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:14.554733 24715 raft_consensus.cc:697] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:14.555720 24715 consensus_queue.cc:237] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.556242 24346 leader_election.cc:304] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:14.557466 24572 raft_consensus.cc:2804] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:14.557636 24431 raft_consensus.cc:359] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.558418 24431 raft_consensus.cc:385] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.558007 24572 raft_consensus.cc:697] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:14.558718 24431 raft_consensus.cc:740] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.559365 24572 consensus_queue.cc:237] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:14.559469 24431 consensus_queue.cc:260] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.580646 24431 ts_tablet_manager.cc:1434] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.001s
I20260709 13:21:14.568571 24805 raft_consensus.cc:515] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:14.584797 24805 leader_election.cc:290] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:14.571482 24123 leader_election.cc:304] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:14.575227 24772 raft_consensus.cc:493] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.588210 24772 raft_consensus.cc:515] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.589388 24304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4105e0d91861411cab1b9ed694694e6a" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:14.590301 24304 raft_consensus.cc:3060] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.591328 24564 raft_consensus.cc:2749] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:14.599594 24772 leader_election.cc:290] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
W20260709 13:21:14.600962 24106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:14.603760 24304 raft_consensus.cc:2468] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:14.581918 24431 tablet_bootstrap.cc:492] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:14.617865 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80418d8094044258597b8ab9021a04e" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:14.619371 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a82f5a216984c39907a5b48bbd3b560" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:14.621101 24428 tablet_bootstrap.cc:492] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:14.621595 24428 ts_tablet_manager.cc:1403] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.235s	user 0.010s	sys 0.003s
I20260709 13:21:14.624802 24428 raft_consensus.cc:359] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:14.625588 24428 raft_consensus.cc:385] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.625931 24428 raft_consensus.cc:740] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.626643 24805 raft_consensus.cc:493] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.627170 24805 raft_consensus.cc:515] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.629160 24805 leader_election.cc:290] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:14.629654 24772 consensus_queue.cc:1048] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:14.629902 24428 consensus_queue.cc:260] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:14.635046 24428 ts_tablet_manager.cc:1434] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:21:14.637827 24428 tablet_bootstrap.cc:492] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:14.640547 24430 tablet_bootstrap.cc:492] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
W20260709 13:21:14.635387 24348 leader_election.cc:343] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.641084 24430 ts_tablet_manager.cc:1403] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.461s	user 0.031s	sys 0.017s
W20260709 13:21:14.642567 24274 leader_election.cc:343] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:14.642967 24200 leader_election.cc:343] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.647272 24431 tablet_bootstrap.cc:654] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.649910 24429 tablet_bootstrap.cc:492] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:14.650480 24429 ts_tablet_manager.cc:1403] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.350s	user 0.009s	sys 0.007s
I20260709 13:21:14.651713 24198 leader_election.cc:304] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:14.654233 24428 tablet_bootstrap.cc:654] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.653579 24429 raft_consensus.cc:359] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:14.656749 24429 raft_consensus.cc:385] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.657099 24429 raft_consensus.cc:740] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.657869 24429 consensus_queue.cc:260] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:14.660455 24429 ts_tablet_manager.cc:1434] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:14.664786 24832 raft_consensus.cc:2804] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:14.665365 24832 raft_consensus.cc:697] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:14.666203 24832 consensus_queue.cc:237] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:14.673086 24429 tablet_bootstrap.cc:492] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:14.675019 24805 consensus_queue.cc:1048] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:14.677508 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4105e0d91861411cab1b9ed694694e6a" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:14.676993 24058 catalog_manager.cc:5697] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.680471 24431 tablet_bootstrap.cc:492] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:14.680976 24431 ts_tablet_manager.cc:1403] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.002s
I20260709 13:21:14.682417 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:14.683184 24379 raft_consensus.cc:2468] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:14.685685 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:14.686363 24158 raft_consensus.cc:2468] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:14.685693 24431 raft_consensus.cc:359] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:14.687543 24430 raft_consensus.cc:359] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.687911 24431 raft_consensus.cc:385] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.688239 24430 raft_consensus.cc:385] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.688339 24431 raft_consensus.cc:740] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.688592 24430 raft_consensus.cc:740] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.689270 24430 consensus_queue.cc:260] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.689291 24431 consensus_queue.cc:260] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:14.692006 24431 ts_tablet_manager.cc:1434] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:21:14.693171 24431 tablet_bootstrap.cc:492] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:14.693181 24428 tablet_bootstrap.cc:492] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:14.693993 24428 ts_tablet_manager.cc:1403] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.005s
I20260709 13:21:14.696530 24429 tablet_bootstrap.cc:654] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.696991 24428 raft_consensus.cc:359] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:14.698432 24428 raft_consensus.cc:385] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.701030 24428 raft_consensus.cc:740] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.699977 24430 ts_tablet_manager.cc:1434] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:21:14.704069 24430 tablet_bootstrap.cc:492] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:14.703605 24428 consensus_queue.cc:260] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:14.707149 24428 ts_tablet_manager.cc:1434] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:21:14.708967 24428 tablet_bootstrap.cc:492] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3: Bootstrap starting.
I20260709 13:21:14.707175 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a82f5a216984c39907a5b48bbd3b560" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:14.713474 24430 tablet_bootstrap.cc:654] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.713213 24306 raft_consensus.cc:2468] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:14.699242 24431 tablet_bootstrap.cc:654] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.715412 24428 tablet_bootstrap.cc:654] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.702579 24200 leader_election.cc:304] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:14.717358 24732 raft_consensus.cc:2804] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:14.718014 24773 consensus_queue.cc:1048] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:14.718238 24732 raft_consensus.cc:493] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:14.719480 24732 raft_consensus.cc:3060] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:14.727625 24773 raft_consensus.cc:493] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.727290 24058 catalog_manager.cc:5697] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.728227 24773 raft_consensus.cc:515] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:14.730234 24227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80418d8094044258597b8ab9021a04e" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:14.730568 24773 leader_election.cc:290] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:14.718411 24346 leader_election.cc:304] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:14.731949 24772 raft_consensus.cc:2804] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:14.732529 24772 raft_consensus.cc:493] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:14.732888 24772 raft_consensus.cc:3060] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.737751 24773 raft_consensus.cc:493] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.738325 24773 raft_consensus.cc:515] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.740574 24773 leader_election.cc:290] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:14.742343 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf4040b9d0747039fdf29b8fa99d02c" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:14.743793 24348 leader_election.cc:343] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.744592 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80418d8094044258597b8ab9021a04e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:14.745205 24307 raft_consensus.cc:2468] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:14.748528 24227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80418d8094044258597b8ab9021a04e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:14.748840 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf4040b9d0747039fdf29b8fa99d02c" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:14.749500 24232 raft_consensus.cc:2468] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:14.750420 24346 leader_election.cc:304] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:14.751153 24796 raft_consensus.cc:2804] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:14.751488 24156 raft_consensus.cc:3060] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.751525 24796 raft_consensus.cc:493] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:14.752174 24796 raft_consensus.cc:3060] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:14.752812 24272 leader_election.cc:343] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.753407 24272 leader_election.cc:304] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
W20260709 13:21:14.754861 24200 leader_election.cc:343] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.754920 24726 raft_consensus.cc:2749] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:14.761098 24709 consensus_queue.cc:1048] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:14.763546 24796 raft_consensus.cc:515] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:14.804075 24796 leader_election.cc:290] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:14.805346 24431 tablet_bootstrap.cc:492] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:14.805886 24431 ts_tablet_manager.cc:1403] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.113s	user 0.015s	sys 0.001s
I20260709 13:21:14.773283 24732 raft_consensus.cc:515] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.808593 24431 raft_consensus.cc:359] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.809191 24431 raft_consensus.cc:385] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.809373 24431 raft_consensus.cc:740] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.810161 24732 leader_election.cc:290] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 2 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
W20260709 13:21:14.774201 24346 leader_election.cc:343] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.809918 24431 consensus_queue.cc:260] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.811383 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:14.811991 24379 raft_consensus.cc:3060] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:14.812403 24431 ts_tablet_manager.cc:1434] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:14.812559 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:14.776244 24772 raft_consensus.cc:515] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.778872 24056 catalog_manager.cc:5697] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.813645 24431 tablet_bootstrap.cc:492] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:14.813911 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80418d8094044258597b8ab9021a04e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:14.780061 24428 tablet_bootstrap.cc:492] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3: No bootstrap required, opened a new log
I20260709 13:21:14.815068 24428 ts_tablet_manager.cc:1403] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.008s
I20260709 13:21:14.817162 24304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80418d8094044258597b8ab9021a04e" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:14.817874 24304 raft_consensus.cc:3060] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.817809 24428 raft_consensus.cc:359] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.818651 24428 raft_consensus.cc:385] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.818925 24428 raft_consensus.cc:740] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.820190 24428 consensus_queue.cc:260] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.822984 24428 ts_tablet_manager.cc:1434] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:21:14.823771 24431 tablet_bootstrap.cc:654] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.827847 24805 consensus_queue.cc:1048] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:14.825779 24057 catalog_manager.cc:5697] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.843001 24054 catalog_manager.cc:5697] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.786453 24430 tablet_bootstrap.cc:492] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:14.798300 24429 tablet_bootstrap.cc:492] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:14.850414 24429 ts_tablet_manager.cc:1403] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.189s	user 0.010s	sys 0.008s
I20260709 13:21:14.852746 24772 leader_election.cc:290] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:14.850414 24430 ts_tablet_manager.cc:1403] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.147s	user 0.014s	sys 0.000s
I20260709 13:21:14.853067 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a82f5a216984c39907a5b48bbd3b560" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:14.853319 24429 raft_consensus.cc:359] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.854868 24429 raft_consensus.cc:385] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.855197 24429 raft_consensus.cc:740] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
W20260709 13:21:14.855435 24348 leader_election.cc:343] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.856170 24430 raft_consensus.cc:359] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.856849 24430 raft_consensus.cc:385] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.857110 24430 raft_consensus.cc:740] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.813232 24155 raft_consensus.cc:3060] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:14.858371 24429 consensus_queue.cc:260] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.860971 24429 ts_tablet_manager.cc:1434] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:14.801710 24709 consensus_queue.cc:1048] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:14.863722 24429 tablet_bootstrap.cc:492] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:14.866966 24379 raft_consensus.cc:2468] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 2.
I20260709 13:21:14.867923 24304 raft_consensus.cc:2468] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:14.871368 24431 tablet_bootstrap.cc:492] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:14.887192 24200 leader_election.cc:304] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:14.881270 24155 raft_consensus.cc:2468] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 2.
I20260709 13:21:14.857758 24430 consensus_queue.cc:260] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.888248 24732 raft_consensus.cc:2804] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:14.888837 24732 raft_consensus.cc:697] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:14.889988 24429 tablet_bootstrap.cc:654] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.890372 24431 ts_tablet_manager.cc:1403] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.073s	user 0.022s	sys 0.032s
I20260709 13:21:14.889863 24732 consensus_queue.cc:237] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:14.863054 24346 leader_election.cc:304] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:14.892972 24819 raft_consensus.cc:2804] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:14.893354 24819 raft_consensus.cc:493] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:14.893682 24819 raft_consensus.cc:3060] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.898151 24431 raft_consensus.cc:359] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.899849 24431 raft_consensus.cc:385] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.900205 24431 raft_consensus.cc:740] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.901095 24431 consensus_queue.cc:260] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.905280 24431 ts_tablet_manager.cc:1434] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:21:14.909451 24431 tablet_bootstrap.cc:492] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
W20260709 13:21:14.911914 24346 leader_election.cc:343] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.916810 24431 tablet_bootstrap.cc:654] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.918496 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a82f5a216984c39907a5b48bbd3b560" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:14.919178 24306 raft_consensus.cc:3060] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.921417 24829 raft_consensus.cc:493] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.922205 24829 raft_consensus.cc:515] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.925683 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc10ce2783b74de384326c27984c7e92" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
W20260709 13:21:14.927089 24274 leader_election.cc:343] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.929244 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc10ce2783b74de384326c27984c7e92" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:14.937036 24274 leader_election.cc:343] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.938789 24274 leader_election.cc:304] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:14.889846 24430 ts_tablet_manager.cc:1434] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:21:14.941727 24715 raft_consensus.cc:2749] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:14.927043 24829 leader_election.cc:290] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:14.945585 24346 leader_election.cc:304] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:14.949090 24772 raft_consensus.cc:2804] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:14.950178 24772 raft_consensus.cc:697] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:14.951203 24772 consensus_queue.cc:237] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:14.941893 24430 tablet_bootstrap.cc:492] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
W20260709 13:21:14.967125 24274 consensus_peers.cc:597] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:14.976035 24431 tablet_bootstrap.cc:492] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:14.987598 24431 ts_tablet_manager.cc:1403] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.001s
I20260709 13:21:14.989964 24054 catalog_manager.cc:5697] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 2, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 2 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.992595 24431 raft_consensus.cc:359] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:14.994180 24431 raft_consensus.cc:385] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.994899 24431 raft_consensus.cc:740] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.998389 24431 consensus_queue.cc:260] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
W20260709 13:21:15.007791 24346 consensus_peers.cc:597] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:14.969492 24819 raft_consensus.cc:515] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.020128 24819 leader_election.cc:290] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:15.020995 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf4040b9d0747039fdf29b8fa99d02c" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:15.021847 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf4040b9d0747039fdf29b8fa99d02c" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
W20260709 13:21:15.022341 24348 leader_election.cc:343] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.024060 24232 raft_consensus.cc:3060] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.040109 24431 ts_tablet_manager.cc:1434] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 13:21:15.041432 24431 tablet_bootstrap.cc:492] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:15.043363 24429 tablet_bootstrap.cc:492] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:15.043952 24429 ts_tablet_manager.cc:1403] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.182s	user 0.038s	sys 0.075s
I20260709 13:21:15.046680 24232 raft_consensus.cc:2468] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:15.046998 24057 catalog_manager.cc:5697] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:15.047015 24429 raft_consensus.cc:359] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:15.049243 24429 raft_consensus.cc:385] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.049505 24429 raft_consensus.cc:740] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.050804 24346 leader_election.cc:304] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:15.052328 24429 consensus_queue.cc:260] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:15.052809 24772 raft_consensus.cc:2804] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:15.053472 24772 raft_consensus.cc:697] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:15.054280 24772 consensus_queue.cc:237] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.059892 24817 raft_consensus.cc:493] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.060492 24817 raft_consensus.cc:515] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.060886 24306 raft_consensus.cc:2468] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:15.063151 24346 leader_election.cc:304] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:15.065930 24429 ts_tablet_manager.cc:1434] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:21:15.068825 24817 leader_election.cc:290] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:15.071527 24572 raft_consensus.cc:2804] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:15.072111 24572 raft_consensus.cc:697] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:15.072569 24429 tablet_bootstrap.cc:492] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:15.074576 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd9769488e4db0bf3addb6ae875e51" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:15.075306 24379 raft_consensus.cc:2468] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:15.071355 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd9769488e4db0bf3addb6ae875e51" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:15.077898 24431 tablet_bootstrap.cc:654] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.079475 24200 leader_election.cc:304] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:15.081101 24817 raft_consensus.cc:2804] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.081512 24817 raft_consensus.cc:493] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.081885 24817 raft_consensus.cc:3060] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.082253 24156 raft_consensus.cc:2468] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:15.083302 24573 consensus_queue.cc:1048] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:15.078393 24572 consensus_queue.cc:237] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:15.087610 24829 raft_consensus.cc:493] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.088632 24829 raft_consensus.cc:515] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.090251 24430 tablet_bootstrap.cc:654] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.090926 24829 leader_election.cc:290] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:15.092738 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7548eaeb146eeb29df319abe407f5" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
W20260709 13:21:15.094138 24274 leader_election.cc:343] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.106141 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7548eaeb146eeb29df319abe407f5" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:15.097470 24829 raft_consensus.cc:493] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.097977 24817 raft_consensus.cc:515] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.117691 24817 leader_election.cc:290] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:15.119521 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd9769488e4db0bf3addb6ae875e51" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:15.119936 24158 raft_consensus.cc:3060] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.120205 24379 raft_consensus.cc:3060] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.123078 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd9769488e4db0bf3addb6ae875e51" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:15.123801 24155 raft_consensus.cc:3060] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:15.110476 24272 leader_election.cc:343] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.126140 24272 leader_election.cc:304] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:15.127737 24726 raft_consensus.cc:2749] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:15.129061 24829 raft_consensus.cc:515] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:15.135212 24154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b893af727e4323b5c5f832d0b543a0" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:15.138767 24274 leader_election.cc:343] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.142933 24379 raft_consensus.cc:2468] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:15.152105 24056 catalog_manager.cc:5697] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:15.154390 24829 leader_election.cc:290] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:15.161927 24200 leader_election.cc:304] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 
I20260709 13:21:15.159826 24832 consensus_queue.cc:1048] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:21:15.173115 24227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b893af727e4323b5c5f832d0b543a0" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:15.158665 24715 consensus_queue.cc:1048] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:21:15.165556 24817 raft_consensus.cc:2804] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:15.185715 24155 raft_consensus.cc:2468] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:15.180953 24817 raft_consensus.cc:697] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:15.188449 24817 consensus_queue.cc:237] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.193940 24832 consensus_queue.cc:1048] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:15.195677 24431 tablet_bootstrap.cc:492] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:15.196240 24431 ts_tablet_manager.cc:1403] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.002s
I20260709 13:21:15.203862 24572 raft_consensus.cc:493] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.204613 24572 raft_consensus.cc:515] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:15.209748 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc10ce2783b74de384326c27984c7e92" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:15.211541 24431 raft_consensus.cc:359] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.212098 24429 tablet_bootstrap.cc:654] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:15.212201 24348 leader_election.cc:343] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.209940 24572 leader_election.cc:290] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:15.217839 24057 catalog_manager.cc:5697] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:15.222819 24430 tablet_bootstrap.cc:492] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:15.223362 24430 ts_tablet_manager.cc:1403] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.282s	user 0.013s	sys 0.032s
I20260709 13:21:15.212381 24431 raft_consensus.cc:385] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.226640 24430 raft_consensus.cc:359] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.227226 24431 raft_consensus.cc:740] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.227432 24430 raft_consensus.cc:385] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.227727 24430 raft_consensus.cc:740] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.228518 24430 consensus_queue.cc:260] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.228724 24431 consensus_queue.cc:260] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.233398 24431 ts_tablet_manager.cc:1434] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.002s
I20260709 13:21:15.236111 24819 raft_consensus.cc:493] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.236778 24819 raft_consensus.cc:515] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.240152 24155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a7bb0565468ebd309763754a3d4c" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:15.240857 24227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a7bb0565468ebd309763754a3d4c" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
W20260709 13:21:15.241725 24348 leader_election.cc:343] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:15.242463 24346 leader_election.cc:343] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.242897 24346 leader_election.cc:304] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:15.243782 24572 raft_consensus.cc:2749] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:15.245949 24272 leader_election.cc:343] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.247536 24272 leader_election.cc:304] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:15.249120 24861 raft_consensus.cc:2749] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:15.249250 24819 leader_election.cc:290] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:15.252601 24430 ts_tablet_manager.cc:1434] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
W20260709 13:21:15.254568 24274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:39703, user_credentials={real_user=slave}} blocked reactor thread for 87355.8us
I20260709 13:21:15.255216 24057 catalog_manager.cc:5697] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:15.257859 24431 tablet_bootstrap.cc:492] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb: Bootstrap starting.
I20260709 13:21:15.258574 24430 tablet_bootstrap.cc:492] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:15.271165 24430 tablet_bootstrap.cc:654] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.307009 24430 tablet_bootstrap.cc:492] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:15.308931 24430 ts_tablet_manager.cc:1403] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.008s
I20260709 13:21:15.322336 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc10ce2783b74de384326c27984c7e92" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:15.323004 24307 raft_consensus.cc:2468] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:15.333907 24430 raft_consensus.cc:359] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.349695 24430 raft_consensus.cc:385] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.350040 24430 raft_consensus.cc:740] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.350749 24430 consensus_queue.cc:260] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.352836 24430 ts_tablet_manager.cc:1434] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.000s
I20260709 13:21:15.345597 24431 tablet_bootstrap.cc:654] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.356303 24430 tablet_bootstrap.cc:492] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:15.348191 24429 tablet_bootstrap.cc:492] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:15.358009 24429 ts_tablet_manager.cc:1403] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.286s	user 0.016s	sys 0.015s
I20260709 13:21:15.361495 24346 leader_election.cc:304] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:15.361251 24429 raft_consensus.cc:359] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.362308 24429 raft_consensus.cc:385] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.363667 24819 raft_consensus.cc:2804] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.364151 24819 raft_consensus.cc:493] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.364511 24819 raft_consensus.cc:3060] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.369692 24430 tablet_bootstrap.cc:654] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.373066 24431 tablet_bootstrap.cc:492] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb: No bootstrap required, opened a new log
I20260709 13:21:15.373584 24431 ts_tablet_manager.cc:1403] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent bootstrapping tablet: real 0.116s	user 0.013s	sys 0.000s
I20260709 13:21:15.376389 24431 raft_consensus.cc:359] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.377084 24431 raft_consensus.cc:385] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.377344 24431 raft_consensus.cc:740] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.381624 24431 consensus_queue.cc:260] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.384449 24431 ts_tablet_manager.cc:1434] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:21:15.387353 24430 tablet_bootstrap.cc:492] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:15.388037 24430 ts_tablet_manager.cc:1403] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.001s
I20260709 13:21:15.391335 24772 raft_consensus.cc:493] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.391397 24430 raft_consensus.cc:359] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.391960 24772 raft_consensus.cc:515] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:15.392287 24430 raft_consensus.cc:385] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.392727 24430 raft_consensus.cc:740] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.393652 24430 consensus_queue.cc:260] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.395761 24430 ts_tablet_manager.cc:1434] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:15.396831 24430 tablet_bootstrap.cc:492] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:15.398458 24772 leader_election.cc:290] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:15.400224 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8d5d925cdf4b799f067f0763e2b3af" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:15.402498 24348 leader_election.cc:343] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.403138 24430 tablet_bootstrap.cc:654] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.406397 24381 raft_consensus.cc:1275] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 3e96a35df00e4646b9c6e356c6fb4bba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:15.408535 24831 consensus_queue.cc:1048] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:15.414283 24232 raft_consensus.cc:3060] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.414537 24430 tablet_bootstrap.cc:492] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:15.415138 24430 ts_tablet_manager.cc:1403] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:21:15.418658 24430 raft_consensus.cc:359] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:15.419512 24430 raft_consensus.cc:385] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.419766 24430 raft_consensus.cc:740] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.420454 24430 consensus_queue.cc:260] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:15.362754 24429 raft_consensus.cc:740] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.422422 24430 ts_tablet_manager.cc:1434] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:15.422680 24429 consensus_queue.cc:260] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.423429 24430 tablet_bootstrap.cc:492] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:15.429829 24819 raft_consensus.cc:515] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:15.439611 24564 raft_consensus.cc:493] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.439849 24430 tablet_bootstrap.cc:654] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.440222 24564 raft_consensus.cc:515] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.443032 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8d5d925cdf4b799f067f0763e2b3af" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:15.443743 24306 raft_consensus.cc:2468] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:15.443868 24564 leader_election.cc:290] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:15.430992 24832 raft_consensus.cc:493] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.445868 24832 raft_consensus.cc:515] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.452250 24832 leader_election.cc:290] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:15.463292 24429 ts_tablet_manager.cc:1434] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.105s	user 0.003s	sys 0.004s
W20260709 13:21:15.480023 24198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:46833, user_credentials={real_user=slave}} blocked reactor thread for 52952.7us
I20260709 13:21:15.485874 24346 leader_election.cc:304] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:15.490373 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80418d8094044258597b8ab9021a04e" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:15.491293 24307 raft_consensus.cc:2393] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e96a35df00e4646b9c6e356c6fb4bba in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:15.494230 24573 raft_consensus.cc:2804] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.495012 24573 raft_consensus.cc:493] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.495463 24573 raft_consensus.cc:3060] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.484077 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf4040b9d0747039fdf29b8fa99d02c" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:15.512701 24819 leader_election.cc:290] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:15.514302 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc10ce2783b74de384326c27984c7e92" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
W20260709 13:21:15.515985 24348 leader_election.cc:343] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.516548 24156 raft_consensus.cc:1275] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Refusing update from remote peer 3e96a35df00e4646b9c6e356c6fb4bba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:15.518611 24231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf4040b9d0747039fdf29b8fa99d02c" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:15.519565 24231 raft_consensus.cc:2393] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:15.530678 24125 leader_election.cc:304] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:15.531858 24564 raft_consensus.cc:3060] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:15.537292 24348 consensus_peers.cc:597] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.538075 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80418d8094044258597b8ab9021a04e" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:15.534479 24573 raft_consensus.cc:515] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:15.543689 24772 raft_consensus.cc:493] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.544556 24772 raft_consensus.cc:515] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.543680 24564 raft_consensus.cc:2749] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:15.546268 24429 tablet_bootstrap.cc:492] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:15.547564 24772 leader_election.cc:290] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:15.549690 24573 leader_election.cc:290] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
W20260709 13:21:15.539018 24274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:44365, user_credentials={real_user=slave}} blocked reactor thread for 57626.7us
I20260709 13:21:15.563512 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8d5d925cdf4b799f067f0763e2b3af" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:15.563599 24831 raft_consensus.cc:493] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:15.565879 24348 leader_election.cc:343] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.565886 24831 raft_consensus.cc:515] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.568621 24831 leader_election.cc:290] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:15.569614 24429 tablet_bootstrap.cc:654] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.569917 24817 consensus_queue.cc:1048] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:15.573463 24430 tablet_bootstrap.cc:492] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:15.573930 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7548eaeb146eeb29df319abe407f5" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:15.574203 24430 ts_tablet_manager.cc:1403] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.151s	user 0.056s	sys 0.057s
I20260709 13:21:15.573377 24231 raft_consensus.cc:3060] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.574638 24232 raft_consensus.cc:2468] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:15.577363 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc10ce2783b74de384326c27984c7e92" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:15.578092 24306 raft_consensus.cc:3060] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.580261 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7548eaeb146eeb29df319abe407f5" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:15.582455 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7548eaeb146eeb29df319abe407f5" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:15.585692 24306 raft_consensus.cc:2468] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:15.586475 24307 raft_consensus.cc:2468] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:15.583590 24429 tablet_bootstrap.cc:492] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:15.584578 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7548eaeb146eeb29df319abe407f5" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:15.587949 24309 raft_consensus.cc:2468] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:15.588119 24430 raft_consensus.cc:359] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.588968 24430 raft_consensus.cc:385] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.589282 24430 raft_consensus.cc:740] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.590011 24430 consensus_queue.cc:260] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.591630 24346 leader_election.cc:304] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:15.592005 24430 ts_tablet_manager.cc:1434] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:21:15.585652 24200 leader_election.cc:304] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:15.586477 24304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8d5d925cdf4b799f067f0763e2b3af" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:15.592823 24304 raft_consensus.cc:3060] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.593619 24430 tablet_bootstrap.cc:492] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:15.594103 24819 raft_consensus.cc:2804] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:15.594655 24819 raft_consensus.cc:697] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:15.595574 24819 consensus_queue.cc:237] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:15.601089 24346 leader_election.cc:304] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:15.601905 24430 tablet_bootstrap.cc:654] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.611538 24304 raft_consensus.cc:2468] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:15.588382 24379 raft_consensus.cc:2468] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:15.613492 24772 raft_consensus.cc:2804] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.614113 24429 ts_tablet_manager.cc:1403] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.149s	user 0.018s	sys 0.000s
I20260709 13:21:15.615633 24772 raft_consensus.cc:493] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.616176 24772 raft_consensus.cc:3060] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.622500 24198 leader_election.cc:304] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:15.623469 24709 raft_consensus.cc:2804] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.623852 24709 raft_consensus.cc:493] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.624228 24709 raft_consensus.cc:3060] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.624985 24773 consensus_queue.cc:1048] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:15.641495 24429 raft_consensus.cc:359] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:15.642413 24429 raft_consensus.cc:385] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.642674 24429 raft_consensus.cc:740] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.647189 24429 consensus_queue.cc:260] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:15.652601 24346 leader_election.cc:304] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:15.655766 24573 raft_consensus.cc:2804] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:15.656267 24573 raft_consensus.cc:697] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:15.657048 24573 consensus_queue.cc:237] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:15.666152 24831 raft_consensus.cc:493] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.666745 24831 raft_consensus.cc:515] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:15.678098 24831 leader_election.cc:290] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:15.680867 24572 raft_consensus.cc:493] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.639742 24773 consensus_queue.cc:1048] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:21:15.681414 24572 raft_consensus.cc:515] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.693131 24429 ts_tablet_manager.cc:1434] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.001s
I20260709 13:21:15.705521 24572 leader_election.cc:290] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:15.714272 24429 tablet_bootstrap.cc:492] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:15.715684 24430 tablet_bootstrap.cc:492] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:15.716184 24430 ts_tablet_manager.cc:1403] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.123s	user 0.046s	sys 0.027s
I20260709 13:21:15.724506 24157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa056dad41df4537ab48328b7221c6cc" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:15.718470 24304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacd8d22901e4b63b728d0d94e835a27" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:15.754421 24304 raft_consensus.cc:2468] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
W20260709 13:21:15.758805 24348 leader_election.cc:343] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.761710 24056 catalog_manager.cc:5697] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:15.776096 24877 consensus_queue.cc:1048] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:15.743556 24772 raft_consensus.cc:515] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.779713 24772 leader_election.cc:290] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:15.738593 24817 raft_consensus.cc:2749] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:15.781648 24817 consensus_queue.cc:1048] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:15.750504 24154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacd8d22901e4b63b728d0d94e835a27" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:15.722695 24229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa056dad41df4537ab48328b7221c6cc" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:15.788341 24429 tablet_bootstrap.cc:654] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.801340 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7548eaeb146eeb29df319abe407f5" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:15.802215 24306 raft_consensus.cc:3060] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.806856 24709 raft_consensus.cc:515] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.811645 24306 raft_consensus.cc:2468] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
W20260709 13:21:15.828383 24198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:46833, user_credentials={real_user=slave}} blocked reactor thread for 93863.1us
I20260709 13:21:15.831262 24346 leader_election.cc:304] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:15.809363 24229 raft_consensus.cc:2468] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 0.
I20260709 13:21:15.835634 24573 raft_consensus.cc:2804] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:15.800153 24831 consensus_queue.cc:1048] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
W20260709 13:21:15.841784 24200 leader_election.cc:343] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.843569 24198 leader_election.cc:304] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
W20260709 13:21:15.866478 24106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:15.876222 24888 raft_consensus.cc:2804] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.876924 24888 raft_consensus.cc:493] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.877355 24888 raft_consensus.cc:3060] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.838702 24796 consensus_queue.cc:1048] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:21:15.881238 24430 raft_consensus.cc:359] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:15.885797 24430 raft_consensus.cc:385] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.886487 24430 raft_consensus.cc:740] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.849623 24772 consensus_queue.cc:1048] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:21:15.868748 24231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7548eaeb146eeb29df319abe407f5" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:15.898209 24430 consensus_queue.cc:260] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
W20260709 13:21:15.907073 24346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:34445, user_credentials={real_user=slave}} blocked reactor thread for 74325.1us
I20260709 13:21:15.911099 24430 ts_tablet_manager.cc:1434] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.195s	user 0.010s	sys 0.000s
I20260709 13:21:15.904676 24573 raft_consensus.cc:697] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:15.914166 24346 leader_election.cc:304] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
W20260709 13:21:15.915647 24200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.68:44365, user_credentials={real_user=slave}} blocked reactor thread for 61410us
I20260709 13:21:15.895197 24709 leader_election.cc:290] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:15.934110 24898 raft_consensus.cc:2804] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.916219 24573 consensus_queue.cc:237] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:15.960562 24898 raft_consensus.cc:493] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.965988 24898 raft_consensus.cc:3060] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.961517 24231 raft_consensus.cc:2393] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 96be869fbe4e464a99c0d5aa3d90dbfb in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
I20260709 13:21:15.929450 24797 raft_consensus.cc:493] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.990847 24429 tablet_bootstrap.cc:492] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:15.991636 24429 ts_tablet_manager.cc:1403] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.283s	user 0.017s	sys 0.012s
W20260709 13:21:15.970870 24890 log.cc:927] Time spent T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3: Append to log took a long time: real 0.162s	user 0.000s	sys 0.002s
I20260709 13:21:15.970428 24304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7548eaeb146eeb29df319abe407f5" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
W20260709 13:21:16.017669 24200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.65:39703, user_credentials={real_user=slave}} blocked reactor thread for 99538.3us
I20260709 13:21:16.022642 24304 raft_consensus.cc:2393] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e96a35df00e4646b9c6e356c6fb4bba in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:15.986672 24797 raft_consensus.cc:515] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:16.024281 24158 raft_consensus.cc:3060] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.025452 24797 leader_election.cc:290] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:16.034963 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48bb74e965d44649059c6cbae8878b9" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:16.047475 24888 raft_consensus.cc:515] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:16.042171 24429 raft_consensus.cc:359] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:16.067224 24429 raft_consensus.cc:385] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.067598 24429 raft_consensus.cc:740] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.049758 24888 leader_election.cc:290] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:16.070272 24306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48bb74e965d44649059c6cbae8878b9" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:16.078250 24123 leader_election.cc:304] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:16.082417 24429 consensus_queue.cc:260] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:16.096205 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacd8d22901e4b63b728d0d94e835a27" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:16.096873 24156 raft_consensus.cc:3060] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.099895 24898 raft_consensus.cc:515] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:16.101033 24430 tablet_bootstrap.cc:492] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba: Bootstrap starting.
I20260709 13:21:16.107779 24909 raft_consensus.cc:493] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.108402 24909 raft_consensus.cc:515] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:16.108824 24152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa056dad41df4537ab48328b7221c6cc" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:16.110759 24909 leader_election.cc:290] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
W20260709 13:21:16.115221 24348 leader_election.cc:343] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.121970 24898 leader_election.cc:290] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:16.124152 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bacd8d22901e4b63b728d0d94e835a27" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:16.124938 24308 raft_consensus.cc:3060] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.125173 24430 tablet_bootstrap.cc:654] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.148020 24153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a7bb0565468ebd309763754a3d4c" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:16.150714 24200 leader_election.cc:343] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:16.177956 24346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:34445, user_credentials={real_user=slave}} blocked reactor thread for 45163.9us
I20260709 13:21:16.183951 24906 raft_consensus.cc:2749] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:16.189168 24429 ts_tablet_manager.cc:1434] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.197s	user 0.021s	sys 0.029s
I20260709 13:21:16.172307 24229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa056dad41df4537ab48328b7221c6cc" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:16.193624 24229 raft_consensus.cc:3060] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.206815 24308 raft_consensus.cc:2468] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:16.211547 24886 consensus_queue.cc:1048] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:16.231248 24429 tablet_bootstrap.cc:492] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
W20260709 13:21:16.234408 24348 consensus_peers.cc:597] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:16.235447 24348 consensus_peers.cc:597] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:16.225399 24198 leader_election.cc:304] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:16.241204 24832 raft_consensus.cc:2804] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:16.241789 24832 raft_consensus.cc:697] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:16.242722 24832 consensus_queue.cc:237] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:16.316704 24156 raft_consensus.cc:2468] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:16.316996 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7548eaeb146eeb29df319abe407f5" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:16.319062 24380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a7bb0565468ebd309763754a3d4c" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:16.319852 24380 raft_consensus.cc:2468] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:16.320142 24200 leader_election.cc:304] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:16.323211 24910 raft_consensus.cc:2749] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:16.291183 24229 raft_consensus.cc:2468] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:16.352545 24429 tablet_bootstrap.cc:654] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.354624 24573 consensus_queue.cc:1048] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:16.356475 24200 leader_election.cc:304] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
W20260709 13:21:16.362263 24918 log.cc:927] Time spent T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:21:16.360813 24831 raft_consensus.cc:2804] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:16.374454 24430 tablet_bootstrap.cc:492] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba: No bootstrap required, opened a new log
I20260709 13:21:16.375156 24430 ts_tablet_manager.cc:1403] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent bootstrapping tablet: real 0.274s	user 0.018s	sys 0.011s
I20260709 13:21:16.369210 24831 raft_consensus.cc:493] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.377136 24831 raft_consensus.cc:3060] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.392501 24430 raft_consensus.cc:359] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:16.393890 24430 raft_consensus.cc:385] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.394255 24430 raft_consensus.cc:740] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.394981 24430 consensus_queue.cc:260] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:16.366637 24346 leader_election.cc:304] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:16.438735 24573 raft_consensus.cc:2804] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:16.439229 24573 raft_consensus.cc:697] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:16.439955 24573 consensus_queue.cc:237] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
W20260709 13:21:16.442770 24346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:34445, user_credentials={real_user=slave}} blocked reactor thread for 76334.5us
I20260709 13:21:16.460834 24430 ts_tablet_manager.cc:1434] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.001s
I20260709 13:21:16.468106 24058 catalog_manager.cc:5697] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.475631 24058 catalog_manager.cc:5697] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:16.448760 24832 raft_consensus.cc:493] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.482247 24831 raft_consensus.cc:515] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:16.495239 24832 raft_consensus.cc:515] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:16.509203 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a7bb0565468ebd309763754a3d4c" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:16.510102 24382 raft_consensus.cc:3060] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.529036 24156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a7bb0565468ebd309763754a3d4c" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:16.529217 24916 consensus_queue.cc:1048] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:16.530864 24429 tablet_bootstrap.cc:492] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:16.531395 24429 ts_tablet_manager.cc:1403] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.300s	user 0.027s	sys 0.036s
W20260709 13:21:16.532883 24200 leader_election.cc:343] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.537215 24429 raft_consensus.cc:359] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:16.538546 24429 raft_consensus.cc:385] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.538834 24429 raft_consensus.cc:740] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.539443 24429 consensus_queue.cc:260] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:16.526539 24831 leader_election.cc:290] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:16.541874 24832 leader_election.cc:290] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:16.543658 24152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b893af727e4323b5c5f832d0b543a0" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:16.546314 24200 leader_election.cc:343] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.549741 24429 ts_tablet_manager.cc:1434] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:21:16.549284 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b893af727e4323b5c5f832d0b543a0" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:16.550597 24309 raft_consensus.cc:2468] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 0.
I20260709 13:21:16.551950 24198 leader_election.cc:304] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:16.552397 24429 tablet_bootstrap.cc:492] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:16.553551 24382 raft_consensus.cc:2468] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
I20260709 13:21:16.553551 24732 raft_consensus.cc:2804] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:16.561750 24732 raft_consensus.cc:493] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.562170 24732 raft_consensus.cc:3060] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.566807 24429 tablet_bootstrap.cc:654] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.577708 24732 raft_consensus.cc:515] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:16.582762 24732 leader_election.cc:290] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Requested vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:16.584664 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b893af727e4323b5c5f832d0b543a0" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:16.585465 24308 raft_consensus.cc:3060] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.580528 24429 tablet_bootstrap.cc:492] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:16.586702 24429 ts_tablet_manager.cc:1403] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.002s
I20260709 13:21:16.580235 24916 consensus_queue.cc:1048] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:16.587661 24056 catalog_manager.cc:5697] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.589663 24429 raft_consensus.cc:359] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:16.602977 24429 raft_consensus.cc:385] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.603106 24200 leader_election.cc:304] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:16.605269 24883 raft_consensus.cc:2804] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:16.605909 24883 raft_consensus.cc:697] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:16.606894 24883 consensus_queue.cc:237] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:16.603259 24429 raft_consensus.cc:740] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.610103 24429 consensus_queue.cc:260] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:16.613087 24429 ts_tablet_manager.cc:1434] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:21:16.614315 24429 tablet_bootstrap.cc:492] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:16.616118 24152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b893af727e4323b5c5f832d0b543a0" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:16.647778 24057 catalog_manager.cc:5697] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 1 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.653203 24308 raft_consensus.cc:2468] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 1.
W20260709 13:21:16.655236 24200 leader_election.cc:343] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.656351 24429 tablet_bootstrap.cc:654] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.661580 24198 leader_election.cc:304] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:16.662868 24831 raft_consensus.cc:2804] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:16.663348 24831 raft_consensus.cc:697] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:16.664192 24831 consensus_queue.cc:237] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:16.669183 24429 tablet_bootstrap.cc:492] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:16.670027 24429 ts_tablet_manager.cc:1403] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.012s
I20260709 13:21:16.673539 24429 raft_consensus.cc:359] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:16.674368 24429 raft_consensus.cc:385] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.674693 24429 raft_consensus.cc:740] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.675484 24429 consensus_queue.cc:260] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:16.677139 24913 raft_consensus.cc:493] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.677376 24429 ts_tablet_manager.cc:1434] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:21:16.677618 24913 raft_consensus.cc:515] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:16.678622 24429 tablet_bootstrap.cc:492] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:16.679876 24913 leader_election.cc:290] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:16.683945 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a82f5a216984c39907a5b48bbd3b560" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:16.685699 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a82f5a216984c39907a5b48bbd3b560" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:16.687150 24429 tablet_bootstrap.cc:654] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.690155 24123 leader_election.cc:304] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:16.693476 24913 raft_consensus.cc:2749] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:16.714562 24152 raft_consensus.cc:3060] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.716703 24892 consensus_queue.cc:1048] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:16.732956 24913 raft_consensus.cc:493] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.733589 24913 raft_consensus.cc:515] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:16.736269 24913 leader_election.cc:290] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:16.694540 24058 catalog_manager.cc:5697] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:16.739749 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa056dad41df4537ab48328b7221c6cc" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:16.745687 24732 consensus_queue.cc:1048] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:16.749063 24228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa056dad41df4537ab48328b7221c6cc" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:16.751807 24228 raft_consensus.cc:2393] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:16.761318 24123 leader_election.cc:304] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:16.771992 24797 raft_consensus.cc:3060] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.793817 24797 raft_consensus.cc:2749] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:16.806209 24797 raft_consensus.cc:493] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.806732 24797 raft_consensus.cc:515] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:16.825831 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a7bb0565468ebd309763754a3d4c" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:16.826715 24381 raft_consensus.cc:2393] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
I20260709 13:21:16.827616 24797 leader_election.cc:290] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:16.832762 24429 tablet_bootstrap.cc:492] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:16.833402 24429 ts_tablet_manager.cc:1403] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.155s	user 0.052s	sys 0.046s
I20260709 13:21:16.833747 24228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a7bb0565468ebd309763754a3d4c" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:16.835800 24123 leader_election.cc:304] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 96be869fbe4e464a99c0d5aa3d90dbfb
I20260709 13:21:16.836000 24429 raft_consensus.cc:359] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:16.836735 24429 raft_consensus.cc:385] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.837069 24429 raft_consensus.cc:740] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.837109 24797 raft_consensus.cc:3060] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.838090 24429 consensus_queue.cc:260] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:16.840952 24429 ts_tablet_manager.cc:1434] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:16.841984 24429 tablet_bootstrap.cc:492] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:16.845736 24797 raft_consensus.cc:2749] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:16.808672 24056 catalog_manager.cc:5697] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 1 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.849874 24429 tablet_bootstrap.cc:654] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.861102 24429 tablet_bootstrap.cc:492] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:16.861676 24429 ts_tablet_manager.cc:1403] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 13:21:16.866065 24429 raft_consensus.cc:359] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:16.867363 24429 raft_consensus.cc:385] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.867681 24429 raft_consensus.cc:740] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.869824 24429 consensus_queue.cc:260] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:16.872951 24429 ts_tablet_manager.cc:1434] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:21:16.885524 24429 tablet_bootstrap.cc:492] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:16.900190 24429 tablet_bootstrap.cc:654] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.903039 24916 consensus_queue.cc:1048] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:16.915678 24429 tablet_bootstrap.cc:492] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98: No bootstrap required, opened a new log
I20260709 13:21:16.916334 24429 ts_tablet_manager.cc:1403] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.001s
I20260709 13:21:16.919312 24429 raft_consensus.cc:359] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:16.920083 24429 raft_consensus.cc:385] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.920404 24429 raft_consensus.cc:740] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.921231 24429 consensus_queue.cc:260] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:16.923547 24429 ts_tablet_manager.cc:1434] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:16.930696 24916 consensus_queue.cc:1048] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:17.054557 24156 raft_consensus.cc:3060] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.066388 24797 raft_consensus.cc:493] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.066885 24797 raft_consensus.cc:515] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:17.070178 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc10ce2783b74de384326c27984c7e92" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:17.072103 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc10ce2783b74de384326c27984c7e92" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:17.074273 24797 leader_election.cc:290] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:17.075568 24123 leader_election.cc:304] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:17.077029 24797 raft_consensus.cc:2749] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.131237 24797 raft_consensus.cc:493] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.131731 24797 raft_consensus.cc:515] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:17.133671 24797 leader_election.cc:290] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:17.134577 24231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b893af727e4323b5c5f832d0b543a0" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" is_pre_election: true
I20260709 13:21:17.134954 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b893af727e4323b5c5f832d0b543a0" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:17.135860 24308 raft_consensus.cc:2393] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97e577a376c948bfac33665f06a4bb98 in current term 1: Already voted for candidate 3e96a35df00e4646b9c6e356c6fb4bba in this term.
I20260709 13:21:17.136953 24123 leader_election.cc:304] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:17.137184 24156 raft_consensus.cc:3060] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.144701 24797 raft_consensus.cc:2749] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.145810 24732 consensus_queue.cc:1048] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:17.164476 24831 consensus_queue.cc:1048] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:17.177867 24732 consensus_queue.cc:1048] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:17.215374 24883 consensus_queue.cc:1048] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:17.310179 24155 raft_consensus.cc:3060] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.305635 16329 tablet_server.cc:179] TabletServer@127.15.242.65:0 shutting down...
W20260709 13:21:18.318838 24348 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 343 similar messages]
W20260709 13:21:18.324973 24348 consensus_peers.cc:597] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.335026 24274 consensus_peers.cc:597] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.348270 24200 consensus_peers.cc:597] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.370954 24348 consensus_peers.cc:597] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.372059 24200 consensus_peers.cc:597] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.374619 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:18.375667 16329 tablet_replica.cc:333] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.376372 16329 raft_consensus.cc:2243] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.376854 16329 raft_consensus.cc:2272] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.379030 16329 tablet_replica.cc:333] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.379654 16329 raft_consensus.cc:2243] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.380190 16329 raft_consensus.cc:2272] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.382795 16329 tablet_replica.cc:333] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.383530 16329 raft_consensus.cc:2243] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.384294 16329 raft_consensus.cc:2272] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.386670 16329 tablet_replica.cc:333] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.387264 16329 raft_consensus.cc:2243] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.387696 16329 raft_consensus.cc:2272] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.389449 16329 tablet_replica.cc:333] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.390125 16329 raft_consensus.cc:2243] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.390556 16329 raft_consensus.cc:2272] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.392377 16329 tablet_replica.cc:333] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.393146 16329 raft_consensus.cc:2243] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.393610 16329 raft_consensus.cc:2272] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.395946 16329 tablet_replica.cc:333] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.396667 16329 raft_consensus.cc:2243] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.397168 16329 raft_consensus.cc:2272] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:18.397982 24200 consensus_peers.cc:597] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.399037 16329 tablet_replica.cc:333] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.399698 16329 raft_consensus.cc:2243] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.400190 16329 raft_consensus.cc:2272] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.402575 16329 tablet_replica.cc:333] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.403378 16329 raft_consensus.cc:2243] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.403863 16329 raft_consensus.cc:2272] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.405673 16329 tablet_replica.cc:333] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.406329 16329 raft_consensus.cc:2243] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.406749 16329 raft_consensus.cc:2272] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.408627 16329 tablet_replica.cc:333] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.409236 16329 raft_consensus.cc:2243] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.409672 16329 raft_consensus.cc:2272] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.411388 16329 tablet_replica.cc:333] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.411976 16329 raft_consensus.cc:2243] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.412374 16329 raft_consensus.cc:2272] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.414352 16329 tablet_replica.cc:333] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.415055 16329 raft_consensus.cc:2243] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.415580 16329 raft_consensus.cc:2272] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.417950 16329 tablet_replica.cc:333] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.418591 16329 raft_consensus.cc:2243] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.419023 16329 raft_consensus.cc:2272] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.420855 16329 tablet_replica.cc:333] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.421638 16329 raft_consensus.cc:2243] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.422259 16329 raft_consensus.cc:2272] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.425148 16329 tablet_replica.cc:333] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
W20260709 13:21:18.425935 24348 consensus_peers.cc:597] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.425954 16329 raft_consensus.cc:2243] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:21:18.426798 24274 consensus_peers.cc:597] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.427361 16329 raft_consensus.cc:2272] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.429955 16329 tablet_replica.cc:333] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.430572 16329 raft_consensus.cc:2243] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.430914 16329 raft_consensus.cc:2272] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.432762 16329 tablet_replica.cc:333] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.433462 16329 raft_consensus.cc:2243] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.433843 16329 raft_consensus.cc:2272] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.435843 16329 tablet_replica.cc:333] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.436559 16329 raft_consensus.cc:2243] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.437072 16329 raft_consensus.cc:2272] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.439361 16329 tablet_replica.cc:333] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
W20260709 13:21:18.440107 24348 consensus_peers.cc:597] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.440102 16329 raft_consensus.cc:2243] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.440832 16329 raft_consensus.cc:2272] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.443199 16329 tablet_replica.cc:333] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
W20260709 13:21:18.443297 24348 consensus_peers.cc:597] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.443888 16329 raft_consensus.cc:2243] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.444392 16329 raft_consensus.cc:2272] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.446455 16329 tablet_replica.cc:333] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.447069 16329 raft_consensus.cc:2243] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.448153 16329 raft_consensus.cc:2272] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.450877 16329 tablet_replica.cc:333] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.451781 16329 raft_consensus.cc:2243] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.452239 16329 raft_consensus.cc:2272] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.454656 16329 tablet_replica.cc:333] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.455488 16329 raft_consensus.cc:2243] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.456105 16329 raft_consensus.cc:2272] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:18.457974 24348 consensus_peers.cc:597] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.459002 16329 tablet_replica.cc:333] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.459627 16329 raft_consensus.cc:2243] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.460171 16329 raft_consensus.cc:2272] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.462268 16329 tablet_replica.cc:333] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.462921 16329 raft_consensus.cc:2243] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.463502 16329 raft_consensus.cc:2272] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.465739 16329 tablet_replica.cc:333] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.466411 16329 raft_consensus.cc:2243] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.466902 16329 raft_consensus.cc:2272] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.469238 16329 tablet_replica.cc:333] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.469856 16329 raft_consensus.cc:2243] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.470407 16329 raft_consensus.cc:2272] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.472443 16329 tablet_replica.cc:333] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.473104 16329 raft_consensus.cc:2243] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.473552 16329 raft_consensus.cc:2272] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.475915 16329 tablet_replica.cc:333] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.476701 16329 raft_consensus.cc:2243] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.477311 16329 raft_consensus.cc:2272] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:18.479616 24200 consensus_peers.cc:597] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.480013 16329 tablet_replica.cc:333] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.480667 16329 raft_consensus.cc:2243] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.481201 16329 raft_consensus.cc:2272] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.484190 16329 tablet_replica.cc:333] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.485031 16329 raft_consensus.cc:2243] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.485535 16329 raft_consensus.cc:2272] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:18.485677 24274 consensus_peers.cc:597] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.487532 16329 tablet_replica.cc:333] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.488068 16329 raft_consensus.cc:2243] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.488440 16329 raft_consensus.cc:2272] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.490455 16329 tablet_replica.cc:333] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.491382 16329 raft_consensus.cc:2243] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.491858 16329 raft_consensus.cc:2272] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.494064 16329 tablet_replica.cc:333] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
W20260709 13:21:18.494470 24200 consensus_peers.cc:597] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.494753 16329 raft_consensus.cc:2243] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:18.495797 16329 raft_consensus.cc:2272] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.498504 16329 tablet_replica.cc:333] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.499183 16329 raft_consensus.cc:2243] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.499658 16329 raft_consensus.cc:2272] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:18.499832 24348 consensus_peers.cc:597] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.501808 16329 tablet_replica.cc:333] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.502458 16329 raft_consensus.cc:2243] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.502923 16329 raft_consensus.cc:2272] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.505393 16329 tablet_replica.cc:333] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.506376 16329 raft_consensus.cc:2243] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.506857 16329 raft_consensus.cc:2272] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.508700 16329 tablet_replica.cc:333] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.509240 16329 raft_consensus.cc:2243] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.509649 16329 raft_consensus.cc:2272] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.511565 16329 tablet_replica.cc:333] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.512092 16329 raft_consensus.cc:2243] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.512523 16329 raft_consensus.cc:2272] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.514532 16329 tablet_replica.cc:333] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.515200 16329 raft_consensus.cc:2243] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.515799 16329 raft_consensus.cc:2272] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.518524 16329 tablet_replica.cc:333] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.519047 16329 raft_consensus.cc:2243] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:18.520000 16329 raft_consensus.cc:2272] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.522543 16329 tablet_replica.cc:333] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.523176 16329 raft_consensus.cc:2243] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.523710 16329 raft_consensus.cc:2272] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.526301 16329 tablet_replica.cc:333] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.526971 16329 raft_consensus.cc:2243] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.527462 16329 raft_consensus.cc:2272] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:18.530126 16329 tablet_replica.cc:333] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98: stopping tablet replica
I20260709 13:21:18.530754 16329 raft_consensus.cc:2243] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:18.531232 16329 raft_consensus.cc:2272] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:18.536233 24200 consensus_peers.cc:597] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.579574 24200 consensus_peers.cc:597] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.597890 24125 connection.cc:466] server connection from 127.0.0.1:46590 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46590 (request call id 272) could send its response
W20260709 13:21:18.600843 24200 connection.cc:769] client connection to 127.15.242.65:39703 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:21:18.602453 24200 consensus_peers.cc:597] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.609751 24348 consensus_peers.cc:597] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.617304 24200 consensus_peers.cc:597] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.619328 16329 tablet_server.cc:196] TabletServer@127.15.242.65:0 shutdown complete.
W20260709 13:21:18.620143 24200 consensus_peers.cc:597] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.621086 24274 consensus_peers.cc:597] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.621594 24274 consensus_peers.cc:597] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.625391 24200 consensus_peers.cc:597] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.625938 24200 consensus_peers.cc:597] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.626349 24200 consensus_peers.cc:597] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.631034 24200 consensus_peers.cc:597] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.648550 24274 consensus_peers.cc:597] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.664988 24348 consensus_peers.cc:597] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.671698 24200 consensus_peers.cc:597] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.684615 24348 consensus_peers.cc:597] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.685321 24348 consensus_peers.cc:597] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.687721 24348 consensus_peers.cc:597] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.703950 24200 consensus_peers.cc:597] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.710868 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:18.718298 24962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:18.720320 24963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:18.724740 24965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:18.729483 16329 server_base.cc:1061] running on GCE node
W20260709 13:21:18.732916 24348 consensus_peers.cc:597] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.733306 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:18.733680 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:18.733950 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603278733927 us; error 0 us; skew 500 ppm
I20260709 13:21:18.734786 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:18.739317 16329 webserver.cc:533] Webserver started at http://127.15.242.65:41997/ using document root <none> and password file <none>
I20260709 13:21:18.739887 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:18.740132 16329 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:21:18.744377 24348 consensus_peers.cc:597] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.744937 16329 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:21:18.756704 24971 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260709 13:21:18.760607 24348 consensus_peers.cc:597] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.760922 16329 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:21:18.761365 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-0-root
uuid: "97e577a376c948bfac33665f06a4bb98"
format_stamp: "Formatted at 2026-07-09 13:21:05 on dist-test-slave-fh5z"
I20260709 13:21:18.761785 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603035614178-16329-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:21:18.787339 24348 consensus_peers.cc:597] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.793709 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:18.795680 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:18.798038 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:21:18.803593 24348 consensus_peers.cc:597] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.805840 24978 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:21:18.808151 24200 consensus_peers.cc:597] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.827035 24200 consensus_peers.cc:597] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.834123 24274 consensus_peers.cc:597] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:19.260980 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:21:19.261447 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.457s	user 0.010s	sys 0.000s
I20260709 13:21:19.261793 16329 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:21:19.270476 24978 tablet_bootstrap.cc:492] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.286823 24978 tablet_bootstrap.cc:492] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.287839 24978 tablet_bootstrap.cc:492] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.288534 24978 ts_tablet_manager.cc:1403] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:21:19.291323 24978 raft_consensus.cc:359] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.292112 24978 raft_consensus.cc:740] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.292914 24978 consensus_queue.cc:260] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.295324 24978 ts_tablet_manager.cc:1434] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:21:19.296067 24978 tablet_bootstrap.cc:492] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.311501 24978 tablet_bootstrap.cc:492] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.312314 24978 tablet_bootstrap.cc:492] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.312887 24978 ts_tablet_manager.cc:1403] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:21:19.314709 24978 raft_consensus.cc:359] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.315191 24978 raft_consensus.cc:740] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.315790 24978 consensus_queue.cc:260] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.317291 24978 ts_tablet_manager.cc:1434] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:19.318003 24978 tablet_bootstrap.cc:492] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.330444 24978 tablet_bootstrap.cc:492] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.331377 24978 tablet_bootstrap.cc:492] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.332033 24978 ts_tablet_manager.cc:1403] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:21:19.334192 24978 raft_consensus.cc:359] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.334729 24978 raft_consensus.cc:740] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.335318 24978 consensus_queue.cc:260] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.336961 24978 ts_tablet_manager.cc:1434] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:19.337729 24978 tablet_bootstrap.cc:492] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.354141 24978 tablet_bootstrap.cc:492] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.355085 24978 tablet_bootstrap.cc:492] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.355679 24978 ts_tablet_manager.cc:1403] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:21:19.357975 24978 raft_consensus.cc:359] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:19.358711 24978 raft_consensus.cc:740] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.363524 24978 consensus_queue.cc:260] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:19.365510 24978 ts_tablet_manager.cc:1434] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:21:19.366360 24978 tablet_bootstrap.cc:492] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.401078 24978 tablet_bootstrap.cc:492] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.402163 24978 tablet_bootstrap.cc:492] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.402765 24978 ts_tablet_manager.cc:1403] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.005s
I20260709 13:21:19.406710 24978 raft_consensus.cc:359] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.407524 24978 raft_consensus.cc:740] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.408116 24978 consensus_queue.cc:260] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.409747 24978 ts_tablet_manager.cc:1434] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:21:19.410583 24978 tablet_bootstrap.cc:492] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.426499 24978 tablet_bootstrap.cc:492] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.427520 24978 tablet_bootstrap.cc:492] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.428220 24978 ts_tablet_manager.cc:1403] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:21:19.430845 24978 raft_consensus.cc:359] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.431581 24978 raft_consensus.cc:740] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.432400 24978 consensus_queue.cc:260] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.434814 24978 ts_tablet_manager.cc:1434] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:19.435678 24978 tablet_bootstrap.cc:492] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.459918 24978 tablet_bootstrap.cc:492] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.460938 24978 tablet_bootstrap.cc:492] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.461658 24978 ts_tablet_manager.cc:1403] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 13:21:19.464390 24978 raft_consensus.cc:359] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.465119 24978 raft_consensus.cc:740] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.465847 24978 consensus_queue.cc:260] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.468567 24978 ts_tablet_manager.cc:1434] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:21:19.469377 24978 tablet_bootstrap.cc:492] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.487208 24978 tablet_bootstrap.cc:492] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.488008 24978 tablet_bootstrap.cc:492] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.488569 24978 ts_tablet_manager.cc:1403] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:21:19.490567 24978 raft_consensus.cc:359] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:19.491089 24978 raft_consensus.cc:740] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.491765 24978 consensus_queue.cc:260] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:19.493304 24978 ts_tablet_manager.cc:1434] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:19.494112 24978 tablet_bootstrap.cc:492] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.510922 24978 tablet_bootstrap.cc:492] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.511965 24978 tablet_bootstrap.cc:492] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.512939 24978 ts_tablet_manager.cc:1403] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:21:19.515884 24978 raft_consensus.cc:359] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:19.516642 24978 raft_consensus.cc:740] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.517411 24978 consensus_queue.cc:260] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:19.520037 24978 ts_tablet_manager.cc:1434] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:19.520764 24978 tablet_bootstrap.cc:492] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.540416 24978 tablet_bootstrap.cc:492] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.541267 24978 tablet_bootstrap.cc:492] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.541852 24978 ts_tablet_manager.cc:1403] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:21:19.543704 24978 raft_consensus.cc:359] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:19.544344 24978 raft_consensus.cc:740] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.545292 24978 consensus_queue.cc:260] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:19.547274 24978 ts_tablet_manager.cc:1434] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:19.548115 24978 tablet_bootstrap.cc:492] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.548862 16329 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:21:19.549254 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.287s	user 0.272s	sys 0.003s
I20260709 13:21:19.564472 24978 tablet_bootstrap.cc:492] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.565537 24978 tablet_bootstrap.cc:492] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.566483 24978 ts_tablet_manager.cc:1403] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:21:19.568672 24978 raft_consensus.cc:359] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.569401 24978 raft_consensus.cc:740] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.570381 24978 consensus_queue.cc:260] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.572073 24978 ts_tablet_manager.cc:1434] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:19.572899 24978 tablet_bootstrap.cc:492] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.588479 24978 tablet_bootstrap.cc:492] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.589481 24978 tablet_bootstrap.cc:492] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.590201 24978 ts_tablet_manager.cc:1403] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.004s
I20260709 13:21:19.592885 24978 raft_consensus.cc:359] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.593644 24978 raft_consensus.cc:740] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.594398 24978 consensus_queue.cc:260] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.596746 24978 ts_tablet_manager.cc:1434] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:19.597606 24978 tablet_bootstrap.cc:492] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.615748 24978 tablet_bootstrap.cc:492] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.617054 24978 tablet_bootstrap.cc:492] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.617980 24978 ts_tablet_manager.cc:1403] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:21:19.623303 24978 raft_consensus.cc:359] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.624352 24978 raft_consensus.cc:740] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.625345 24978 consensus_queue.cc:260] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.628782 24978 ts_tablet_manager.cc:1434] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:21:19.630435 24978 tablet_bootstrap.cc:492] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.635346 24916 raft_consensus.cc:493] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:19.635979 24916 raft_consensus.cc:515] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.638850 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:19.637949 24916 leader_election.cc:290] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
W20260709 13:21:19.656215 24348 leader_election.cc:336] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111)
I20260709 13:21:19.656737 24348 leader_election.cc:304] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:19.658016 24982 raft_consensus.cc:2749] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:19.658555 24978 tablet_bootstrap.cc:492] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.659677 24978 tablet_bootstrap.cc:492] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.660702 24978 ts_tablet_manager.cc:1403] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.031s	user 0.027s	sys 0.000s
I20260709 13:21:19.663468 24978 raft_consensus.cc:359] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:19.664217 24978 raft_consensus.cc:740] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.664909 24978 consensus_queue.cc:260] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:19.667610 24978 ts_tablet_manager.cc:1434] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:19.668434 24978 tablet_bootstrap.cc:492] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.689097 24978 tablet_bootstrap.cc:492] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.690557 24978 tablet_bootstrap.cc:492] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.691499 24978 ts_tablet_manager.cc:1403] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:21:19.695328 24978 raft_consensus.cc:359] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.696394 24978 raft_consensus.cc:740] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.698351 24978 consensus_queue.cc:260] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.704360 24978 ts_tablet_manager.cc:1434] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 13:21:19.705471 24978 tablet_bootstrap.cc:492] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.723694 24980 raft_consensus.cc:493] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:19.724327 24980 raft_consensus.cc:515] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.726361 24980 leader_election.cc:290] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:19.727506 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:19.733198 24978 tablet_bootstrap.cc:492] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.735219 24978 tablet_bootstrap.cc:492] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.735963 24978 ts_tablet_manager.cc:1403] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 13:21:19.738492 24978 raft_consensus.cc:359] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.740028 24978 raft_consensus.cc:740] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.740731 24978 consensus_queue.cc:260] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.742522 24978 ts_tablet_manager.cc:1434] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:21:19.743309 24978 tablet_bootstrap.cc:492] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.758005 24982 raft_consensus.cc:493] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:19.758667 24982 raft_consensus.cc:515] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.760775 24982 leader_election.cc:290] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:19.762210 24978 tablet_bootstrap.cc:492] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.763288 24978 tablet_bootstrap.cc:492] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.763154 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:19.764031 24308 raft_consensus.cc:2468] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:19.764143 24978 ts_tablet_manager.cc:1403] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:21:19.766697 24978 raft_consensus.cc:359] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:19.766922 24346 leader_election.cc:304] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:19.767354 24978 raft_consensus.cc:740] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.767947 24982 raft_consensus.cc:2804] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:19.768297 24982 raft_consensus.cc:493] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:19.768246 24978 consensus_queue.cc:260] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:19.770716 24978 ts_tablet_manager.cc:1434] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:21:19.772377 24978 tablet_bootstrap.cc:492] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.768836 24982 raft_consensus.cc:3060] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:19.774454 24348 leader_election.cc:336] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111)
I20260709 13:21:19.789013 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.65:39703
I20260709 13:21:19.789076 25059 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.65:39703 every 8 connection(s)
I20260709 13:21:19.790452 24982 raft_consensus.cc:515] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.791230 24978 tablet_bootstrap.cc:492] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.792208 24978 tablet_bootstrap.cc:492] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.792860 24978 ts_tablet_manager.cc:1403] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260709 13:21:19.793937 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:19.794951 24982 leader_election.cc:290] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:19.795015 24308 raft_consensus.cc:3060] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:19.808805 24308 raft_consensus.cc:2468] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 2.
I20260709 13:21:19.812671 24978 raft_consensus.cc:359] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:19.813598 24978 raft_consensus.cc:740] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.814860 24346 leader_election.cc:304] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:19.814610 24978 consensus_queue.cc:260] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:19.815878 24970 raft_consensus.cc:2804] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:19.816735 24970 raft_consensus.cc:697] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:19.817610 24970 consensus_queue.cc:237] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.822551 24978 ts_tablet_manager.cc:1434] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:21:19.825879 24978 tablet_bootstrap.cc:492] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:19.849618 24057 catalog_manager.cc:5697] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 1 to 2, leader changed from 97e577a376c948bfac33665f06a4bb98 (127.15.242.65) to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 2 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.869104 25032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
W20260709 13:21:19.883894 24348 leader_election.cc:343] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.954152 25060 heartbeater.cc:344] Connected to a master server at 127.15.242.126:42991
I20260709 13:21:19.954674 25060 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:19.955695 25060 heartbeater.cc:507] Master 127.15.242.126:42991 requested a full tablet report, sending...
I20260709 13:21:19.960270 24978 tablet_bootstrap.cc:492] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:19.962242 24978 tablet_bootstrap.cc:492] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:19.962481 24916 raft_consensus.cc:493] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:19.963156 24916 raft_consensus.cc:515] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.964097 24978 ts_tablet_manager.cc:1403] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.138s	user 0.030s	sys 0.056s
I20260709 13:21:19.965296 24916 leader_election.cc:290] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:19.966810 25029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:19.967665 25029 raft_consensus.cc:2468] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:19.970468 24348 leader_election.cc:304] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:19.971647 24978 raft_consensus.cc:359] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.973500 24978 raft_consensus.cc:740] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.974694 24896 raft_consensus.cc:2804] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:19.975679 24827 raft_consensus.cc:493] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:19.975311 24978 consensus_queue.cc:260] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:19.984386 24827 raft_consensus.cc:515] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:19.975310 24896 raft_consensus.cc:493] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:19.987941 24896 raft_consensus.cc:3060] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:19.990790 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3" is_pre_election: true
I20260709 13:21:19.988787 24978 ts_tablet_manager.cc:1434] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.004s
I20260709 13:21:19.991928 24308 raft_consensus.cc:2468] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 1.
I20260709 13:21:19.996366 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:19.997928 24980 raft_consensus.cc:493] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:19.998607 24980 raft_consensus.cc:515] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.002135 24980 leader_election.cc:290] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:20.007560 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" is_pre_election: true
I20260709 13:21:20.008374 24382 raft_consensus.cc:2468] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 1.
I20260709 13:21:20.009691 24274 leader_election.cc:304] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:20.010903 24980 raft_consensus.cc:2804] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:20.011377 24980 raft_consensus.cc:493] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:20.011834 24980 raft_consensus.cc:3060] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.014176 24827 leader_election.cc:290] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:20.017910 24978 tablet_bootstrap.cc:492] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.021983 24896 raft_consensus.cc:515] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.023883 24980 raft_consensus.cc:515] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.035585 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:20.036314 24382 raft_consensus.cc:3060] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.034927 24980 leader_election.cc:290] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:20.047204 24381 raft_consensus.cc:2393] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c6aaf55421432a91a73360865771d3 in current term 2: Already voted for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in this term.
I20260709 13:21:20.048180 24054 ts_manager.cc:194] Re-registered known tserver with Master: 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:20.049392 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:20.050061 24309 raft_consensus.cc:3060] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.051952 25029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:20.052651 25029 raft_consensus.cc:3060] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.048964 24382 raft_consensus.cc:2468] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 2.
I20260709 13:21:20.061836 24309 raft_consensus.cc:2468] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 2.
I20260709 13:21:20.048329 24896 leader_election.cc:290] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:20.066891 24274 leader_election.cc:304] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:20.067796 24827 raft_consensus.cc:2804] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:20.068405 24827 raft_consensus.cc:697] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 2 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:20.069608 24827 consensus_queue.cc:237] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.070638 25029 raft_consensus.cc:2468] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96be869fbe4e464a99c0d5aa3d90dbfb in term 2.
I20260709 13:21:20.067272 24346 leader_election.cc:304] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:20.073508 24970 raft_consensus.cc:2804] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:20.074347 24970 raft_consensus.cc:697] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 LEADER]: Becoming Leader. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:20.075325 24970 consensus_queue.cc:237] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.099946 24978 tablet_bootstrap.cc:492] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.101105 24978 tablet_bootstrap.cc:492] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.103001 24978 ts_tablet_manager.cc:1403] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.017s
I20260709 13:21:20.103228 24057 catalog_manager.cc:5697] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb reported cstate change: term changed from 1 to 2, leader changed from 97e577a376c948bfac33665f06a4bb98 (127.15.242.65) to 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68). New cstate: current_term: 2 leader_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.112174 24978 raft_consensus.cc:359] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:20.112910 24978 raft_consensus.cc:740] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.113591 24978 consensus_queue.cc:260] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:20.121279 24978 ts_tablet_manager.cc:1434] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:21:20.122226 24978 tablet_bootstrap.cc:492] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.140563 24056 catalog_manager.cc:5697] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 1 to 2, leader changed from 97e577a376c948bfac33665f06a4bb98 (127.15.242.65) to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.147774 24978 tablet_bootstrap.cc:492] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.148849 24978 tablet_bootstrap.cc:492] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.149547 24978 ts_tablet_manager.cc:1403] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.000s
I20260709 13:21:20.152262 24978 raft_consensus.cc:359] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.152819 24978 raft_consensus.cc:740] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.154433 24978 consensus_queue.cc:260] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.158182 24978 ts_tablet_manager.cc:1434] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:21:20.159036 24978 tablet_bootstrap.cc:492] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.173223 24054 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41634
I20260709 13:21:20.175513 24978 tablet_bootstrap.cc:492] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.176448 24978 tablet_bootstrap.cc:492] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.177098 24978 ts_tablet_manager.cc:1403] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:21:20.178678 25060 heartbeater.cc:499] Master 127.15.242.126:42991 was elected leader, sending a full tablet report...
I20260709 13:21:20.179689 24978 raft_consensus.cc:359] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.181542 24978 raft_consensus.cc:740] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.182298 24978 consensus_queue.cc:260] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.184087 24978 ts_tablet_manager.cc:1434] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:20.184798 24978 tablet_bootstrap.cc:492] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.218487 24978 tablet_bootstrap.cc:492] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.220508 24978 tablet_bootstrap.cc:492] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.221213 24978 ts_tablet_manager.cc:1403] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.037s	user 0.026s	sys 0.008s
I20260709 13:21:20.223253 24978 raft_consensus.cc:359] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:20.223896 24978 raft_consensus.cc:740] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.224465 24978 consensus_queue.cc:260] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:20.226536 24978 ts_tablet_manager.cc:1434] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:21:20.227288 24978 tablet_bootstrap.cc:492] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.249922 24978 tablet_bootstrap.cc:492] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.251041 24978 tablet_bootstrap.cc:492] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.251811 24978 ts_tablet_manager.cc:1403] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 13:21:20.254848 24978 raft_consensus.cc:359] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.255462 24978 raft_consensus.cc:740] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.256166 24978 consensus_queue.cc:260] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.257485 24978 ts_tablet_manager.cc:1434] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:20.258242 24978 tablet_bootstrap.cc:492] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.293681 24309 raft_consensus.cc:1275] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Refusing update from remote peer 96be869fbe4e464a99c0d5aa3d90dbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.296432 25073 consensus_queue.cc:1048] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.309774 24978 tablet_bootstrap.cc:492] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.311209 24978 tablet_bootstrap.cc:492] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.312150 24978 ts_tablet_manager.cc:1403] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.023s
I20260709 13:21:20.315281 24978 raft_consensus.cc:359] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.316048 24978 raft_consensus.cc:740] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.317030 24978 consensus_queue.cc:260] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.320279 24978 ts_tablet_manager.cc:1434] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:21:20.323176 24978 tablet_bootstrap.cc:492] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.396998 24978 tablet_bootstrap.cc:492] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.398306 24978 tablet_bootstrap.cc:492] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.399255 24978 ts_tablet_manager.cc:1403] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.010s
I20260709 13:21:20.403034 24978 raft_consensus.cc:359] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.404054 24978 raft_consensus.cc:740] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.404999 24978 consensus_queue.cc:260] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.416572 24978 ts_tablet_manager.cc:1434] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.002s
I20260709 13:21:20.417872 24978 tablet_bootstrap.cc:492] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
W20260709 13:21:20.453307 24348 consensus_peers.cc:597] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:20.463337 24382 raft_consensus.cc:1275] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer b8c6aaf55421432a91a73360865771d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.465205 24980 consensus_queue.cc:1048] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.480000 24978 tablet_bootstrap.cc:492] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.481197 24978 tablet_bootstrap.cc:492] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.482004 24978 ts_tablet_manager.cc:1403] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.005s
I20260709 13:21:20.485495 24978 raft_consensus.cc:359] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.486334 24978 raft_consensus.cc:740] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.487234 24978 consensus_queue.cc:260] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.489624 24978 ts_tablet_manager.cc:1434] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:20.490566 24978 tablet_bootstrap.cc:492] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.505904 24308 raft_consensus.cc:1275] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Refusing update from remote peer 96be869fbe4e464a99c0d5aa3d90dbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.508486 25074 consensus_queue.cc:1048] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.525982 24978 tablet_bootstrap.cc:492] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.527599 24978 tablet_bootstrap.cc:492] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.528299 24978 ts_tablet_manager.cc:1403] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.006s
I20260709 13:21:20.531463 24978 raft_consensus.cc:359] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.532234 24978 raft_consensus.cc:740] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.532966 24978 consensus_queue.cc:260] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.534895 25029 raft_consensus.cc:1275] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Refusing update from remote peer 96be869fbe4e464a99c0d5aa3d90dbfb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.536034 24978 ts_tablet_manager.cc:1434] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:21:20.536955 24896 consensus_queue.cc:1048] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.538793 24978 tablet_bootstrap.cc:492] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.568058 24978 tablet_bootstrap.cc:492] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.569087 24978 tablet_bootstrap.cc:492] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.569849 24978 ts_tablet_manager.cc:1403] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.007s
I20260709 13:21:20.572677 24978 raft_consensus.cc:359] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:20.573626 24978 raft_consensus.cc:740] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.574517 24978 consensus_queue.cc:260] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:20.576596 24978 ts_tablet_manager.cc:1434] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:21:20.577587 24978 tablet_bootstrap.cc:492] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.593230 24978 tablet_bootstrap.cc:492] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.594369 24978 tablet_bootstrap.cc:492] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.595108 24978 ts_tablet_manager.cc:1403] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:21:20.597622 24978 raft_consensus.cc:359] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:20.598395 24978 raft_consensus.cc:740] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.600322 24978 consensus_queue.cc:260] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:20.602566 24978 ts_tablet_manager.cc:1434] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:20.605001 24978 tablet_bootstrap.cc:492] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.620476 24978 tablet_bootstrap.cc:492] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.621336 24978 tablet_bootstrap.cc:492] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.622062 24978 ts_tablet_manager.cc:1403] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:21:20.624375 24978 raft_consensus.cc:359] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.625072 24978 raft_consensus.cc:740] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.625715 24978 consensus_queue.cc:260] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.627867 24978 ts_tablet_manager.cc:1434] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:20.630563 24978 tablet_bootstrap.cc:492] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.656131 24978 tablet_bootstrap.cc:492] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.657177 24978 tablet_bootstrap.cc:492] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.657909 24978 ts_tablet_manager.cc:1403] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.006s
I20260709 13:21:20.660550 24978 raft_consensus.cc:359] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.661294 24978 raft_consensus.cc:740] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.662070 24978 consensus_queue.cc:260] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.664216 24978 ts_tablet_manager.cc:1434] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:20.665879 24978 tablet_bootstrap.cc:492] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.684929 24978 tablet_bootstrap.cc:492] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.685992 24978 tablet_bootstrap.cc:492] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.686794 24978 ts_tablet_manager.cc:1403] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:21:20.689357 24978 raft_consensus.cc:359] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.689978 24978 raft_consensus.cc:740] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.690737 24978 consensus_queue.cc:260] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.692723 24978 ts_tablet_manager.cc:1434] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:20.693506 24978 tablet_bootstrap.cc:492] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.711341 24978 tablet_bootstrap.cc:492] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.712357 24978 tablet_bootstrap.cc:492] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.713088 24978 ts_tablet_manager.cc:1403] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 13:21:20.716710 24978 raft_consensus.cc:359] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.717379 24978 raft_consensus.cc:740] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.718060 24978 consensus_queue.cc:260] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.719691 24978 ts_tablet_manager.cc:1434] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:20.720454 24978 tablet_bootstrap.cc:492] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.749706 24978 tablet_bootstrap.cc:492] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.750903 24978 tablet_bootstrap.cc:492] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.751653 24978 ts_tablet_manager.cc:1403] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.006s
I20260709 13:21:20.755180 24978 raft_consensus.cc:359] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:20.757717 24978 raft_consensus.cc:740] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.758473 24978 consensus_queue.cc:260] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:20.760747 24978 ts_tablet_manager.cc:1434] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:21:20.763010 24978 tablet_bootstrap.cc:492] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.796554 24978 tablet_bootstrap.cc:492] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.797801 24978 tablet_bootstrap.cc:492] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.798857 24978 ts_tablet_manager.cc:1403] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.036s	user 0.025s	sys 0.000s
I20260709 13:21:20.801753 24978 raft_consensus.cc:359] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.802665 24978 raft_consensus.cc:740] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.803454 24978 consensus_queue.cc:260] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.806007 24978 ts_tablet_manager.cc:1434] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:20.807117 24978 tablet_bootstrap.cc:492] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.825161 25030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:20.827299 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf4b67fba4c29b17c18984f51368f" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
I20260709 13:21:20.830418 25032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98"
I20260709 13:21:20.831174 25032 raft_consensus.cc:3060] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.832585 25030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca07974685419bbf6372e6306542e8" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "97e577a376c948bfac33665f06a4bb98" is_pre_election: true
W20260709 13:21:20.846500 24274 leader_election.cc:343] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.847232 24274 leader_election.cc:304] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:20.848078 24980 raft_consensus.cc:2749] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:20.848896 24274 leader_election.cc:304] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c6aaf55421432a91a73360865771d3; no voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:20.849871 24827 raft_consensus.cc:2749] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:20.853003 24978 tablet_bootstrap.cc:492] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.854187 24978 tablet_bootstrap.cc:492] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.854882 24978 ts_tablet_manager.cc:1403] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.011s
I20260709 13:21:20.857900 24978 raft_consensus.cc:359] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.858692 24978 raft_consensus.cc:740] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.859463 24978 consensus_queue.cc:260] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.859788 25032 raft_consensus.cc:2468] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 2.
I20260709 13:21:20.860839 24978 ts_tablet_manager.cc:1434] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:20.860780 25028 raft_consensus.cc:1275] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Refusing update from remote peer b8c6aaf55421432a91a73360865771d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.862560 24978 tablet_bootstrap.cc:492] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.863498 24827 consensus_queue.cc:1048] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:20.880443 24978 tablet_bootstrap.cc:492] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.881343 24978 tablet_bootstrap.cc:492] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.882066 24978 ts_tablet_manager.cc:1403] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 13:21:20.884107 24978 raft_consensus.cc:359] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.884682 24978 raft_consensus.cc:740] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.885263 24978 consensus_queue.cc:260] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.887017 24978 ts_tablet_manager.cc:1434] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:20.887980 24978 tablet_bootstrap.cc:492] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.909168 24978 tablet_bootstrap.cc:492] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.910559 24978 tablet_bootstrap.cc:492] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.911432 24978 ts_tablet_manager.cc:1403] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.003s
I20260709 13:21:20.914335 24978 raft_consensus.cc:359] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.915128 24978 raft_consensus.cc:740] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.915844 24978 consensus_queue.cc:260] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:20.918948 24978 ts_tablet_manager.cc:1434] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:20.919798 24978 tablet_bootstrap.cc:492] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.937389 24978 tablet_bootstrap.cc:492] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.938510 24978 tablet_bootstrap.cc:492] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.939291 24978 ts_tablet_manager.cc:1403] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.005s
I20260709 13:21:20.941721 24978 raft_consensus.cc:359] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:20.942432 24978 raft_consensus.cc:740] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.943059 24978 consensus_queue.cc:260] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:20.945104 24978 ts_tablet_manager.cc:1434] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:20.951121 24978 tablet_bootstrap.cc:492] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:20.980407 24978 tablet_bootstrap.cc:492] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:20.981477 24978 tablet_bootstrap.cc:492] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:20.982244 24978 ts_tablet_manager.cc:1403] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.003s
I20260709 13:21:20.984830 24978 raft_consensus.cc:359] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.985610 24978 raft_consensus.cc:740] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.986691 24978 consensus_queue.cc:260] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:20.988969 24978 ts_tablet_manager.cc:1434] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:21:20.989873 24978 tablet_bootstrap.cc:492] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:21.022099 24978 tablet_bootstrap.cc:492] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:21.023116 24978 tablet_bootstrap.cc:492] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:21.023782 24978 ts_tablet_manager.cc:1403] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.001s
W20260709 13:21:21.025947 24348 consensus_peers.cc:597] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:21.026629 24978 raft_consensus.cc:359] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:21.027364 24978 raft_consensus.cc:740] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.028061 24978 consensus_queue.cc:260] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:21.030272 24978 ts_tablet_manager.cc:1434] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:21:21.032145 24978 tablet_bootstrap.cc:492] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
W20260709 13:21:21.033758 24348 consensus_peers.cc:597] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:21.051999 24978 tablet_bootstrap.cc:492] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:21.053756 24978 tablet_bootstrap.cc:492] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:21.054529 24978 ts_tablet_manager.cc:1403] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.003s
I20260709 13:21:21.057626 24978 raft_consensus.cc:359] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:21.058250 24978 raft_consensus.cc:740] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.058831 24978 consensus_queue.cc:260] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:21.060809 24978 ts_tablet_manager.cc:1434] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:21:21.062621 24978 tablet_bootstrap.cc:492] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
I20260709 13:21:21.085423 24978 tablet_bootstrap.cc:492] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:21.086354 24978 tablet_bootstrap.cc:492] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:21.086957 24978 ts_tablet_manager.cc:1403] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260709 13:21:21.089022 24978 raft_consensus.cc:359] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:21.089519 24978 raft_consensus.cc:740] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.090289 24978 consensus_queue.cc:260] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:21.091900 24978 ts_tablet_manager.cc:1434] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:21.093008 24978 tablet_bootstrap.cc:492] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98: Bootstrap starting.
W20260709 13:21:21.113426 24200 consensus_peers.cc:597] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:21.122565 24978 tablet_bootstrap.cc:492] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:21.123561 24978 tablet_bootstrap.cc:492] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98: Bootstrap complete.
I20260709 13:21:21.124210 24978 ts_tablet_manager.cc:1403] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.011s
I20260709 13:21:21.126493 24978 raft_consensus.cc:359] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:21.127482 24978 raft_consensus.cc:740] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.128182 24978 consensus_queue.cc:260] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:21.129794 24978 ts_tablet_manager.cc:1434] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:21.437741 25032 raft_consensus.cc:3060] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:26.207639 24198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:46833, user_credentials={real_user=slave}} blocked reactor thread for 303153us
W20260709 13:21:26.976847 24089 debug-util.cc:398] Leaking SignalData structure 0x7b08000619a0 after lost signal to thread 16332
W20260709 13:21:26.978232 24089 debug-util.cc:398] Leaking SignalData structure 0x7b0800348e80 after lost signal to thread 24092
W20260709 13:21:26.979664 24089 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1c00 after lost signal to thread 24259
W20260709 13:21:26.980775 24089 debug-util.cc:398] Leaking SignalData structure 0x7b0800127980 after lost signal to thread 24333
W20260709 13:21:26.981698 24089 debug-util.cc:398] Leaking SignalData structure 0x7b080016bbe0 after lost signal to thread 24407
W20260709 13:21:26.982762 24089 debug-util.cc:398] Leaking SignalData structure 0x7b080035ed00 after lost signal to thread 25059
W20260709 13:21:27.272375 24346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.67:46833, user_credentials={real_user=slave}} blocked reactor thread for 46941.9us
I20260709 13:21:29.965411 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:30.051112 24232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5"
dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:49992
I20260709 13:21:30.052039 24232 raft_consensus.cc:606] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:30.055112 24232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dfc3f1f066843e382fa402c8d4ec110"
dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:49992
I20260709 13:21:30.055656 24232 raft_consensus.cc:606] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:30.058564 24229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95192d3963414bdfac891aba6df47f7c"
dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:49992
I20260709 13:21:30.059206 24229 raft_consensus.cc:606] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:30.062539 24232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5172214c61f4935bce32538470f1ef8"
dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:49992
I20260709 13:21:30.063117 24232 raft_consensus.cc:606] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:30.090227 24382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c67fd67822294670b224a43c149b126f"
dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
mode: GRACEFUL
new_leader_uuid: "b8c6aaf55421432a91a73360865771d3"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:21:30.091012 24382 raft_consensus.cc:606] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Received request to transfer leadership to TS b8c6aaf55421432a91a73360865771d3
I20260709 13:21:30.099160 24232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbbd9769488e4db0bf3addb6ae875e51"
dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:49992
I20260709 13:21:30.099766 24232 raft_consensus.cc:606] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:30.101285 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:21:30.103307 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:30.253926 25145 raft_consensus.cc:993] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:30.254739 25149 raft_consensus.cc:1081] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:30.256502 25028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5172214c61f4935bce32538470f1ef8"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46714
I20260709 13:21:30.257041 25028 raft_consensus.cc:493] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:30.257402 25028 raft_consensus.cc:3060] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.267639 25028 raft_consensus.cc:515] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.272308 25028 leader_election.cc:290] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:30.286888 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5172214c61f4935bce32538470f1ef8" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:30.287796 24382 raft_consensus.cc:3060] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.296469 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5172214c61f4935bce32538470f1ef8" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:30.297289 24232 raft_consensus.cc:3055] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:30.297650 24232 raft_consensus.cc:740] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:30.297880 24382 raft_consensus.cc:2468] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:30.299249 24974 leader_election.cc:304] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:30.298732 24232 consensus_queue.cc:260] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.301592 25156 raft_consensus.cc:2804] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.302004 24232 raft_consensus.cc:3060] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.304253 25149 raft_consensus.cc:993] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:30.304881 25148 raft_consensus.cc:1081] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:30.306690 25028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46714
I20260709 13:21:30.307267 25028 raft_consensus.cc:493] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:30.307636 25028 raft_consensus.cc:3060] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:30.315219 24232 raft_consensus.cc:2468] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:30.327816 25028 raft_consensus.cc:515] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.332401 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:30.335680 24382 raft_consensus.cc:3060] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:30.334920 25156 raft_consensus.cc:697] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:30.339756 25156 consensus_queue.cc:237] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.338593 25028 leader_election.cc:290] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 3 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:30.351019 24382 raft_consensus.cc:2468] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 3.
I20260709 13:21:30.352767 24381 raft_consensus.cc:1240] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 3 FOLLOWER]: Rejecting Update request from peer 3e96a35df00e4646b9c6e356c6fb4bba for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:30.353880 24974 leader_election.cc:304] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:30.354555 25156 raft_consensus.cc:2804] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:30.355345 25156 raft_consensus.cc:697] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 3 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:30.356210 25148 consensus_queue.cc:1059] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:30.356802 25156 consensus_queue.cc:237] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.362316 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7fdf5436a3408eb7a2074f0d4f48f5" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:30.364406 24232 raft_consensus.cc:3055] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:30.365185 24232 raft_consensus.cc:740] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:30.368845 24056 catalog_manager.cc:5697] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 1 to 2, leader changed from 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.366736 24232 consensus_queue.cc:260] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.372442 24232 raft_consensus.cc:3060] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:30.401350 25145 raft_consensus.cc:993] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:30.401894 25145 raft_consensus.cc:1081] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:30.405632 25159 raft_consensus.cc:993] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:30.405735 24232 raft_consensus.cc:2468] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 3.
I20260709 13:21:30.406415 25159 raft_consensus.cc:1081] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
W20260709 13:21:30.406524 25149 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:21:30.406807 25029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dfc3f1f066843e382fa402c8d4ec110"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46714
I20260709 13:21:30.407505 25029 raft_consensus.cc:493] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:30.407900 25029 raft_consensus.cc:3060] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.410003 25023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbbd9769488e4db0bf3addb6ae875e51"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46714
I20260709 13:21:30.410979 25023 raft_consensus.cc:493] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:30.411582 25023 raft_consensus.cc:3060] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.417374 25029 raft_consensus.cc:515] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.421622 25029 leader_election.cc:290] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:30.421829 24232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc3f1f066843e382fa402c8d4ec110" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:30.422559 24232 raft_consensus.cc:3055] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:30.422932 24232 raft_consensus.cc:740] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:30.423463 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc3f1f066843e382fa402c8d4ec110" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:30.424167 24381 raft_consensus.cc:3060] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.423843 24232 consensus_queue.cc:260] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.425426 24232 raft_consensus.cc:3060] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.434640 24232 raft_consensus.cc:2468] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:30.436375 24972 leader_election.cc:304] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:30.438710 25156 raft_consensus.cc:2804] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.439256 25156 raft_consensus.cc:697] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:30.440285 25156 consensus_queue.cc:237] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.448700 24381 raft_consensus.cc:2468] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:30.466574 25023 raft_consensus.cc:515] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.483824 24229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd9769488e4db0bf3addb6ae875e51" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:30.483920 24381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd9769488e4db0bf3addb6ae875e51" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:30.484486 24229 raft_consensus.cc:3055] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:30.484710 24381 raft_consensus.cc:3060] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.484869 24229 raft_consensus.cc:740] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:30.486210 24229 consensus_queue.cc:260] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.487682 24229 raft_consensus.cc:3060] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.507778 25023 leader_election.cc:290] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:30.515309 25147 raft_consensus.cc:993] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb: : Instructing follower b8c6aaf55421432a91a73360865771d3 to start an election
I20260709 13:21:30.515867 25147 raft_consensus.cc:1081] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Signalling peer b8c6aaf55421432a91a73360865771d3 to start an election
I20260709 13:21:30.517892 24308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c67fd67822294670b224a43c149b126f"
dest_uuid: "b8c6aaf55421432a91a73360865771d3"
 from {username='slave'} at 127.0.0.1:38062
I20260709 13:21:30.518710 24308 raft_consensus.cc:493] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:30.519383 24308 raft_consensus.cc:3060] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.522392 24229 raft_consensus.cc:2468] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:30.538332 24972 leader_election.cc:304] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:30.535175 24056 catalog_manager.cc:5697] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 2 to 3, leader changed from 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 3 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.541385 24381 raft_consensus.cc:2468] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:30.540795 25156 raft_consensus.cc:2804] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.542659 25156 raft_consensus.cc:697] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:30.543639 25156 consensus_queue.cc:237] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.542063 24056 catalog_manager.cc:5697] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 1 to 2, leader changed from 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.583473 25149 raft_consensus.cc:993] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:30.584087 25148 raft_consensus.cc:1081] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:30.587399 25029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95192d3963414bdfac891aba6df47f7c"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46714
I20260709 13:21:30.588231 25029 raft_consensus.cc:493] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:30.588697 25029 raft_consensus.cc:3060] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.604954 25029 raft_consensus.cc:515] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.608580 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95192d3963414bdfac891aba6df47f7c" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:30.609277 24383 raft_consensus.cc:3060] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.610178 24228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95192d3963414bdfac891aba6df47f7c" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:30.610946 24228 raft_consensus.cc:3055] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:30.611265 24228 raft_consensus.cc:740] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:30.612190 24228 consensus_queue.cc:260] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.613559 24228 raft_consensus.cc:3060] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.618489 24383 raft_consensus.cc:2468] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:30.624929 24974 leader_election.cc:304] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:30.626209 25157 raft_consensus.cc:2804] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.627512 25157 raft_consensus.cc:697] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:30.628767 25157 consensus_queue.cc:237] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:30.637835 25029 leader_election.cc:290] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:30.642658 24228 raft_consensus.cc:2468] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
W20260709 13:21:30.723068 24346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:34445, user_credentials={real_user=slave}} blocked reactor thread for 78966.5us
I20260709 13:21:30.740903 24228 raft_consensus.cc:1275] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 3 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:30.742892 25157 consensus_queue.cc:1048] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:30.749123 24308 raft_consensus.cc:515] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:30.750896 24056 catalog_manager.cc:5697] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 1 to 2, leader changed from 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.754904 24228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67fd67822294670b224a43c149b126f" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:30.755668 24228 raft_consensus.cc:3060] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.756440 24308 leader_election.cc:290] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:30.764609 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67fd67822294670b224a43c149b126f" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:30.765370 24383 raft_consensus.cc:3055] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:30.765719 24383 raft_consensus.cc:740] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:30.766719 24383 consensus_queue.cc:260] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:30.767717 24383 raft_consensus.cc:3060] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.797737 24228 raft_consensus.cc:2468] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 2.
I20260709 13:21:30.894850 24383 raft_consensus.cc:2468] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 2.
I20260709 13:21:30.897970 24272 leader_election.cc:304] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:30.899137 25133 raft_consensus.cc:2804] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.926649 25133 raft_consensus.cc:697] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 2 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:30.928133 25133 consensus_queue.cc:237] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:30.930480 24056 catalog_manager.cc:5697] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 1 to 2, leader changed from 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.933900 24228 raft_consensus.cc:1275] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.934094 24232 raft_consensus.cc:1240] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Rejecting Update request from peer 96be869fbe4e464a99c0d5aa3d90dbfb for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:30.936622 25156 consensus_queue.cc:1048] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:30.948101 24383 raft_consensus.cc:1275] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 3 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:30.949471 24379 raft_consensus.cc:1275] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.949805 24382 raft_consensus.cc:1275] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.950984 24381 raft_consensus.cc:1275] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.965730 24057 catalog_manager.cc:5697] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 1 to 2, leader changed from 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68) to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.972225 25168 consensus_queue.cc:1048] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:30.973727 24233 raft_consensus.cc:1275] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.975910 25168 consensus_queue.cc:1048] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:30.976768 25157 consensus_queue.cc:1048] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:30.982321 25157 consensus_queue.cc:1048] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:30.986431 25157 consensus_queue.cc:1048] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:31.104640 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:31.115499 24232 raft_consensus.cc:1275] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.124681 25156 consensus_queue.cc:1048] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:31.216758 24383 raft_consensus.cc:1275] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.219061 25168 consensus_queue.cc:1048] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:31.258407 24233 raft_consensus.cc:1275] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.260391 25157 consensus_queue.cc:1048] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:31.336628 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:31.391115 24379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bf4040b9d0747039fdf29b8fa99d02c"
dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:21:31.391812 24379 raft_consensus.cc:606] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:31.396874 24233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2789a7bb0565468ebd309763754a3d4c"
dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:49992
I20260709 13:21:31.397558 24233 raft_consensus.cc:606] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:31.403075 24383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4206794ab99d4bc2b0573743d29d74ca"
dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
mode: GRACEFUL
new_leader_uuid: "b8c6aaf55421432a91a73360865771d3"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:21:31.403712 24383 raft_consensus.cc:606] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Received request to transfer leadership to TS b8c6aaf55421432a91a73360865771d3
I20260709 13:21:31.406548 24383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d13a5255f4d444b984355f509d3a7918"
dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:21:31.407131 24383 raft_consensus.cc:606] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:31.409788 24383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc10ce2783b74de384326c27984c7e92"
dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:21:31.410385 24383 raft_consensus.cc:606] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:31.411588 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:31.412766 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:31.435956 25153 raft_consensus.cc:993] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb: : Instructing follower b8c6aaf55421432a91a73360865771d3 to start an election
I20260709 13:21:31.436543 25153 raft_consensus.cc:1081] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Signalling peer b8c6aaf55421432a91a73360865771d3 to start an election
I20260709 13:21:31.438271 24305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4206794ab99d4bc2b0573743d29d74ca"
dest_uuid: "b8c6aaf55421432a91a73360865771d3"
 from {username='slave'} at 127.0.0.1:38062
I20260709 13:21:31.438768 24305 raft_consensus.cc:493] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:31.439088 24305 raft_consensus.cc:3060] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.449466 24305 raft_consensus.cc:515] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:31.451193 24305 leader_election.cc:290] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:31.452006 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4206794ab99d4bc2b0573743d29d74ca" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:31.452664 24233 raft_consensus.cc:3060] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.452878 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4206794ab99d4bc2b0573743d29d74ca" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:31.453615 25170 raft_consensus.cc:993] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:31.453667 24383 raft_consensus.cc:3055] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:31.454298 25153 raft_consensus.cc:1081] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:31.454324 24383 raft_consensus.cc:740] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:31.455600 24383 consensus_queue.cc:260] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:31.457054 24383 raft_consensus.cc:3060] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.461709 24233 raft_consensus.cc:2468] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 2.
I20260709 13:21:31.462374 25023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d13a5255f4d444b984355f509d3a7918"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:21:31.463295 25023 raft_consensus.cc:493] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:31.463359 24272 leader_election.cc:304] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:31.463853 25023 raft_consensus.cc:3060] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.464501 25163 raft_consensus.cc:2804] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:31.464911 24383 raft_consensus.cc:2468] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 2.
I20260709 13:21:31.465126 25163 raft_consensus.cc:697] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 2 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:31.466099 25163 consensus_queue.cc:237] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:31.473973 25023 raft_consensus.cc:515] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:31.478076 25023 leader_election.cc:290] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:31.481464 24056 catalog_manager.cc:5697] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 1 to 2, leader changed from 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68) to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.492223 25147 raft_consensus.cc:993] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:31.492933 25174 raft_consensus.cc:1081] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:31.493254 24383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13a5255f4d444b984355f509d3a7918" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:31.494199 24383 raft_consensus.cc:3055] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:31.495450 25023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bf4040b9d0747039fdf29b8fa99d02c"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:21:31.497908 25023 raft_consensus.cc:493] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:31.498379 25023 raft_consensus.cc:3060] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.505213 25023 raft_consensus.cc:515] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:31.505961 24383 raft_consensus.cc:740] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:31.512737 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf4040b9d0747039fdf29b8fa99d02c" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:31.513252 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf4040b9d0747039fdf29b8fa99d02c" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:31.513799 24233 raft_consensus.cc:3060] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.513832 24379 raft_consensus.cc:3055] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:31.514312 24379 raft_consensus.cc:740] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:31.514813 25023 leader_election.cc:290] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:31.515154 24379 consensus_queue.cc:260] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:31.516940 24379 raft_consensus.cc:3060] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.520507 24305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13a5255f4d444b984355f509d3a7918" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:31.521118 24305 raft_consensus.cc:3060] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.522583 24233 raft_consensus.cc:2468] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:31.523759 24972 leader_election.cc:304] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:31.524724 25168 raft_consensus.cc:2804] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:31.525223 25168 raft_consensus.cc:697] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:31.511468 24383 consensus_queue.cc:260] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:31.526786 24383 raft_consensus.cc:3060] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.527300 24379 raft_consensus.cc:2468] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:31.526315 25168 consensus_queue.cc:237] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:31.534181 24383 raft_consensus.cc:2468] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:31.534744 24305 raft_consensus.cc:2468] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:31.536219 24233 raft_consensus.cc:1275] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Refusing update from remote peer b8c6aaf55421432a91a73360865771d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.536403 24972 leader_election.cc:304] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:31.537709 25168 raft_consensus.cc:2804] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:31.538368 25168 raft_consensus.cc:697] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:31.539311 25168 consensus_queue.cc:237] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:31.542255 24379 raft_consensus.cc:1275] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer b8c6aaf55421432a91a73360865771d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.544974 25163 consensus_queue.cc:1048] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:31.546016 24056 catalog_manager.cc:5697] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 1 to 2, leader changed from 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.547118 25163 consensus_queue.cc:1048] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:31.578110 24057 catalog_manager.cc:5697] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 1 to 2, leader changed from 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:31.652710 25147 raft_consensus.cc:993] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:31.653285 25153 raft_consensus.cc:1081] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:31.654891 25023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc10ce2783b74de384326c27984c7e92"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:21:31.655376 25023 raft_consensus.cc:493] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:31.655637 25023 raft_consensus.cc:3060] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.661312 25023 raft_consensus.cc:515] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:31.663180 25023 leader_election.cc:290] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:31.664060 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc10ce2783b74de384326c27984c7e92" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:31.664261 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc10ce2783b74de384326c27984c7e92" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:31.664780 24307 raft_consensus.cc:3060] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.664793 24379 raft_consensus.cc:3055] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:31.665602 24379 raft_consensus.cc:740] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:31.666539 24379 consensus_queue.cc:260] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:31.668026 24379 raft_consensus.cc:3060] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.673205 24307 raft_consensus.cc:2468] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:31.674840 24972 leader_election.cc:304] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:31.675259 24379 raft_consensus.cc:2468] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:31.675982 25168 raft_consensus.cc:2804] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:31.676553 25168 raft_consensus.cc:697] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:31.678102 25168 consensus_queue.cc:237] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:31.694196 24054 catalog_manager.cc:5697] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 1 to 2, leader changed from 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:31.791324 25149 raft_consensus.cc:993] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:31.791831 25148 raft_consensus.cc:1081] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:31.793467 25023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2789a7bb0565468ebd309763754a3d4c"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46714
I20260709 13:21:31.794005 25023 raft_consensus.cc:493] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:31.794368 25023 raft_consensus.cc:3060] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.800949 25023 raft_consensus.cc:515] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:31.802780 25023 leader_election.cc:290] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:31.803531 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a7bb0565468ebd309763754a3d4c" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:31.803740 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a7bb0565468ebd309763754a3d4c" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:31.804175 24379 raft_consensus.cc:3060] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.804368 24233 raft_consensus.cc:3055] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:31.804760 24233 raft_consensus.cc:740] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:31.806396 24233 consensus_queue.cc:260] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:31.807740 24233 raft_consensus.cc:3060] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.811992 24379 raft_consensus.cc:2468] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:31.812906 24233 raft_consensus.cc:2468] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:31.813239 24974 leader_election.cc:304] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:31.814121 25168 raft_consensus.cc:2804] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:31.814631 25168 raft_consensus.cc:697] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:31.815510 25168 consensus_queue.cc:237] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:31.825399 24054 catalog_manager.cc:5697] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 1 to 2, leader changed from 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.875945 24379 raft_consensus.cc:1275] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer b8c6aaf55421432a91a73360865771d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.877209 25175 consensus_queue.cc:1048] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:31.893055 24233 raft_consensus.cc:1275] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Refusing update from remote peer b8c6aaf55421432a91a73360865771d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.896313 25163 consensus_queue.cc:1048] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:31.942914 24379 raft_consensus.cc:1275] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.944504 25168 consensus_queue.cc:1048] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:31.970196 24233 raft_consensus.cc:1275] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.971601 25168 consensus_queue.cc:1048] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:32.030905 24305 raft_consensus.cc:1275] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:32.032255 25168 consensus_queue.cc:1048] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:32.050900 24379 raft_consensus.cc:1275] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:32.053324 25168 consensus_queue.cc:1048] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:32.160688 24379 raft_consensus.cc:1275] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:32.161908 25168 consensus_queue.cc:1048] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:32.189800 24305 raft_consensus.cc:1275] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:32.191458 25210 consensus_queue.cc:1048] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:32.281039 24379 raft_consensus.cc:1275] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:32.282377 25210 consensus_queue.cc:1048] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:32.297343 24233 raft_consensus.cc:1275] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:32.300462 25168 consensus_queue.cc:1048] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:32.413622 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:32.459319 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:32.499073 24379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17f8ed631e60464e98c97b58568b708d"
dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
mode: GRACEFUL
new_leader_uuid: "b8c6aaf55421432a91a73360865771d3"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:21:32.499626 24379 raft_consensus.cc:606] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Received request to transfer leadership to TS b8c6aaf55421432a91a73360865771d3
I20260709 13:21:32.502892 24379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a82f5a216984c39907a5b48bbd3b560"
dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:21:32.503397 24379 raft_consensus.cc:606] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:32.505987 24379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8336ccf163c04dfa94f4eb0109695563"
dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
mode: GRACEFUL
new_leader_uuid: "b8c6aaf55421432a91a73360865771d3"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:21:32.506556 24379 raft_consensus.cc:606] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Received request to transfer leadership to TS b8c6aaf55421432a91a73360865771d3
I20260709 13:21:32.509900 24379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa056dad41df4537ab48328b7221c6cc"
dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:21:32.510447 24379 raft_consensus.cc:606] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:32.512575 24379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd"
dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:21:32.513005 24379 raft_consensus.cc:606] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:32.513938 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:32.515228 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:32.652352 25174 raft_consensus.cc:993] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:32.652915 25153 raft_consensus.cc:1081] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:32.654505 25029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa056dad41df4537ab48328b7221c6cc"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:21:32.655021 25029 raft_consensus.cc:493] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:32.655433 25029 raft_consensus.cc:3060] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.657651 25174 raft_consensus.cc:993] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb: : Instructing follower b8c6aaf55421432a91a73360865771d3 to start an election
I20260709 13:21:32.658219 25153 raft_consensus.cc:1081] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Signalling peer b8c6aaf55421432a91a73360865771d3 to start an election
I20260709 13:21:32.660084 24305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17f8ed631e60464e98c97b58568b708d"
dest_uuid: "b8c6aaf55421432a91a73360865771d3"
 from {username='slave'} at 127.0.0.1:38062
I20260709 13:21:32.660797 24305 raft_consensus.cc:493] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:32.661434 24305 raft_consensus.cc:3060] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.663296 25029 raft_consensus.cc:515] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:32.665452 25029 leader_election.cc:290] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Requested vote from peers 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:32.666428 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa056dad41df4537ab48328b7221c6cc" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:32.667073 24382 raft_consensus.cc:3055] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:32.667037 24231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa056dad41df4537ab48328b7221c6cc" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:32.667706 24382 raft_consensus.cc:740] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:32.667907 24231 raft_consensus.cc:3060] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.668414 24305 raft_consensus.cc:515] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:32.668622 24382 consensus_queue.cc:260] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:32.670135 24382 raft_consensus.cc:3060] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.670603 24305 leader_election.cc:290] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:32.671218 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f8ed631e60464e98c97b58568b708d" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:32.671835 24233 raft_consensus.cc:3060] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.675341 24379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f8ed631e60464e98c97b58568b708d" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:32.675997 24379 raft_consensus.cc:3055] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:32.676316 24379 raft_consensus.cc:740] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:32.678184 24382 raft_consensus.cc:2468] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:32.678751 24233 raft_consensus.cc:2468] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 2.
I20260709 13:21:32.677120 24379 consensus_queue.cc:260] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:32.679704 24231 raft_consensus.cc:2468] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:32.679746 24974 leader_election.cc:304] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:32.680194 24272 leader_election.cc:304] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:32.680434 24379 raft_consensus.cc:3060] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.681039 25168 raft_consensus.cc:2804] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:32.681068 25175 raft_consensus.cc:2804] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:32.681777 25168 raft_consensus.cc:697] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:32.682639 25175 raft_consensus.cc:697] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 2 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:32.682772 25168 consensus_queue.cc:237] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:32.683717 25175 consensus_queue.cc:237] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:32.688701 24379 raft_consensus.cc:2468] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 2.
I20260709 13:21:32.696647 24057 catalog_manager.cc:5697] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 1 to 2, leader changed from 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68) to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:32.704689 24054 catalog_manager.cc:5697] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 1 to 2, leader changed from 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:32.758649 25153 raft_consensus.cc:993] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:32.759192 25174 raft_consensus.cc:1081] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:32.760907 25029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a82f5a216984c39907a5b48bbd3b560"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:21:32.761754 25029 raft_consensus.cc:493] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:32.762110 25029 raft_consensus.cc:3060] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.767443 25029 raft_consensus.cc:515] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:32.770141 25029 leader_election.cc:290] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:32.770902 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a82f5a216984c39907a5b48bbd3b560" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:32.771554 24307 raft_consensus.cc:3060] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.772473 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a82f5a216984c39907a5b48bbd3b560" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:32.773095 24382 raft_consensus.cc:3055] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:32.773370 24382 raft_consensus.cc:740] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:32.774130 24382 consensus_queue.cc:260] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:32.775286 24382 raft_consensus.cc:3060] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.778577 24307 raft_consensus.cc:2468] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:32.780455 24972 leader_election.cc:304] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:32.781329 25156 raft_consensus.cc:2804] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:32.781755 25156 raft_consensus.cc:697] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:32.783026 24382 raft_consensus.cc:2468] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:32.782968 25156 consensus_queue.cc:237] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:32.794266 24054 catalog_manager.cc:5697] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 1 to 2, leader changed from 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:32.934212 25174 raft_consensus.cc:993] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb: : Instructing follower b8c6aaf55421432a91a73360865771d3 to start an election
I20260709 13:21:32.935961 25174 raft_consensus.cc:1081] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Signalling peer b8c6aaf55421432a91a73360865771d3 to start an election
I20260709 13:21:32.938005 24307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8336ccf163c04dfa94f4eb0109695563"
dest_uuid: "b8c6aaf55421432a91a73360865771d3"
 from {username='slave'} at 127.0.0.1:38062
I20260709 13:21:32.938581 24307 raft_consensus.cc:493] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:32.938894 24307 raft_consensus.cc:3060] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.945329 24307 raft_consensus.cc:515] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:32.946975 24307 leader_election.cc:290] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:32.947986 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8336ccf163c04dfa94f4eb0109695563" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:32.948751 24233 raft_consensus.cc:3060] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.947889 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8336ccf163c04dfa94f4eb0109695563" candidate_uuid: "b8c6aaf55421432a91a73360865771d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:32.949383 24382 raft_consensus.cc:3055] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:32.949815 24382 raft_consensus.cc:740] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:32.955482 24233 raft_consensus.cc:2468] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 2.
I20260709 13:21:32.950747 24382 consensus_queue.cc:260] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:32.956600 24272 leader_election.cc:304] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:32.957839 25153 raft_consensus.cc:993] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:32.958354 25153 raft_consensus.cc:1081] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:32.958527 24382 raft_consensus.cc:3060] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.959970 25028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:21:32.960614 25028 raft_consensus.cc:493] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:32.961017 25028 raft_consensus.cc:3060] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:32.964272 24382 raft_consensus.cc:2468] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c6aaf55421432a91a73360865771d3 in term 2.
I20260709 13:21:32.957572 25163 raft_consensus.cc:2804] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:32.966526 25163 raft_consensus.cc:697] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 2 LEADER]: Becoming Leader. State: Replica: b8c6aaf55421432a91a73360865771d3, State: Running, Role: LEADER
I20260709 13:21:32.967429 25163 consensus_queue.cc:237] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:32.968706 25028 raft_consensus.cc:515] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:32.971812 24307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:32.972400 24307 raft_consensus.cc:3060] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:32.974790 25028 leader_election.cc:290] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 3 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:32.975790 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768d2f1ef2449b5b035c41ed3fa15bd" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:32.976429 24382 raft_consensus.cc:3055] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:32.976735 24382 raft_consensus.cc:740] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:32.977500 24382 consensus_queue.cc:260] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:32.978878 24382 raft_consensus.cc:3060] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:32.981643 24054 catalog_manager.cc:5697] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 reported cstate change: term changed from 1 to 2, leader changed from 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68) to b8c6aaf55421432a91a73360865771d3 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "b8c6aaf55421432a91a73360865771d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:32.985635 24382 raft_consensus.cc:2468] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 3.
I20260709 13:21:32.986792 24974 leader_election.cc:304] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb, 97e577a376c948bfac33665f06a4bb98; no voters: 
I20260709 13:21:32.981652 24307 raft_consensus.cc:2468] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 3.
I20260709 13:21:32.987617 25156 raft_consensus.cc:2804] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:32.988186 25156 raft_consensus.cc:697] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 3 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:32.989041 25156 consensus_queue.cc:237] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:33.000828 24054 catalog_manager.cc:5697] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 2 to 3, leader changed from 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 3 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:33.094422 24379 raft_consensus.cc:1275] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.095856 25156 consensus_queue.cc:1048] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:33.097986 24379 raft_consensus.cc:1275] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer b8c6aaf55421432a91a73360865771d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.099351 25163 consensus_queue.cc:1048] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:33.130649 24233 raft_consensus.cc:1275] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.132354 25210 consensus_queue.cc:1048] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:33.136765 24232 raft_consensus.cc:1275] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Refusing update from remote peer b8c6aaf55421432a91a73360865771d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.138947 25175 consensus_queue.cc:1048] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:33.176867 24307 raft_consensus.cc:1275] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.178316 25210 consensus_queue.cc:1048] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:33.195892 24382 raft_consensus.cc:1275] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.198179 25210 consensus_queue.cc:1048] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:33.424434 24379 raft_consensus.cc:1275] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 3 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:33.425783 25210 consensus_queue.cc:1048] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:33.434880 24305 raft_consensus.cc:1275] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 3 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:33.436193 25156 consensus_queue.cc:1048] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:33.444422 24233 raft_consensus.cc:1275] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Refusing update from remote peer b8c6aaf55421432a91a73360865771d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.447393 25175 consensus_queue.cc:1048] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:33.466681 24382 raft_consensus.cc:1275] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer b8c6aaf55421432a91a73360865771d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.469805 25163 consensus_queue.cc:1048] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:33.516068 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:33.566800 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:33.610183 24382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21208eaee0f548318b6d3fd6edb3e12f"
dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:21:33.610772 24382 raft_consensus.cc:606] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:33.613288 24382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b80418d8094044258597b8ab9021a04e"
dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
mode: GRACEFUL
new_leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:21:33.613790 24382 raft_consensus.cc:606] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Received request to transfer leadership to TS 3e96a35df00e4646b9c6e356c6fb4bba
I20260709 13:21:33.614852 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:33.616173 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:33.634016 25153 raft_consensus.cc:993] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb: : Instructing follower 3e96a35df00e4646b9c6e356c6fb4bba to start an election
I20260709 13:21:33.634619 25228 raft_consensus.cc:1081] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Signalling peer 3e96a35df00e4646b9c6e356c6fb4bba to start an election
I20260709 13:21:33.636153 24233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b80418d8094044258597b8ab9021a04e"
dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
 from {username='slave'} at 127.0.0.1:38268
I20260709 13:21:33.636603 24233 raft_consensus.cc:493] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:33.636926 24233 raft_consensus.cc:3060] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.641340 24233 raft_consensus.cc:515] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:33.643476 24233 leader_election.cc:290] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 2 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:33.644215 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80418d8094044258597b8ab9021a04e" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:33.644747 24308 raft_consensus.cc:3060] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.644865 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80418d8094044258597b8ab9021a04e" candidate_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:33.645483 24382 raft_consensus.cc:3055] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:33.645711 24382 raft_consensus.cc:740] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:33.646489 24382 consensus_queue.cc:260] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:33.647470 24382 raft_consensus.cc:3060] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.651052 24308 raft_consensus.cc:2468] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 2.
I20260709 13:21:33.652460 24198 leader_election.cc:304] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e96a35df00e4646b9c6e356c6fb4bba, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:33.653461 25216 raft_consensus.cc:2804] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:33.654228 25216 raft_consensus.cc:697] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 LEADER]: Becoming Leader. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:33.655146 25216 consensus_queue.cc:237] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } }
I20260709 13:21:33.656383 24382 raft_consensus.cc:2468] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e96a35df00e4646b9c6e356c6fb4bba in term 2.
I20260709 13:21:33.667119 24054 catalog_manager.cc:5697] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba reported cstate change: term changed from 1 to 2, leader changed from 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68) to 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66). New cstate: current_term: 2 leader_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:33.916551 25228 raft_consensus.cc:993] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:33.917140 25153 raft_consensus.cc:1081] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:33.992079 25029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21208eaee0f548318b6d3fd6edb3e12f"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:21:33.998828 25029 raft_consensus.cc:493] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:34.024494 25029 raft_consensus.cc:3060] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.045251 24309 raft_consensus.cc:1275] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Refusing update from remote peer 3e96a35df00e4646b9c6e356c6fb4bba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.049163 25239 consensus_queue.cc:1048] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:21:34.059540 25029 raft_consensus.cc:515] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:34.062448 25029 leader_election.cc:290] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Requested vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68:44365)
I20260709 13:21:34.065707 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208eaee0f548318b6d3fd6edb3e12f" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:34.068528 24309 raft_consensus.cc:3060] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.085064 24382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21208eaee0f548318b6d3fd6edb3e12f" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb"
I20260709 13:21:34.086463 24382 raft_consensus.cc:3055] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:34.087807 24382 raft_consensus.cc:740] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96be869fbe4e464a99c0d5aa3d90dbfb, State: Running, Role: LEADER
I20260709 13:21:34.089645 24382 consensus_queue.cc:260] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:34.099798 24382 raft_consensus.cc:3060] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.127700 24309 raft_consensus.cc:2468] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:34.131752 24972 leader_election.cc:304] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:34.133036 25168 raft_consensus.cc:2804] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.133674 25168 raft_consensus.cc:697] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:34.135380 25168 consensus_queue.cc:237] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:34.137012 24382 raft_consensus.cc:2468] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:34.159900 24382 raft_consensus.cc:1275] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 3e96a35df00e4646b9c6e356c6fb4bba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.161552 25239 consensus_queue.cc:1048] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:34.170213 24054 catalog_manager.cc:5697] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 1 to 2, leader changed from 96be869fbe4e464a99c0d5aa3d90dbfb (127.15.242.68) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:34.617522 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:34.644505 24309 raft_consensus.cc:1275] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.646391 25210 consensus_queue.cc:1048] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:34.670892 24379 raft_consensus.cc:1275] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.672322 25168 consensus_queue.cc:1048] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:34.681915 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:34.729602 24233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "135602f434b34156a908d7dea9da6594"
dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
mode: GRACEFUL
new_leader_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:49992
I20260709 13:21:34.730418 24233 raft_consensus.cc:606] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Received request to transfer leadership to TS 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:34.732074 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:21:34.733440 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:35.192459 25216 raft_consensus.cc:993] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba: : Instructing follower 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:35.193066 25148 raft_consensus.cc:1081] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Signalling peer 97e577a376c948bfac33665f06a4bb98 to start an election
I20260709 13:21:35.194639 25029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "135602f434b34156a908d7dea9da6594"
dest_uuid: "97e577a376c948bfac33665f06a4bb98"
 from {username='slave'} at 127.0.0.1:46714
I20260709 13:21:35.195080 25029 raft_consensus.cc:493] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:35.195349 25029 raft_consensus.cc:3060] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.201475 25029 raft_consensus.cc:515] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:35.203150 25029 leader_election.cc:290] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Requested vote from peers 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445), b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833)
I20260709 13:21:35.203940 24231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e96a35df00e4646b9c6e356c6fb4bba"
I20260709 13:21:35.204568 24231 raft_consensus.cc:3055] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:35.204047 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135602f434b34156a908d7dea9da6594" candidate_uuid: "97e577a376c948bfac33665f06a4bb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c6aaf55421432a91a73360865771d3"
I20260709 13:21:35.205348 24231 raft_consensus.cc:740] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e96a35df00e4646b9c6e356c6fb4bba, State: Running, Role: LEADER
I20260709 13:21:35.205806 24309 raft_consensus.cc:3060] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.206638 24231 consensus_queue.cc:260] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:35.208310 24231 raft_consensus.cc:3060] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.212574 24309 raft_consensus.cc:2468] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:35.213929 24972 leader_election.cc:304] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3; no voters: 
I20260709 13:21:35.214850 25168 raft_consensus.cc:2804] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:35.215240 25168 raft_consensus.cc:697] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Becoming Leader. State: Replica: 97e577a376c948bfac33665f06a4bb98, State: Running, Role: LEADER
I20260709 13:21:35.216199 25168 consensus_queue.cc:237] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } }
I20260709 13:21:35.219276 24231 raft_consensus.cc:2468] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e577a376c948bfac33665f06a4bb98 in term 2.
I20260709 13:21:35.229364 24054 catalog_manager.cc:5697] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 reported cstate change: term changed from 1 to 2, leader changed from 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66) to 97e577a376c948bfac33665f06a4bb98 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "97e577a376c948bfac33665f06a4bb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.734455 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:35.737629 24231 raft_consensus.cc:1275] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.740456 25210 consensus_queue.cc:1048] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.755595 24309 raft_consensus.cc:1275] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Refusing update from remote peer 97e577a376c948bfac33665f06a4bb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.756927 25210 consensus_queue.cc:1048] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.788913 16329 tablet_server.cc:179] TabletServer@127.15.242.65:39703 shutting down...
W20260709 13:21:35.815541 24200 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 124 similar messages]
W20260709 13:21:35.820210 24200 consensus_peers.cc:597] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.841503 24348 consensus_peers.cc:597] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.844604 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:35.845643 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.846725 16329 raft_consensus.cc:2243] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.847236 16329 raft_consensus.cc:2272] T 4105e0d91861411cab1b9ed694694e6a P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.849983 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.850939 16329 raft_consensus.cc:2243] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.851531 16329 raft_consensus.cc:2272] T 619d34e00ecc47839c94d82bacd2add7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.855201 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.857306 16329 raft_consensus.cc:2243] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.857846 16329 raft_consensus.cc:2272] T fc15fe782c914a21a8001515c189022a P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.861675 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.862640 16329 raft_consensus.cc:2243] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.863209 16329 raft_consensus.cc:2272] T bd488127e8e5406e956c1118ed2ffbbc P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.866114 16329 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:35.867347 24274 consensus_peers.cc:597] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.868140 16329 raft_consensus.cc:2243] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.868836 16329 raft_consensus.cc:2272] T 33ca7353f12e4915a607cd21f4492c2e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.873610 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.874668 16329 raft_consensus.cc:2243] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.875164 16329 raft_consensus.cc:2272] T 1022101d02354929a4335f20304fdcb0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.877363 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.878216 16329 raft_consensus.cc:2243] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.879400 16329 raft_consensus.cc:2272] T b5172214c61f4935bce32538470f1ef8 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.882225 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.883060 16329 raft_consensus.cc:2243] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.884109 16329 raft_consensus.cc:2272] T d768d2f1ef2449b5b035c41ed3fa15bd P 97e577a376c948bfac33665f06a4bb98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.886626 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.887234 16329 raft_consensus.cc:2243] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.887723 16329 raft_consensus.cc:2272] T feff48c38ffe40ec83c61e469590bab2 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.889897 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.890596 16329 raft_consensus.cc:2243] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.891116 16329 raft_consensus.cc:2272] T 08f87db850ae4d62b879e989d7572ad8 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.894559 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.895510 16329 raft_consensus.cc:2243] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.896008 16329 raft_consensus.cc:2272] T 96813b389fd14d7890c804a06966b952 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.898746 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.899394 16329 raft_consensus.cc:2243] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.899847 16329 raft_consensus.cc:2272] T d48bb74e965d44649059c6cbae8878b9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.902118 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.902688 16329 raft_consensus.cc:2243] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.903198 16329 raft_consensus.cc:2272] T c29861adc1e34aeb8b9916d115af5f9b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.905221 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.905813 16329 raft_consensus.cc:2243] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.906770 16329 raft_consensus.cc:2272] T 2789a7bb0565468ebd309763754a3d4c P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.909673 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.910444 16329 raft_consensus.cc:2243] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.910979 16329 raft_consensus.cc:2272] T 61ca07974685419bbf6372e6306542e8 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.912981 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.913671 16329 raft_consensus.cc:2243] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.914211 16329 raft_consensus.cc:2272] T 9c8d5d925cdf4b799f067f0763e2b3af P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.916900 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.917661 16329 raft_consensus.cc:2243] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:35.917683 24200 consensus_peers.cc:597] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.918277 16329 raft_consensus.cc:2272] T 2e20ad9ccb7d416fb78ca24817f25f01 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.920324 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.920892 16329 raft_consensus.cc:2243] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.921675 16329 raft_consensus.cc:2272] T 0bf4040b9d0747039fdf29b8fa99d02c P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.923732 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.924647 16329 raft_consensus.cc:2243] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.925287 16329 raft_consensus.cc:2272] T 0b184e3a09204b16a54a19c799fe3491 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.928278 24348 consensus_peers.cc:597] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.928524 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.929453 16329 raft_consensus.cc:2243] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.929994 16329 raft_consensus.cc:2272] T 926dce38ed89423898a8cd9ca37e1f7e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.933110 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.933982 16329 raft_consensus.cc:2243] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.934515 16329 raft_consensus.cc:2272] T e0bbda74ba444fd2bd1ad847ca18463d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.937685 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.938565 16329 raft_consensus.cc:2243] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.939117 16329 raft_consensus.cc:2272] T f41cf4b67fba4c29b17c18984f51368f P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.942209 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.942821 16329 raft_consensus.cc:2243] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.943737 16329 raft_consensus.cc:2272] T aa056dad41df4537ab48328b7221c6cc P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.945960 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.946530 16329 raft_consensus.cc:2243] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.946910 16329 raft_consensus.cc:2272] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.948958 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.949579 16329 raft_consensus.cc:2243] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.950417 16329 raft_consensus.cc:2272] T d13a5255f4d444b984355f509d3a7918 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.952948 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.953677 16329 raft_consensus.cc:2243] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.954592 16329 raft_consensus.cc:2272] T 21208eaee0f548318b6d3fd6edb3e12f P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.955324 24274 consensus_peers.cc:597] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.956967 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.957839 16329 raft_consensus.cc:2243] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.958295 16329 raft_consensus.cc:2272] T 3863e0f41bbc4ace93654a83e2578032 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.960450 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.961289 16329 raft_consensus.cc:2243] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.961894 16329 raft_consensus.cc:2272] T 449b9227c5fd46caa8fb8daa040867e9 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.965211 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.966013 16329 raft_consensus.cc:2243] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.966531 16329 raft_consensus.cc:2272] T b1ea9e8d8e234a52956bc1fc72b80c6e P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.969293 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.969987 16329 raft_consensus.cc:2243] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.970564 16329 raft_consensus.cc:2272] T 5c7d5de1a9b448969e2db6601b724c9c P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.973450 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.974356 16329 raft_consensus.cc:2243] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.975396 16329 raft_consensus.cc:2272] T 2a82f5a216984c39907a5b48bbd3b560 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.978758 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.979606 16329 raft_consensus.cc:2243] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.980752 16329 raft_consensus.cc:2272] T 2dfc3f1f066843e382fa402c8d4ec110 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.982259 24200 consensus_peers.cc:597] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.983692 24200 consensus_peers.cc:597] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.983894 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.984871 16329 raft_consensus.cc:2243] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.985847 16329 raft_consensus.cc:2272] T bacd8d22901e4b63b728d0d94e835a27 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.989375 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.990248 16329 raft_consensus.cc:2243] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.990797 16329 raft_consensus.cc:2272] T dbb065e24bd14e7f86badfbb68d51325 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.993461 24348 consensus_peers.cc:597] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.994122 16329 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:35.994534 24200 consensus_peers.cc:597] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.995074 16329 raft_consensus.cc:2243] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.996223 16329 raft_consensus.cc:2272] T cbbd9769488e4db0bf3addb6ae875e51 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.999320 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:36.000413 16329 raft_consensus.cc:2243] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.000995 16329 raft_consensus.cc:2272] T b9e21b3c9af648169d5786fe63dd5df7 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.004081 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:36.004706 16329 raft_consensus.cc:2243] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.005791 16329 raft_consensus.cc:2272] T 95192d3963414bdfac891aba6df47f7c P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.008531 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:36.009111 16329 raft_consensus.cc:2243] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.009886 16329 raft_consensus.cc:2272] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 97e577a376c948bfac33665f06a4bb98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.011965 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:36.012569 16329 raft_consensus.cc:2243] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.012894 16329 raft_consensus.cc:2272] T e9b893af727e4323b5c5f832d0b543a0 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.014909 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:36.015383 16329 raft_consensus.cc:2243] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.015772 16329 raft_consensus.cc:2272] T ae2833e9ae264f259ce3c2967ad5bc2d P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.017800 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:36.018358 16329 raft_consensus.cc:2243] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.018740 16329 raft_consensus.cc:2272] T 0814205560524ce18e70c58645190dcd P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.020951 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:36.021440 16329 raft_consensus.cc:2243] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.021920 16329 raft_consensus.cc:2272] T f4118ee5e16a4387ac189a181756ba0b P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.024739 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:36.025424 16329 raft_consensus.cc:2243] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.025931 16329 raft_consensus.cc:2272] T 965a2d41972049e2975015ab66773956 P 97e577a376c948bfac33665f06a4bb98 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.025970 24200 consensus_peers.cc:597] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.028292 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:36.028859 16329 raft_consensus.cc:2243] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.029874 16329 raft_consensus.cc:2272] T dc10ce2783b74de384326c27984c7e92 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.032620 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:36.033031 16329 raft_consensus.cc:2243] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.033696 16329 raft_consensus.cc:2272] T 135602f434b34156a908d7dea9da6594 P 97e577a376c948bfac33665f06a4bb98 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.037528 24348 consensus_peers.cc:597] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.048570 24274 consensus_peers.cc:597] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.070096 24274 consensus_peers.cc:597] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.074682 24348 consensus_peers.cc:597] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.082482 24200 consensus_peers.cc:597] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.110900 16329 tablet_server.cc:196] TabletServer@127.15.242.65:39703 shutdown complete.
W20260709 13:21:36.115144 24200 consensus_peers.cc:597] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.138914 24274 consensus_peers.cc:597] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.172240 24348 consensus_peers.cc:597] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.180544 24348 consensus_peers.cc:597] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.184908 24348 consensus_peers.cc:597] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.187687 24200 consensus_peers.cc:597] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.198652 24348 consensus_peers.cc:597] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.206882 16329 tablet_server.cc:179] TabletServer@127.15.242.66:0 shutting down...
W20260709 13:21:36.238327 24272 consensus_peers.cc:597] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.250514 24274 consensus_peers.cc:597] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.251873 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:21:36.252367 24346 consensus_peers.cc:597] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.252914 16329 tablet_replica.cc:333] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.254256 16329 raft_consensus.cc:2243] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.255318 16329 raft_consensus.cc:2272] T e9b893af727e4323b5c5f832d0b543a0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.255957 24200 consensus_peers.cc:597] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.257725 16329 tablet_replica.cc:333] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.258445 16329 raft_consensus.cc:2243] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.258893 16329 raft_consensus.cc:2272] T 2789a7bb0565468ebd309763754a3d4c P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.261593 16329 tablet_replica.cc:333] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.262548 16329 raft_consensus.cc:2243] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.263152 16329 raft_consensus.cc:2272] T aa056dad41df4537ab48328b7221c6cc P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.265105 16329 tablet_replica.cc:333] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.265731 16329 raft_consensus.cc:2243] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.266670 16329 raft_consensus.cc:2272] T 4105e0d91861411cab1b9ed694694e6a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.268741 16329 tablet_replica.cc:333] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.269312 16329 raft_consensus.cc:2243] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.270208 16329 raft_consensus.cc:2272] T 33ca7353f12e4915a607cd21f4492c2e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.272363 16329 tablet_replica.cc:333] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.273044 16329 raft_consensus.cc:2243] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.274102 16329 raft_consensus.cc:2272] T 135602f434b34156a908d7dea9da6594 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.277055 16329 tablet_replica.cc:333] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
W20260709 13:21:36.277365 24200 consensus_peers.cc:597] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.277809 16329 raft_consensus.cc:2243] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.278364 16329 raft_consensus.cc:2272] T 17f8ed631e60464e98c97b58568b708d P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.280767 16329 tablet_replica.cc:333] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.281577 16329 raft_consensus.cc:2243] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.282231 16329 raft_consensus.cc:2272] T b2f81314f6f14fa9a2c432de6bddcb21 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.284451 24272 consensus_peers.cc:597] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.284777 24346 consensus_peers.cc:597] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.285677 16329 tablet_replica.cc:333] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.286427 16329 raft_consensus.cc:2243] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.286935 16329 raft_consensus.cc:2272] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.289047 16329 tablet_replica.cc:333] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.289803 16329 raft_consensus.cc:2243] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.290647 16329 raft_consensus.cc:2272] T e0bbda74ba444fd2bd1ad847ca18463d P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.293139 16329 tablet_replica.cc:333] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.293972 16329 raft_consensus.cc:2243] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.294577 16329 raft_consensus.cc:2272] T 94b95f5240b5450d968047f65e13d4ea P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.296666 24272 consensus_peers.cc:597] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.297713 16329 tablet_replica.cc:333] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.298563 16329 raft_consensus.cc:2243] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.299634 16329 raft_consensus.cc:2272] T bacd8d22901e4b63b728d0d94e835a27 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.300423 24274 consensus_peers.cc:597] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.302582 16329 tablet_replica.cc:333] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
W20260709 13:21:36.303462 24346 consensus_peers.cc:597] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.303526 16329 raft_consensus.cc:2243] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.304669 16329 raft_consensus.cc:2272] T dbb065e24bd14e7f86badfbb68d51325 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.306939 16329 tablet_replica.cc:333] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.307528 16329 raft_consensus.cc:2243] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.307966 16329 raft_consensus.cc:2272] T fc15fe782c914a21a8001515c189022a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.310508 16329 tablet_replica.cc:333] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.311146 16329 raft_consensus.cc:2243] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.311688 16329 raft_consensus.cc:2272] T 619d34e00ecc47839c94d82bacd2add7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.314306 16329 tablet_replica.cc:333] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
W20260709 13:21:36.314828 24348 consensus_peers.cc:597] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.314859 16329 raft_consensus.cc:2243] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:36.315454 24348 consensus_peers.cc:597] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.315728 16329 raft_consensus.cc:2272] T 7de7548eaeb146eeb29df319abe407f5 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.319137 16329 tablet_replica.cc:333] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.320124 16329 raft_consensus.cc:2243] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.320772 16329 raft_consensus.cc:2272] T 95192d3963414bdfac891aba6df47f7c P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.321190 24272 consensus_peers.cc:597] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.323064 24348 consensus_peers.cc:597] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.323836 16329 tablet_replica.cc:333] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.324479 16329 raft_consensus.cc:2243] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.324941 16329 raft_consensus.cc:2272] T 8336ccf163c04dfa94f4eb0109695563 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.327167 16329 tablet_replica.cc:333] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.327850 16329 raft_consensus.cc:2243] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.328352 16329 raft_consensus.cc:2272] T b5172214c61f4935bce32538470f1ef8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.330834 16329 tablet_replica.cc:333] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.331574 16329 raft_consensus.cc:2243] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.332151 16329 raft_consensus.cc:2272] T 2dfc3f1f066843e382fa402c8d4ec110 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.334842 16329 tablet_replica.cc:333] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.335757 16329 raft_consensus.cc:2243] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.336359 16329 raft_consensus.cc:2272] T be7f93cd2c1042aa9ce8434973e4e95a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.338904 24274 consensus_peers.cc:597] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 -> Peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Couldn't send request to peer 97e577a376c948bfac33665f06a4bb98. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.339459 16329 tablet_replica.cc:333] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.340363 16329 raft_consensus.cc:2243] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.340896 16329 raft_consensus.cc:2272] T b5e41c560ee74f5c860ed22ba1487d2d P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.341244 24346 consensus_peers.cc:597] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.344646 16329 tablet_replica.cc:333] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.345412 16329 raft_consensus.cc:2243] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.345947 16329 raft_consensus.cc:2272] T 1022101d02354929a4335f20304fdcb0 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.347736 24272 consensus_peers.cc:597] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.348552 16329 tablet_replica.cc:333] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.349200 16329 raft_consensus.cc:2243] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.350134 16329 raft_consensus.cc:2272] T 449b9227c5fd46caa8fb8daa040867e9 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.352221 16329 tablet_replica.cc:333] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.352787 16329 raft_consensus.cc:2243] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.353547 16329 raft_consensus.cc:2272] T b80418d8094044258597b8ab9021a04e P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.355753 16329 tablet_replica.cc:333] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.356520 16329 raft_consensus.cc:2243] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.357537 16329 raft_consensus.cc:2272] T f4118ee5e16a4387ac189a181756ba0b P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.358189 24272 consensus_peers.cc:597] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.359809 16329 tablet_replica.cc:333] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.360479 16329 raft_consensus.cc:2243] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.360936 16329 raft_consensus.cc:2272] T 965a2d41972049e2975015ab66773956 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.362999 16329 tablet_replica.cc:333] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.363730 16329 raft_consensus.cc:2243] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.364831 16329 raft_consensus.cc:2272] T 2e20ad9ccb7d416fb78ca24817f25f01 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.367969 16329 tablet_replica.cc:333] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.368790 16329 raft_consensus.cc:2243] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.369278 16329 raft_consensus.cc:2272] T 3863e0f41bbc4ace93654a83e2578032 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.372087 16329 tablet_replica.cc:333] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.372807 16329 raft_consensus.cc:2243] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.373307 16329 raft_consensus.cc:2272] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.375905 16329 tablet_replica.cc:333] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.376636 16329 raft_consensus.cc:2243] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.377743 16329 raft_consensus.cc:2272] T 5c7d5de1a9b448969e2db6601b724c9c P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.380435 16329 tablet_replica.cc:333] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.381150 16329 raft_consensus.cc:2243] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.382274 16329 raft_consensus.cc:2272] T 96813b389fd14d7890c804a06966b952 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.384310 16329 tablet_replica.cc:333] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.384866 16329 raft_consensus.cc:2243] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.385349 16329 raft_consensus.cc:2272] T c67fd67822294670b224a43c149b126f P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.387717 16329 tablet_replica.cc:333] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.388280 16329 raft_consensus.cc:2243] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.388811 16329 raft_consensus.cc:2272] T cbbd9769488e4db0bf3addb6ae875e51 P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.390910 16329 tablet_replica.cc:333] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.391448 16329 raft_consensus.cc:2243] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.391875 16329 raft_consensus.cc:2272] T b9e21b3c9af648169d5786fe63dd5df7 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.393750 16329 tablet_replica.cc:333] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.394223 16329 raft_consensus.cc:2243] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.394960 16329 raft_consensus.cc:2272] T c64b5ba5e5d84dd78ae3c83e7c375709 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.397018 16329 tablet_replica.cc:333] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.397475 16329 raft_consensus.cc:2243] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.397845 16329 raft_consensus.cc:2272] T cfb70981888a450ca715b1ed427ba95e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.399892 16329 tablet_replica.cc:333] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.400355 16329 raft_consensus.cc:2243] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.400722 16329 raft_consensus.cc:2272] T 0bf4040b9d0747039fdf29b8fa99d02c P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.402792 16329 tablet_replica.cc:333] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.403295 16329 raft_consensus.cc:2243] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.403730 16329 raft_consensus.cc:2272] T 926dce38ed89423898a8cd9ca37e1f7e P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.405755 16329 tablet_replica.cc:333] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.406319 16329 raft_consensus.cc:2243] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.406778 16329 raft_consensus.cc:2272] T 4206794ab99d4bc2b0573743d29d74ca P 3e96a35df00e4646b9c6e356c6fb4bba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.408876 16329 tablet_replica.cc:333] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.409403 16329 raft_consensus.cc:2243] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.409925 16329 raft_consensus.cc:2272] T 08f87db850ae4d62b879e989d7572ad8 P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.411859 16329 tablet_replica.cc:333] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.412359 16329 raft_consensus.cc:2243] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.413165 16329 raft_consensus.cc:2272] T bb6f84753e2b4220a883363c1561af3a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.415203 16329 tablet_replica.cc:333] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.415707 16329 raft_consensus.cc:2243] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.416416 16329 raft_consensus.cc:2272] T f6350c1629234440b97877600cb50d2a P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.419003 16329 tablet_replica.cc:333] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba: stopping tablet replica
I20260709 13:21:36.419824 16329 raft_consensus.cc:2243] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.420404 16329 raft_consensus.cc:2272] T 0814205560524ce18e70c58645190dcd P 3e96a35df00e4646b9c6e356c6fb4bba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.433456 24272 consensus_peers.cc:597] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.501307 16329 tablet_server.cc:196] TabletServer@127.15.242.66:0 shutdown complete.
W20260709 13:21:36.513896 24346 consensus_peers.cc:597] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.514621 24346 consensus_peers.cc:597] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.520846 24272 consensus_peers.cc:597] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.533265 24346 consensus_peers.cc:597] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.563271 24272 consensus_peers.cc:597] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.569149 24272 consensus_peers.cc:597] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.576733 24346 consensus_peers.cc:597] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.577292 24346 consensus_peers.cc:597] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:36.607193 24346 consensus_peers.cc:597] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Couldn't send request to peer 3e96a35df00e4646b9c6e356c6fb4bba. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.608399 16329 tablet_server.cc:179] TabletServer@127.15.242.67:0 shutting down...
I20260709 13:21:36.682086 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:36.682998 16329 tablet_replica.cc:333] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.683759 16329 raft_consensus.cc:2243] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.684289 16329 raft_consensus.cc:2272] T 7de7548eaeb146eeb29df319abe407f5 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.686483 16329 tablet_replica.cc:333] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.687069 16329 raft_consensus.cc:2243] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.687582 16329 raft_consensus.cc:2272] T e9b893af727e4323b5c5f832d0b543a0 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.689546 16329 tablet_replica.cc:333] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.690212 16329 raft_consensus.cc:2243] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.691057 16329 raft_consensus.cc:2272] T 17f8ed631e60464e98c97b58568b708d P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.692853 16329 tablet_replica.cc:333] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.693485 16329 raft_consensus.cc:2243] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.693907 16329 raft_consensus.cc:2272] T 4105e0d91861411cab1b9ed694694e6a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.696347 16329 tablet_replica.cc:333] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.697006 16329 raft_consensus.cc:2243] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.697599 16329 raft_consensus.cc:2272] T 33ca7353f12e4915a607cd21f4492c2e P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.700706 16329 tablet_replica.cc:333] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.701638 16329 raft_consensus.cc:2243] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.702288 16329 raft_consensus.cc:2272] T bd488127e8e5406e956c1118ed2ffbbc P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.705408 16329 tablet_replica.cc:333] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.706626 16329 raft_consensus.cc:2243] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.707340 16329 raft_consensus.cc:2272] T b2f81314f6f14fa9a2c432de6bddcb21 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.711321 16329 tablet_replica.cc:333] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.712436 16329 raft_consensus.cc:2243] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.713150 16329 raft_consensus.cc:2272] T 135602f434b34156a908d7dea9da6594 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.717886 16329 tablet_replica.cc:333] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.718962 16329 raft_consensus.cc:2243] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.719585 16329 raft_consensus.cc:2272] T e0bbda74ba444fd2bd1ad847ca18463d P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.722684 16329 tablet_replica.cc:333] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.723493 16329 raft_consensus.cc:2243] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.724642 16329 raft_consensus.cc:2272] T 619d34e00ecc47839c94d82bacd2add7 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.729650 16329 tablet_replica.cc:333] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.730611 16329 raft_consensus.cc:2243] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.731212 16329 raft_consensus.cc:2272] T bacd8d22901e4b63b728d0d94e835a27 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.734354 16329 tablet_replica.cc:333] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
W20260709 13:21:36.734354 24346 consensus_peers.cc:597] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833): Couldn't send request to peer b8c6aaf55421432a91a73360865771d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.735314 16329 raft_consensus.cc:2243] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.735983 16329 raft_consensus.cc:2272] T dbb065e24bd14e7f86badfbb68d51325 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.738811 16329 tablet_replica.cc:333] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
W20260709 13:21:36.738956 24346 consensus_peers.cc:597] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833): Couldn't send request to peer b8c6aaf55421432a91a73360865771d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.739647 16329 raft_consensus.cc:2243] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.740521 16329 raft_consensus.cc:2272] T 4206794ab99d4bc2b0573743d29d74ca P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.742623 16329 tablet_replica.cc:333] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.743219 16329 raft_consensus.cc:2243] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.743634 16329 raft_consensus.cc:2272] T bb6f84753e2b4220a883363c1561af3a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.745831 16329 tablet_replica.cc:333] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.746476 16329 raft_consensus.cc:2243] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.747262 16329 raft_consensus.cc:2272] T 08f87db850ae4d62b879e989d7572ad8 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.750085 16329 tablet_replica.cc:333] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.751022 16329 raft_consensus.cc:2243] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.751714 16329 raft_consensus.cc:2272] T d768d2f1ef2449b5b035c41ed3fa15bd P b8c6aaf55421432a91a73360865771d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.754740 16329 tablet_replica.cc:333] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.755661 16329 raft_consensus.cc:2243] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.756726 16329 raft_consensus.cc:2272] T feff48c38ffe40ec83c61e469590bab2 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.759292 16329 tablet_replica.cc:333] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.759902 16329 raft_consensus.cc:2243] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.760754 16329 raft_consensus.cc:2272] T 8336ccf163c04dfa94f4eb0109695563 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.763123 16329 tablet_replica.cc:333] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.763775 16329 raft_consensus.cc:2243] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.764623 16329 raft_consensus.cc:2272] T 94b95f5240b5450d968047f65e13d4ea P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.767217 16329 tablet_replica.cc:333] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.767902 16329 raft_consensus.cc:2243] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.768395 16329 raft_consensus.cc:2272] T f41cf4b67fba4c29b17c18984f51368f P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.770643 16329 tablet_replica.cc:333] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.771245 16329 raft_consensus.cc:2243] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.771701 16329 raft_consensus.cc:2272] T 449b9227c5fd46caa8fb8daa040867e9 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.773893 16329 tablet_replica.cc:333] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.774542 16329 raft_consensus.cc:2243] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.774991 16329 raft_consensus.cc:2272] T be7f93cd2c1042aa9ce8434973e4e95a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.777287 16329 tablet_replica.cc:333] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.777875 16329 raft_consensus.cc:2243] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.778841 16329 raft_consensus.cc:2272] T b5e41c560ee74f5c860ed22ba1487d2d P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.781263 16329 tablet_replica.cc:333] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.782058 16329 raft_consensus.cc:2243] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.782630 16329 raft_consensus.cc:2272] T 2a82f5a216984c39907a5b48bbd3b560 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.785215 16329 tablet_replica.cc:333] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.786096 16329 raft_consensus.cc:2243] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.786670 16329 raft_consensus.cc:2272] T b1ea9e8d8e234a52956bc1fc72b80c6e P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.789601 16329 tablet_replica.cc:333] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.790773 16329 raft_consensus.cc:2243] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.791570 16329 raft_consensus.cc:2272] T 5c7d5de1a9b448969e2db6601b724c9c P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.794363 16329 tablet_replica.cc:333] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.795066 16329 raft_consensus.cc:2243] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.796191 16329 raft_consensus.cc:2272] T 0814205560524ce18e70c58645190dcd P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.799258 16329 tablet_replica.cc:333] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.799973 16329 raft_consensus.cc:2243] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.800782 16329 raft_consensus.cc:2272] T ae2833e9ae264f259ce3c2967ad5bc2d P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.803195 16329 tablet_replica.cc:333] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.803826 16329 raft_consensus.cc:2243] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.804311 16329 raft_consensus.cc:2272] T f6350c1629234440b97877600cb50d2a P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.806658 16329 tablet_replica.cc:333] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.807296 16329 raft_consensus.cc:2243] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.808081 16329 raft_consensus.cc:2272] T 61ca07974685419bbf6372e6306542e8 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.810222 16329 tablet_replica.cc:333] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.810781 16329 raft_consensus.cc:2243] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.811496 16329 raft_consensus.cc:2272] T c67fd67822294670b224a43c149b126f P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.813445 16329 tablet_replica.cc:333] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.813971 16329 raft_consensus.cc:2243] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.814484 16329 raft_consensus.cc:2272] T c29861adc1e34aeb8b9916d115af5f9b P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.816653 16329 tablet_replica.cc:333] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.817312 16329 raft_consensus.cc:2243] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.817752 16329 raft_consensus.cc:2272] T 9c8d5d925cdf4b799f067f0763e2b3af P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.819741 16329 tablet_replica.cc:333] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.820269 16329 raft_consensus.cc:2243] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.820761 16329 raft_consensus.cc:2272] T 2e20ad9ccb7d416fb78ca24817f25f01 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.822741 16329 tablet_replica.cc:333] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.823288 16329 raft_consensus.cc:2243] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.824111 16329 raft_consensus.cc:2272] T d48bb74e965d44649059c6cbae8878b9 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.826228 16329 tablet_replica.cc:333] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.826732 16329 raft_consensus.cc:2243] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.827205 16329 raft_consensus.cc:2272] T 96813b389fd14d7890c804a06966b952 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.829221 16329 tablet_replica.cc:333] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.829731 16329 raft_consensus.cc:2243] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.830214 16329 raft_consensus.cc:2272] T c64b5ba5e5d84dd78ae3c83e7c375709 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.832137 16329 tablet_replica.cc:333] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.832648 16329 raft_consensus.cc:2243] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.833482 16329 raft_consensus.cc:2272] T cfb70981888a450ca715b1ed427ba95e P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.835681 16329 tablet_replica.cc:333] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.836134 16329 raft_consensus.cc:2243] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.836493 16329 raft_consensus.cc:2272] T 21208eaee0f548318b6d3fd6edb3e12f P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.838315 16329 tablet_replica.cc:333] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.838747 16329 raft_consensus.cc:2243] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.839092 16329 raft_consensus.cc:2272] T d13a5255f4d444b984355f509d3a7918 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.841032 16329 tablet_replica.cc:333] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.841477 16329 raft_consensus.cc:2243] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:36.842222 16329 raft_consensus.cc:2272] T 0b184e3a09204b16a54a19c799fe3491 P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.843951 16329 tablet_replica.cc:333] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.844369 16329 raft_consensus.cc:2243] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.844717 16329 raft_consensus.cc:2272] T dc10ce2783b74de384326c27984c7e92 P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.846611 16329 tablet_replica.cc:333] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.847030 16329 raft_consensus.cc:2243] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.847405 16329 raft_consensus.cc:2272] T b80418d8094044258597b8ab9021a04e P b8c6aaf55421432a91a73360865771d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:36.849095 16329 tablet_replica.cc:333] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3: stopping tablet replica
I20260709 13:21:36.849583 16329 raft_consensus.cc:2243] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:36.850049 16329 raft_consensus.cc:2272] T f4118ee5e16a4387ac189a181756ba0b P b8c6aaf55421432a91a73360865771d3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:36.877789 24346 consensus_peers.cc:597] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833): Couldn't send request to peer b8c6aaf55421432a91a73360865771d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.937220 16329 tablet_server.cc:196] TabletServer@127.15.242.67:0 shutdown complete.
W20260709 13:21:36.937693 24346 consensus_peers.cc:597] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833): Couldn't send request to peer b8c6aaf55421432a91a73360865771d3. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.67:46833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.957316 25254 raft_consensus.cc:493] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:36.957937 25254 raft_consensus.cc:515] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:36.960355 25254 leader_election.cc:290] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
W20260709 13:21:36.965263 24346 leader_election.cc:336] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833): Network error: Client connection negotiation failed: client connection to 127.15.242.67:46833: connect: Connection refused (error 111)
W20260709 13:21:36.966825 24348 leader_election.cc:336] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111)
I20260709 13:21:36.967293 24348 leader_election.cc:304] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:36.968106 25254 raft_consensus.cc:2749] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:36.971868 24346 consensus_peers.cc:597] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833): Couldn't send request to peer b8c6aaf55421432a91a73360865771d3. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.67:46833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:37.020767 24346 consensus_peers.cc:597] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833): Couldn't send request to peer b8c6aaf55421432a91a73360865771d3. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.67:46833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:37.034694 16329 tablet_server.cc:179] TabletServer@127.15.242.68:0 shutting down...
I20260709 13:21:37.036674 25277 raft_consensus.cc:493] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:37.038295 25277 raft_consensus.cc:515] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:37.038455 25254 raft_consensus.cc:493] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:37.039029 25254 raft_consensus.cc:515] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:37.040100 25277 leader_election.cc:290] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:37.041390 25254 leader_election.cc:290] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
W20260709 13:21:37.045722 24348 leader_election.cc:336] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111)
W20260709 13:21:37.046351 24348 leader_election.cc:336] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111)
W20260709 13:21:37.046984 24346 leader_election.cc:336] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111)
I20260709 13:21:37.047489 24346 leader_election.cc:304] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:37.048501 25254 raft_consensus.cc:2749] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:37.048516 24346 leader_election.cc:336] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111)
I20260709 13:21:37.049101 24346 leader_election.cc:304] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:37.050365 25254 raft_consensus.cc:2749] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:37.082798 25254 raft_consensus.cc:493] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:37.083833 25254 raft_consensus.cc:515] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c6aaf55421432a91a73360865771d3" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 46833 } } peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } }
I20260709 13:21:37.086483 25254 leader_election.cc:290] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833), 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703)
I20260709 13:21:37.087239 25254 raft_consensus.cc:493] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:37.087775 25254 raft_consensus.cc:515] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
W20260709 13:21:37.091112 24348 leader_election.cc:336] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111)
W20260709 13:21:37.093331 24346 leader_election.cc:336] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833): Network error: Client connection negotiation failed: client connection to 127.15.242.67:46833: connect: Connection refused (error 111)
I20260709 13:21:37.093744 24346 leader_election.cc:304] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 97e577a376c948bfac33665f06a4bb98, b8c6aaf55421432a91a73360865771d3
I20260709 13:21:37.094365 25277 raft_consensus.cc:2749] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:37.092517 25254 leader_election.cc:290] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
W20260709 13:21:37.095903 24346 leader_election.cc:336] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111)
W20260709 13:21:37.099622 24348 leader_election.cc:336] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111)
I20260709 13:21:37.100088 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:37.100059 24348 leader_election.cc:304] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:37.101029 25254 raft_consensus.cc:2749] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:37.101555 16329 tablet_replica.cc:333] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.102856 16329 raft_consensus.cc:2243] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.103929 16329 raft_consensus.cc:2272] T 9c8d5d925cdf4b799f067f0763e2b3af P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.106148 16329 tablet_replica.cc:333] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.106801 16329 raft_consensus.cc:2243] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.107332 16329 raft_consensus.cc:2272] T 2789a7bb0565468ebd309763754a3d4c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.109428 16329 tablet_replica.cc:333] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.110005 16329 raft_consensus.cc:2243] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.110554 16329 raft_consensus.cc:2272] T d48bb74e965d44649059c6cbae8878b9 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.112618 16329 tablet_replica.cc:333] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.113139 16329 raft_consensus.cc:2243] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.113873 16329 raft_consensus.cc:2272] T bd488127e8e5406e956c1118ed2ffbbc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.116066 16329 tablet_replica.cc:333] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.116863 16329 raft_consensus.cc:2243] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.117429 16329 raft_consensus.cc:2272] T 17f8ed631e60464e98c97b58568b708d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.119051 25254 raft_consensus.cc:493] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:37.119494 25254 raft_consensus.cc:515] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:37.120412 16329 tablet_replica.cc:333] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.121382 16329 raft_consensus.cc:2243] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.121639 25254 leader_election.cc:290] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:37.121999 16329 raft_consensus.cc:2272] T 2a82f5a216984c39907a5b48bbd3b560 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:37.123430 24346 consensus_peers.cc:597] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb -> Peer b8c6aaf55421432a91a73360865771d3 (127.15.242.67:46833): Couldn't send request to peer b8c6aaf55421432a91a73360865771d3. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.67:46833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:37.125840 16329 tablet_replica.cc:333] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
W20260709 13:21:37.126377 24346 leader_election.cc:336] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111)
I20260709 13:21:37.126802 16329 raft_consensus.cc:2243] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:21:37.127650 24348 leader_election.cc:336] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111)
I20260709 13:21:37.127887 16329 raft_consensus.cc:2272] T b1ea9e8d8e234a52956bc1fc72b80c6e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.128118 24348 leader_election.cc:304] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:37.128851 25254 raft_consensus.cc:2749] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:37.130409 16329 tablet_replica.cc:333] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.131105 16329 raft_consensus.cc:2243] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.132124 16329 raft_consensus.cc:2272] T b2f81314f6f14fa9a2c432de6bddcb21 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.134902 16329 tablet_replica.cc:333] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.135640 16329 raft_consensus.cc:2243] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.136142 16329 raft_consensus.cc:2272] T 1d7fdf5436a3408eb7a2074f0d4f48f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.138568 16329 tablet_replica.cc:333] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.139178 16329 raft_consensus.cc:2243] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.139950 16329 raft_consensus.cc:2272] T 1022101d02354929a4335f20304fdcb0 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.141993 16329 tablet_replica.cc:333] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.142678 16329 raft_consensus.cc:2243] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.143136 16329 raft_consensus.cc:2272] T 94b95f5240b5450d968047f65e13d4ea P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.145102 16329 tablet_replica.cc:333] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.145677 16329 raft_consensus.cc:2243] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.146212 16329 raft_consensus.cc:2272] T 8336ccf163c04dfa94f4eb0109695563 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.148234 16329 tablet_replica.cc:333] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.148833 16329 raft_consensus.cc:2243] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.149286 16329 raft_consensus.cc:2272] T 4206794ab99d4bc2b0573743d29d74ca P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.151408 16329 tablet_replica.cc:333] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.151985 16329 raft_consensus.cc:2243] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.152426 16329 raft_consensus.cc:2272] T d768d2f1ef2449b5b035c41ed3fa15bd P 96be869fbe4e464a99c0d5aa3d90dbfb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.154424 16329 tablet_replica.cc:333] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.155016 16329 raft_consensus.cc:2243] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.155458 16329 raft_consensus.cc:2272] T bb6f84753e2b4220a883363c1561af3a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.157474 16329 tablet_replica.cc:333] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.158082 16329 raft_consensus.cc:2243] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.158553 16329 raft_consensus.cc:2272] T feff48c38ffe40ec83c61e469590bab2 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.160470 16329 tablet_replica.cc:333] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.161049 16329 raft_consensus.cc:2243] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.161513 16329 raft_consensus.cc:2272] T 2dfc3f1f066843e382fa402c8d4ec110 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.164155 16329 tablet_replica.cc:333] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.164712 16329 raft_consensus.cc:2243] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.165516 16329 raft_consensus.cc:2272] T be7f93cd2c1042aa9ce8434973e4e95a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.167681 16329 tablet_replica.cc:333] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.168413 16329 raft_consensus.cc:2243] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.168968 16329 raft_consensus.cc:2272] T b5e41c560ee74f5c860ed22ba1487d2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.171241 16329 tablet_replica.cc:333] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.171909 16329 raft_consensus.cc:2243] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.172483 16329 raft_consensus.cc:2272] T b5172214c61f4935bce32538470f1ef8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.175495 16329 tablet_replica.cc:333] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.176312 16329 raft_consensus.cc:2243] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.176862 16329 raft_consensus.cc:2272] T c67fd67822294670b224a43c149b126f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.178994 16329 tablet_replica.cc:333] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.179580 16329 raft_consensus.cc:2243] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.180461 16329 raft_consensus.cc:2272] T c29861adc1e34aeb8b9916d115af5f9b P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.183087 16329 tablet_replica.cc:333] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.183760 16329 raft_consensus.cc:2243] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.184372 16329 raft_consensus.cc:2272] T 61ca07974685419bbf6372e6306542e8 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.186641 16329 tablet_replica.cc:333] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.187160 16329 raft_consensus.cc:2243] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.187580 16329 raft_consensus.cc:2272] T f6350c1629234440b97877600cb50d2a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.189558 16329 tablet_replica.cc:333] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.190160 16329 raft_consensus.cc:2243] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.190559 16329 raft_consensus.cc:2272] T 0bf4040b9d0747039fdf29b8fa99d02c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.192456 16329 tablet_replica.cc:333] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.192950 16329 raft_consensus.cc:2243] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.193323 16329 raft_consensus.cc:2272] T 0b184e3a09204b16a54a19c799fe3491 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.195446 16329 tablet_replica.cc:333] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.195979 16329 raft_consensus.cc:2243] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.196811 16329 raft_consensus.cc:2272] T 926dce38ed89423898a8cd9ca37e1f7e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.199510 16329 tablet_replica.cc:333] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.200194 16329 raft_consensus.cc:2243] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.200896 16329 raft_consensus.cc:2272] T aa056dad41df4537ab48328b7221c6cc P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.202678 25277 raft_consensus.cc:493] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 97e577a376c948bfac33665f06a4bb98)
I20260709 13:21:37.203099 25277 raft_consensus.cc:515] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96be869fbe4e464a99c0d5aa3d90dbfb" member_type: VOTER last_known_addr { host: "127.15.242.68" port: 44365 } } peers { permanent_uuid: "97e577a376c948bfac33665f06a4bb98" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39703 } } peers { permanent_uuid: "3e96a35df00e4646b9c6e356c6fb4bba" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 34445 } }
I20260709 13:21:37.204107 16329 tablet_replica.cc:333] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.204891 25277 leader_election.cc:290] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703), 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445)
I20260709 13:21:37.205054 16329 raft_consensus.cc:2243] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.206718 16329 raft_consensus.cc:2272] T f41cf4b67fba4c29b17c18984f51368f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:37.209760 24348 leader_election.cc:336] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 97e577a376c948bfac33665f06a4bb98 (127.15.242.65:39703): Network error: Client connection negotiation failed: client connection to 127.15.242.65:39703: connect: Connection refused (error 111)
I20260709 13:21:37.210343 16329 tablet_replica.cc:333] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
W20260709 13:21:37.210314 24346 leader_election.cc:336] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e96a35df00e4646b9c6e356c6fb4bba (127.15.242.66:34445): Network error: Client connection negotiation failed: client connection to 127.15.242.66:34445: connect: Connection refused (error 111)
I20260709 13:21:37.210879 24346 leader_election.cc:304] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96be869fbe4e464a99c0d5aa3d90dbfb; no voters: 3e96a35df00e4646b9c6e356c6fb4bba, 97e577a376c948bfac33665f06a4bb98
I20260709 13:21:37.211354 16329 raft_consensus.cc:2243] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.211575 25277 raft_consensus.cc:2749] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:37.212464 16329 raft_consensus.cc:2272] T fc15fe782c914a21a8001515c189022a P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.214707 16329 tablet_replica.cc:333] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.215343 16329 raft_consensus.cc:2243] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.215867 16329 raft_consensus.cc:2272] T dc10ce2783b74de384326c27984c7e92 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.218112 16329 tablet_replica.cc:333] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.218662 16329 raft_consensus.cc:2243] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.219115 16329 raft_consensus.cc:2272] T b80418d8094044258597b8ab9021a04e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.220996 16329 tablet_replica.cc:333] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.221582 16329 raft_consensus.cc:2243] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.222447 16329 raft_consensus.cc:2272] T 965a2d41972049e2975015ab66773956 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.224526 16329 tablet_replica.cc:333] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.225118 16329 raft_consensus.cc:2243] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.225953 16329 raft_consensus.cc:2272] T 3863e0f41bbc4ace93654a83e2578032 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.228070 16329 tablet_replica.cc:333] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.228670 16329 raft_consensus.cc:2243] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.229139 16329 raft_consensus.cc:2272] T 21208eaee0f548318b6d3fd6edb3e12f P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.231065 16329 tablet_replica.cc:333] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.231643 16329 raft_consensus.cc:2243] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.232471 16329 raft_consensus.cc:2272] T dcd592b9cef049dfbfa3d0ee1ab44c41 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.234706 16329 tablet_replica.cc:333] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.235553 16329 raft_consensus.cc:2243] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.236157 16329 raft_consensus.cc:2272] T d13a5255f4d444b984355f509d3a7918 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.238981 16329 tablet_replica.cc:333] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.239813 16329 raft_consensus.cc:2243] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.240419 16329 raft_consensus.cc:2272] T cbbd9769488e4db0bf3addb6ae875e51 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.243137 16329 tablet_replica.cc:333] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.243701 16329 raft_consensus.cc:2243] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.244513 16329 raft_consensus.cc:2272] T b9e21b3c9af648169d5786fe63dd5df7 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.246559 16329 tablet_replica.cc:333] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.247124 16329 raft_consensus.cc:2243] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.247576 16329 raft_consensus.cc:2272] T c64b5ba5e5d84dd78ae3c83e7c375709 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.249394 16329 tablet_replica.cc:333] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.249924 16329 raft_consensus.cc:2243] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.250456 16329 raft_consensus.cc:2272] T cfb70981888a450ca715b1ed427ba95e P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.252825 16329 tablet_replica.cc:333] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.253356 16329 raft_consensus.cc:2243] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.253799 16329 raft_consensus.cc:2272] T ae2833e9ae264f259ce3c2967ad5bc2d P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.255880 16329 tablet_replica.cc:333] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.256408 16329 raft_consensus.cc:2243] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.257166 16329 raft_consensus.cc:2272] T 7de7548eaeb146eeb29df319abe407f5 P 96be869fbe4e464a99c0d5aa3d90dbfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.259469 16329 tablet_replica.cc:333] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb: stopping tablet replica
I20260709 13:21:37.260107 16329 raft_consensus.cc:2243] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:37.260548 16329 raft_consensus.cc:2272] T 95192d3963414bdfac891aba6df47f7c P 96be869fbe4e464a99c0d5aa3d90dbfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.331763 16329 tablet_server.cc:196] TabletServer@127.15.242.68:0 shutdown complete.
I20260709 13:21:37.399621 16329 master.cc:562] Master@127.15.242.126:42991 shutting down...
I20260709 13:21:37.429212 16329 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:37.429842 16329 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:37.430284 16329 tablet_replica.cc:333] T 00000000000000000000000000000000 P fd725a448b4949ce974e95420329ff6d: stopping tablet replica
I20260709 13:21:37.471797 16329 master.cc:584] Master@127.15.242.126:42991 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32698 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:21:37.566939 16329 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.242.126:39199
I20260709 13:21:37.568094 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:37.574091 25290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:37.574370 25289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:37.575007 25292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:37.575879 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:37.577108 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:37.577308 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:37.577435 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603297577422 us; error 0 us; skew 500 ppm
I20260709 13:21:37.577944 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:37.580678 16329 webserver.cc:533] Webserver started at http://127.15.242.126:37271/ using document root <none> and password file <none>
I20260709 13:21:37.581265 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:37.581439 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:37.581701 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:37.583312 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/master-0-root/instance:
uuid: "a2f114307adc44a79430127f52cdb54d"
format_stamp: "Formatted at 2026-07-09 13:21:37 on dist-test-slave-fh5z"
I20260709 13:21:37.588291 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:21:37.592084 25297 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:37.593044 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:21:37.593318 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/master-0-root
uuid: "a2f114307adc44a79430127f52cdb54d"
format_stamp: "Formatted at 2026-07-09 13:21:37 on dist-test-slave-fh5z"
I20260709 13:21:37.593559 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:37.608393 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:37.609671 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:37.651029 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.126:39199
I20260709 13:21:37.651132 25348 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.126:39199 every 8 connection(s)
I20260709 13:21:37.654953 25349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:37.665670 25349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d: Bootstrap starting.
I20260709 13:21:37.670606 25349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:37.674983 25349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d: No bootstrap required, opened a new log
I20260709 13:21:37.677192 25349 raft_consensus.cc:359] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2f114307adc44a79430127f52cdb54d" member_type: VOTER }
I20260709 13:21:37.677591 25349 raft_consensus.cc:385] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:37.677820 25349 raft_consensus.cc:740] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2f114307adc44a79430127f52cdb54d, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.678565 25349 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2f114307adc44a79430127f52cdb54d" member_type: VOTER }
I20260709 13:21:37.679034 25349 raft_consensus.cc:399] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:37.679260 25349 raft_consensus.cc:493] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:37.679497 25349 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:37.684161 25349 raft_consensus.cc:515] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2f114307adc44a79430127f52cdb54d" member_type: VOTER }
I20260709 13:21:37.684700 25349 leader_election.cc:304] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2f114307adc44a79430127f52cdb54d; no voters: 
I20260709 13:21:37.685968 25349 leader_election.cc:290] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:37.686573 25352 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:37.688436 25352 raft_consensus.cc:697] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [term 1 LEADER]: Becoming Leader. State: Replica: a2f114307adc44a79430127f52cdb54d, State: Running, Role: LEADER
I20260709 13:21:37.689136 25352 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2f114307adc44a79430127f52cdb54d" member_type: VOTER }
I20260709 13:21:37.689741 25349 sys_catalog.cc:565] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:37.696014 25354 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2f114307adc44a79430127f52cdb54d. Latest consensus state: current_term: 1 leader_uuid: "a2f114307adc44a79430127f52cdb54d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2f114307adc44a79430127f52cdb54d" member_type: VOTER } }
I20260709 13:21:37.696947 25354 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:37.696027 25353 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2f114307adc44a79430127f52cdb54d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2f114307adc44a79430127f52cdb54d" member_type: VOTER } }
I20260709 13:21:37.697978 25353 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:37.699113 25359 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:37.707957 25359 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:37.708988 16329 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:37.717219 25359 catalog_manager.cc:1383] Generated new cluster ID: ba93e7d3f7204051be75a8eb23e280ea
I20260709 13:21:37.717568 25359 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:37.762552 25359 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:37.764009 25359 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:37.788434 25359 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d: Generated new TSK 0
I20260709 13:21:37.789348 25359 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:37.840680 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:37.847827 25370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:37.848984 25371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:37.850317 25373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:37.851751 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:37.852820 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:37.853034 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:37.853255 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603297853238 us; error 0 us; skew 500 ppm
I20260709 13:21:37.854259 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:37.856920 16329 webserver.cc:533] Webserver started at http://127.15.242.65:40279/ using document root <none> and password file <none>
I20260709 13:21:37.857496 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:37.857712 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:37.858072 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:37.859329 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-0-root/instance:
uuid: "d0fadd57a0a64a98854b63eb61761a8e"
format_stamp: "Formatted at 2026-07-09 13:21:37 on dist-test-slave-fh5z"
I20260709 13:21:37.864558 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:21:37.868127 25378 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:37.868976 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:37.869319 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-0-root
uuid: "d0fadd57a0a64a98854b63eb61761a8e"
format_stamp: "Formatted at 2026-07-09 13:21:37 on dist-test-slave-fh5z"
I20260709 13:21:37.869632 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:37.886637 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:37.887897 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:37.889396 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:37.892004 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:37.892223 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:37.892485 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:37.892676 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:37.935511 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.65:45161
I20260709 13:21:37.935642 25440 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.65:45161 every 8 connection(s)
I20260709 13:21:37.941208 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:37.949679 25445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:37.949703 25446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:37.953138 25448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:37.954347 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:37.955404 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:37.955667 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:37.955864 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603297955846 us; error 0 us; skew 500 ppm
I20260709 13:21:37.956565 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:37.958942 25441 heartbeater.cc:344] Connected to a master server at 127.15.242.126:39199
I20260709 13:21:37.959381 25441 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:37.959534 16329 webserver.cc:533] Webserver started at http://127.15.242.66:42625/ using document root <none> and password file <none>
I20260709 13:21:37.960147 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:37.960366 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:37.960209 25441 heartbeater.cc:507] Master 127.15.242.126:39199 requested a full tablet report, sending...
I20260709 13:21:37.960799 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:37.962121 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-1-root/instance:
uuid: "8e513729a6434ea782461d121a035e0b"
format_stamp: "Formatted at 2026-07-09 13:21:37 on dist-test-slave-fh5z"
I20260709 13:21:37.962647 25314 ts_manager.cc:194] Registered new tserver with Master: d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161)
I20260709 13:21:37.964495 25314 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51390
I20260709 13:21:37.967562 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:21:37.971614 25453 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:37.972448 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:21:37.972810 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-1-root
uuid: "8e513729a6434ea782461d121a035e0b"
format_stamp: "Formatted at 2026-07-09 13:21:37 on dist-test-slave-fh5z"
I20260709 13:21:37.973155 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:38.001272 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:38.002759 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:38.004369 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:38.006789 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:38.007033 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.007304 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:38.007524 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.051927 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.66:46197
I20260709 13:21:38.052049 25515 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.66:46197 every 8 connection(s)
I20260709 13:21:38.057228 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:38.064893 25519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:38.065817 25520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:38.069013 16329 server_base.cc:1061] running on GCE node
W20260709 13:21:38.069747 25523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:38.070923 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:38.071259 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:38.071514 25516 heartbeater.cc:344] Connected to a master server at 127.15.242.126:39199
I20260709 13:21:38.071513 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603298071491 us; error 0 us; skew 500 ppm
I20260709 13:21:38.072063 25516 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:38.072450 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:38.072880 25516 heartbeater.cc:507] Master 127.15.242.126:39199 requested a full tablet report, sending...
I20260709 13:21:38.075431 16329 webserver.cc:533] Webserver started at http://127.15.242.67:44503/ using document root <none> and password file <none>
I20260709 13:21:38.075451 25314 ts_manager.cc:194] Registered new tserver with Master: 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:38.076351 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:38.076642 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:38.076968 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:38.077548 25314 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51392
I20260709 13:21:38.078598 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-2-root/instance:
uuid: "1154092fa2c04526a55b392074c58a51"
format_stamp: "Formatted at 2026-07-09 13:21:38 on dist-test-slave-fh5z"
I20260709 13:21:38.083371 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:38.087191 25527 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.088065 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:21:38.088392 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-2-root
uuid: "1154092fa2c04526a55b392074c58a51"
format_stamp: "Formatted at 2026-07-09 13:21:38 on dist-test-slave-fh5z"
I20260709 13:21:38.088683 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:38.123087 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:38.124315 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:38.125839 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:38.128126 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:38.128304 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.128600 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:38.128767 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.169871 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.67:45617
I20260709 13:21:38.169983 25589 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.67:45617 every 8 connection(s)
I20260709 13:21:38.184439 25590 heartbeater.cc:344] Connected to a master server at 127.15.242.126:39199
I20260709 13:21:38.184875 25590 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:38.185606 25590 heartbeater.cc:507] Master 127.15.242.126:39199 requested a full tablet report, sending...
I20260709 13:21:38.187706 25314 ts_manager.cc:194] Registered new tserver with Master: 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:38.188129 16329 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01490085s
I20260709 13:21:38.189208 25314 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51396
I20260709 13:21:38.216049 25314 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51406:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:38.219015 25314 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:38.294948 25406 tablet_service.cc:1511] Processing CreateTablet for tablet 22caba5eac714345ba2babf42a20afa2 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:38.296756 25406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22caba5eac714345ba2babf42a20afa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.297554 25403 tablet_service.cc:1511] Processing CreateTablet for tablet 8ee289b8af0f41ffb1bdfa3cf42fc743 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:38.299228 25403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee289b8af0f41ffb1bdfa3cf42fc743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.303249 25404 tablet_service.cc:1511] Processing CreateTablet for tablet 81a56844ee7848cfb953b32f3913868e (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:38.304852 25404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a56844ee7848cfb953b32f3913868e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.307161 25405 tablet_service.cc:1511] Processing CreateTablet for tablet cebd3633bdd24bec89f1d2ec9673a05e (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:38.308729 25405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cebd3633bdd24bec89f1d2ec9673a05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.312527 25402 tablet_service.cc:1511] Processing CreateTablet for tablet 62dee54ceb3740cc84018666437f5291 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:38.313957 25402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62dee54ceb3740cc84018666437f5291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.315733 25401 tablet_service.cc:1511] Processing CreateTablet for tablet beabeec6c779444c9747beb9fa8afaa1 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:38.317140 25401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beabeec6c779444c9747beb9fa8afaa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.318414 25475 tablet_service.cc:1511] Processing CreateTablet for tablet 4026ade6660a484b9592984bfac572d6 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:38.319810 25475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4026ade6660a484b9592984bfac572d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.323154 25476 tablet_service.cc:1511] Processing CreateTablet for tablet beabeec6c779444c9747beb9fa8afaa1 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:38.323700 25398 tablet_service.cc:1511] Processing CreateTablet for tablet 1b251600b0c341c4911c9a9621879f87 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:38.324615 25476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beabeec6c779444c9747beb9fa8afaa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.324980 25398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b251600b0c341c4911c9a9621879f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.327248 25399 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd06cc431b74b61931554e409abfe77 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:38.328727 25399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd06cc431b74b61931554e409abfe77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.329000 25397 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb70474b2f243e5b038f3203af329d6 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:38.330313 25397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb70474b2f243e5b038f3203af329d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.331230 25477 tablet_service.cc:1511] Processing CreateTablet for tablet 62dee54ceb3740cc84018666437f5291 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:38.332597 25477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62dee54ceb3740cc84018666437f5291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.335273 25478 tablet_service.cc:1511] Processing CreateTablet for tablet 8ee289b8af0f41ffb1bdfa3cf42fc743 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:38.336602 25478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee289b8af0f41ffb1bdfa3cf42fc743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.339226 25479 tablet_service.cc:1511] Processing CreateTablet for tablet 81a56844ee7848cfb953b32f3913868e (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:38.340588 25479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a56844ee7848cfb953b32f3913868e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.343207 25480 tablet_service.cc:1511] Processing CreateTablet for tablet cebd3633bdd24bec89f1d2ec9673a05e (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:38.344614 25480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cebd3633bdd24bec89f1d2ec9673a05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.347267 25400 tablet_service.cc:1511] Processing CreateTablet for tablet 4026ade6660a484b9592984bfac572d6 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:38.348740 25400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4026ade6660a484b9592984bfac572d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.351363 25481 tablet_service.cc:1511] Processing CreateTablet for tablet 22caba5eac714345ba2babf42a20afa2 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:38.352730 25481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22caba5eac714345ba2babf42a20afa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.360525 25555 tablet_service.cc:1511] Processing CreateTablet for tablet 22caba5eac714345ba2babf42a20afa2 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:38.361306 25551 tablet_service.cc:1511] Processing CreateTablet for tablet 62dee54ceb3740cc84018666437f5291 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:38.363201 25474 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd06cc431b74b61931554e409abfe77 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:38.363716 25554 tablet_service.cc:1511] Processing CreateTablet for tablet cebd3633bdd24bec89f1d2ec9673a05e (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:38.364673 25474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd06cc431b74b61931554e409abfe77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.365270 25549 tablet_service.cc:1511] Processing CreateTablet for tablet 4026ade6660a484b9592984bfac572d6 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:38.366478 25553 tablet_service.cc:1511] Processing CreateTablet for tablet 81a56844ee7848cfb953b32f3913868e (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:38.363826 25550 tablet_service.cc:1511] Processing CreateTablet for tablet beabeec6c779444c9747beb9fa8afaa1 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:38.367231 25473 tablet_service.cc:1511] Processing CreateTablet for tablet 1b251600b0c341c4911c9a9621879f87 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:38.368671 25473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b251600b0c341c4911c9a9621879f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.369167 25552 tablet_service.cc:1511] Processing CreateTablet for tablet 8ee289b8af0f41ffb1bdfa3cf42fc743 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:38.371230 25472 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb70474b2f243e5b038f3203af329d6 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:38.372562 25472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb70474b2f243e5b038f3203af329d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.375296 25555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22caba5eac714345ba2babf42a20afa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.376170 25552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee289b8af0f41ffb1bdfa3cf42fc743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.377182 25547 tablet_service.cc:1511] Processing CreateTablet for tablet 1b251600b0c341c4911c9a9621879f87 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:38.377897 25549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4026ade6660a484b9592984bfac572d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.378578 25547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b251600b0c341c4911c9a9621879f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.378295 25548 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd06cc431b74b61931554e409abfe77 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:38.379618 25548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd06cc431b74b61931554e409abfe77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.380725 25546 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb70474b2f243e5b038f3203af329d6 (DEFAULT_TABLE table=test-workload [id=e9bbd2d302684361b63768fa12526657]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:38.382198 25546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb70474b2f243e5b038f3203af329d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.382861 25553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a56844ee7848cfb953b32f3913868e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.386430 25554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cebd3633bdd24bec89f1d2ec9673a05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.394375 25551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62dee54ceb3740cc84018666437f5291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.395107 25550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beabeec6c779444c9747beb9fa8afaa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.497778 25605 tablet_bootstrap.cc:492] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:38.530004 25605 tablet_bootstrap.cc:654] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.548393 25607 tablet_bootstrap.cc:492] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b: Bootstrap starting.
I20260709 13:21:38.554360 25607 tablet_bootstrap.cc:654] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.554843 25606 tablet_bootstrap.cc:492] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51: Bootstrap starting.
I20260709 13:21:38.569082 25606 tablet_bootstrap.cc:654] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.573653 25605 tablet_bootstrap.cc:492] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e: No bootstrap required, opened a new log
I20260709 13:21:38.574327 25605 ts_tablet_manager.cc:1403] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.003s
I20260709 13:21:38.577307 25605 raft_consensus.cc:359] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.578080 25605 raft_consensus.cc:385] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.578426 25605 raft_consensus.cc:740] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.579242 25605 consensus_queue.cc:260] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.581293 25607 tablet_bootstrap.cc:492] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b: No bootstrap required, opened a new log
I20260709 13:21:38.581947 25607 ts_tablet_manager.cc:1403] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.004s
I20260709 13:21:38.582273 25605 ts_tablet_manager.cc:1434] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:38.582384 25441 heartbeater.cc:499] Master 127.15.242.126:39199 was elected leader, sending a full tablet report...
I20260709 13:21:38.583338 25605 tablet_bootstrap.cc:492] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:38.583478 25606 tablet_bootstrap.cc:492] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51: No bootstrap required, opened a new log
I20260709 13:21:38.584062 25606 ts_tablet_manager.cc:1403] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51: Time spent bootstrapping tablet: real 0.030s	user 0.002s	sys 0.011s
I20260709 13:21:38.585242 25607 raft_consensus.cc:359] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.586540 25607 raft_consensus.cc:385] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.586879 25607 raft_consensus.cc:740] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.587499 25606 raft_consensus.cc:359] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.588378 25606 raft_consensus.cc:385] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.587867 25607 consensus_queue.cc:260] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.588760 25606 raft_consensus.cc:740] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.589951 25605 tablet_bootstrap.cc:654] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.589785 25606 consensus_queue.cc:260] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.596724 25516 heartbeater.cc:499] Master 127.15.242.126:39199 was elected leader, sending a full tablet report...
I20260709 13:21:38.597895 25607 ts_tablet_manager.cc:1434] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:21:38.599067 25607 tablet_bootstrap.cc:492] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b: Bootstrap starting.
I20260709 13:21:38.605938 25607 tablet_bootstrap.cc:654] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.617777 25607 tablet_bootstrap.cc:492] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b: No bootstrap required, opened a new log
I20260709 13:21:38.618328 25607 ts_tablet_manager.cc:1403] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.009s
I20260709 13:21:38.621354 25607 raft_consensus.cc:359] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.622093 25607 raft_consensus.cc:385] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.622385 25607 raft_consensus.cc:740] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.623286 25607 consensus_queue.cc:260] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.625689 25607 ts_tablet_manager.cc:1434] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:38.626696 25607 tablet_bootstrap.cc:492] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b: Bootstrap starting.
I20260709 13:21:38.633205 25607 tablet_bootstrap.cc:654] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.645037 25607 tablet_bootstrap.cc:492] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b: No bootstrap required, opened a new log
I20260709 13:21:38.645550 25607 ts_tablet_manager.cc:1403] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.011s
I20260709 13:21:38.648521 25607 raft_consensus.cc:359] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.649223 25607 raft_consensus.cc:385] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.649507 25607 raft_consensus.cc:740] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.650465 25607 consensus_queue.cc:260] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.652542 25606 ts_tablet_manager.cc:1434] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51: Time spent starting tablet: real 0.068s	user 0.036s	sys 0.026s
I20260709 13:21:38.653113 25590 heartbeater.cc:499] Master 127.15.242.126:39199 was elected leader, sending a full tablet report...
I20260709 13:21:38.654333 25606 tablet_bootstrap.cc:492] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51: Bootstrap starting.
I20260709 13:21:38.655030 25605 tablet_bootstrap.cc:492] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e: No bootstrap required, opened a new log
I20260709 13:21:38.655112 25607 ts_tablet_manager.cc:1434] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:21:38.655857 25605 ts_tablet_manager.cc:1403] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.073s	user 0.025s	sys 0.043s
I20260709 13:21:38.656477 25607 tablet_bootstrap.cc:492] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b: Bootstrap starting.
I20260709 13:21:38.659245 25605 raft_consensus.cc:359] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.660135 25605 raft_consensus.cc:385] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.660508 25605 raft_consensus.cc:740] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.661444 25605 consensus_queue.cc:260] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.663530 25606 tablet_bootstrap.cc:654] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.663599 25607 tablet_bootstrap.cc:654] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.668166 25605 ts_tablet_manager.cc:1434] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:21:38.669538 25605 tablet_bootstrap.cc:492] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
W20260709 13:21:38.674256 25591 tablet.cc:2406] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:38.674734 25606 tablet_bootstrap.cc:492] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51: No bootstrap required, opened a new log
I20260709 13:21:38.674391 25607 tablet_bootstrap.cc:492] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b: No bootstrap required, opened a new log
I20260709 13:21:38.675275 25606 ts_tablet_manager.cc:1403] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.000s
I20260709 13:21:38.675657 25607 ts_tablet_manager.cc:1403] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.003s
I20260709 13:21:38.678524 25605 tablet_bootstrap.cc:654] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.678414 25606 raft_consensus.cc:359] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.678623 25607 raft_consensus.cc:359] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.679193 25606 raft_consensus.cc:385] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.679471 25607 raft_consensus.cc:385] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.679508 25606 raft_consensus.cc:740] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.679921 25607 raft_consensus.cc:740] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.680598 25606 consensus_queue.cc:260] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.680822 25607 consensus_queue.cc:260] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.683027 25606 ts_tablet_manager.cc:1434] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:21:38.683166 25607 ts_tablet_manager.cc:1434] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:38.684067 25606 tablet_bootstrap.cc:492] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51: Bootstrap starting.
I20260709 13:21:38.684304 25607 tablet_bootstrap.cc:492] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b: Bootstrap starting.
I20260709 13:21:38.690994 25607 tablet_bootstrap.cc:654] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.693271 25605 tablet_bootstrap.cc:492] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e: No bootstrap required, opened a new log
I20260709 13:21:38.693687 25606 tablet_bootstrap.cc:654] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.694046 25605 ts_tablet_manager.cc:1403] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.001s
I20260709 13:21:38.697656 25605 raft_consensus.cc:359] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.698654 25605 raft_consensus.cc:385] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.699051 25605 raft_consensus.cc:740] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.699904 25605 consensus_queue.cc:260] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.702508 25605 ts_tablet_manager.cc:1434] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 13:21:38.703526 25362 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:38.703696 25605 tablet_bootstrap.cc:492] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:38.710850 25605 tablet_bootstrap.cc:654] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.736316 25612 raft_consensus.cc:493] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:38.737145 25612 raft_consensus.cc:515] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.741019 25606 tablet_bootstrap.cc:492] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51: No bootstrap required, opened a new log
I20260709 13:21:38.743340 25612 leader_election.cc:290] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:38.741779 25606 ts_tablet_manager.cc:1403] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51: Time spent bootstrapping tablet: real 0.058s	user 0.033s	sys 0.015s
I20260709 13:21:38.745433 25607 tablet_bootstrap.cc:492] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b: No bootstrap required, opened a new log
I20260709 13:21:38.746105 25605 tablet_bootstrap.cc:492] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e: No bootstrap required, opened a new log
I20260709 13:21:38.746248 25607 ts_tablet_manager.cc:1403] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b: Time spent bootstrapping tablet: real 0.062s	user 0.027s	sys 0.031s
I20260709 13:21:38.746739 25605 ts_tablet_manager.cc:1403] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.020s
I20260709 13:21:38.747766 25606 raft_consensus.cc:359] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.748554 25606 raft_consensus.cc:385] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.748848 25606 raft_consensus.cc:740] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.750187 25605 raft_consensus.cc:359] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.750948 25611 raft_consensus.cc:493] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:38.750744 25607 raft_consensus.cc:359] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.751490 25605 raft_consensus.cc:385] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.751598 25611 raft_consensus.cc:515] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.751837 25607 raft_consensus.cc:385] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.751986 25605 raft_consensus.cc:740] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.752529 25607 raft_consensus.cc:740] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.753814 25607 consensus_queue.cc:260] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.754663 25611 leader_election.cc:290] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:38.750187 25606 consensus_queue.cc:260] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.757041 25606 ts_tablet_manager.cc:1434] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:21:38.758344 25606 tablet_bootstrap.cc:492] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51: Bootstrap starting.
I20260709 13:21:38.753360 25605 consensus_queue.cc:260] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.766824 25606 tablet_bootstrap.cc:654] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.769552 25613 raft_consensus.cc:493] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:38.770323 25613 raft_consensus.cc:515] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.776297 25605 ts_tablet_manager.cc:1434] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:21:38.782260 25613 leader_election.cc:290] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:38.793655 25605 tablet_bootstrap.cc:492] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:38.798336 25607 ts_tablet_manager.cc:1434] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b: Time spent starting tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 13:21:38.809058 25607 tablet_bootstrap.cc:492] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b: Bootstrap starting.
I20260709 13:21:38.816552 25605 tablet_bootstrap.cc:654] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.817691 25607 tablet_bootstrap.cc:654] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.834339 25607 tablet_bootstrap.cc:492] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b: No bootstrap required, opened a new log
I20260709 13:21:38.834908 25607 ts_tablet_manager.cc:1403] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.001s
I20260709 13:21:38.837169 25612 raft_consensus.cc:493] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:38.837654 25612 raft_consensus.cc:515] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.837944 25607 raft_consensus.cc:359] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.838707 25607 raft_consensus.cc:385] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.839008 25607 raft_consensus.cc:740] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.839802 25612 leader_election.cc:290] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:38.839880 25607 consensus_queue.cc:260] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.842655 25607 ts_tablet_manager.cc:1434] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:21:38.843664 25607 tablet_bootstrap.cc:492] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b: Bootstrap starting.
I20260709 13:21:38.849987 25607 tablet_bootstrap.cc:654] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.850972 25612 raft_consensus.cc:493] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:38.851478 25612 raft_consensus.cc:515] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.853575 25612 leader_election.cc:290] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:38.869288 25612 raft_consensus.cc:493] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:38.869838 25612 raft_consensus.cc:515] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.872331 25612 leader_election.cc:290] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:38.886425 25613 raft_consensus.cc:493] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:38.887106 25613 raft_consensus.cc:515] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.889492 25613 leader_election.cc:290] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:38.899993 25613 raft_consensus.cc:493] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:38.900794 25613 raft_consensus.cc:515] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.904439 25613 leader_election.cc:290] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:38.922071 25605 tablet_bootstrap.cc:492] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e: No bootstrap required, opened a new log
I20260709 13:21:38.922807 25605 ts_tablet_manager.cc:1403] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.129s	user 0.036s	sys 0.059s
I20260709 13:21:38.923305 25606 tablet_bootstrap.cc:492] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51: No bootstrap required, opened a new log
I20260709 13:21:38.923902 25606 ts_tablet_manager.cc:1403] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51: Time spent bootstrapping tablet: real 0.166s	user 0.091s	sys 0.071s
I20260709 13:21:38.924667 25612 raft_consensus.cc:493] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:38.925199 25612 raft_consensus.cc:515] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.927305 25612 leader_election.cc:290] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:38.927692 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:38.927071 25605 raft_consensus.cc:359] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.928957 25415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:38.929359 25605 raft_consensus.cc:385] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.929780 25415 raft_consensus.cc:2468] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 0.
I20260709 13:21:38.930343 25414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dee54ceb3740cc84018666437f5291" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:38.931468 25457 leader_election.cc:304] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:38.931787 25413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:38.932658 25412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4026ade6660a484b9592984bfac572d6" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:38.934078 25612 raft_consensus.cc:2804] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:38.934204 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a56844ee7848cfb953b32f3913868e" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
I20260709 13:21:38.934639 25612 raft_consensus.cc:493] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:38.935055 25612 raft_consensus.cc:3060] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:38.928961 25606 raft_consensus.cc:359] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.936388 25606 raft_consensus.cc:385] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.936833 25606 raft_consensus.cc:740] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Initialized, Role: FOLLOWER
W20260709 13:21:38.937132 25379 leader_election.cc:343] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:38.937630 25636 raft_consensus.cc:493] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:38.937657 25606 consensus_queue.cc:260] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.938262 25636 raft_consensus.cc:515] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
W20260709 13:21:38.938525 25457 leader_election.cc:343] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:38.940261 25606 ts_tablet_manager.cc:1434] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:21:38.945087 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
W20260709 13:21:38.945499 25457 leader_election.cc:343] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:38.946179 25606 tablet_bootstrap.cc:492] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51: Bootstrap starting.
I20260709 13:21:38.946249 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dee54ceb3740cc84018666437f5291" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
W20260709 13:21:38.946564 25457 leader_election.cc:343] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:38.947034 25490 raft_consensus.cc:2468] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 0.
I20260709 13:21:38.944144 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
I20260709 13:21:38.929780 25605 raft_consensus.cc:740] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.948050 25491 raft_consensus.cc:2468] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 0.
I20260709 13:21:38.949028 25605 consensus_queue.cc:260] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.950155 25416 raft_consensus.cc:2468] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 0.
I20260709 13:21:38.951705 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:38.952742 25565 raft_consensus.cc:2468] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 0.
I20260709 13:21:38.953649 25606 tablet_bootstrap.cc:654] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.953965 25457 leader_election.cc:304] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:38.954248 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:38.955525 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dee54ceb3740cc84018666437f5291" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:38.956318 25563 raft_consensus.cc:2468] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 0.
I20260709 13:21:38.957844 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:38.958889 25636 leader_election.cc:290] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:38.959441 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4026ade6660a484b9592984bfac572d6" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:38.961834 25605 ts_tablet_manager.cc:1434] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.003s
I20260709 13:21:38.962728 25528 leader_election.cc:304] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: 
I20260709 13:21:38.959547 25636 raft_consensus.cc:2804] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:38.966529 25413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:38.967116 25636 raft_consensus.cc:493] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:38.944322 25612 raft_consensus.cc:515] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.967630 25636 raft_consensus.cc:3060] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:38.968411 25412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dee54ceb3740cc84018666437f5291" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:38.969455 25612 leader_election.cc:290] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:38.971181 25607 tablet_bootstrap.cc:492] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b: No bootstrap required, opened a new log
W20260709 13:21:38.971024 25531 leader_election.cc:343] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:38.971841 25607 ts_tablet_manager.cc:1403] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b: Time spent bootstrapping tablet: real 0.128s	user 0.029s	sys 0.051s
I20260709 13:21:38.973488 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:38.974690 25613 raft_consensus.cc:2804] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:38.975993 25613 raft_consensus.cc:493] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:38.976524 25613 raft_consensus.cc:3060] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:38.977965 25605 tablet_bootstrap.cc:492] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:38.976015 25416 raft_consensus.cc:2468] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 0.
W20260709 13:21:38.975332 25531 leader_election.cc:343] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:38.981972 25636 raft_consensus.cc:515] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.975584 25528 leader_election.cc:304] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: 
I20260709 13:21:38.974392 25607 raft_consensus.cc:359] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.986526 25636 leader_election.cc:290] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:38.988497 25607 raft_consensus.cc:385] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.987831 25611 raft_consensus.cc:493] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:38.989420 25607 raft_consensus.cc:740] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.989720 25611 raft_consensus.cc:515] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.990514 25607 consensus_queue.cc:260] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:38.994383 25607 ts_tablet_manager.cc:1434] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 13:21:38.994589 25611 leader_election.cc:290] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:38.997037 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
I20260709 13:21:38.997560 25607 tablet_bootstrap.cc:492] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b: Bootstrap starting.
I20260709 13:21:38.997660 25489 raft_consensus.cc:2468] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0fadd57a0a64a98854b63eb61761a8e in term 0.
I20260709 13:21:38.999571 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:39.000764 25379 leader_election.cc:304] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:39.002108 25611 raft_consensus.cc:2804] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.002475 25611 raft_consensus.cc:493] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.002789 25611 raft_consensus.cc:3060] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.004388 25607 tablet_bootstrap.cc:654] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.006702 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:39.015336 25412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:39.015949 25412 raft_consensus.cc:3060] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.019722 25605 tablet_bootstrap.cc:654] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.019810 25613 raft_consensus.cc:515] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.023903 25639 raft_consensus.cc:2804] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.024389 25639 raft_consensus.cc:493] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.024574 25606 tablet_bootstrap.cc:492] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51: No bootstrap required, opened a new log
I20260709 13:21:39.024766 25639 raft_consensus.cc:3060] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.025291 25606 ts_tablet_manager.cc:1403] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51: Time spent bootstrapping tablet: real 0.079s	user 0.028s	sys 0.020s
W20260709 13:21:39.026417 25528 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.66:46197, user_credentials={real_user=slave}} blocked reactor thread for 50975.1us
W20260709 13:21:39.027323 25528 leader_election.cc:343] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.027479 25412 raft_consensus.cc:2468] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 1.
I20260709 13:21:39.027869 25528 leader_election.cc:304] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1154092fa2c04526a55b392074c58a51; no voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:39.028748 25611 raft_consensus.cc:515] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.029963 25416 raft_consensus.cc:2393] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e513729a6434ea782461d121a035e0b in current term 1: Already voted for candidate d0fadd57a0a64a98854b63eb61761a8e in this term.
I20260709 13:21:39.029850 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:39.031436 25413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dee54ceb3740cc84018666437f5291" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
W20260709 13:21:39.033071 25531 leader_election.cc:343] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.034801 25639 raft_consensus.cc:515] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.036405 25413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:39.036768 25611 leader_election.cc:290] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 election: Requested vote from peers 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:39.037137 25413 raft_consensus.cc:3060] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.037838 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:39.039580 25613 leader_election.cc:290] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:39.040334 25613 raft_consensus.cc:2749] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:39.041337 25639 leader_election.cc:290] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:39.041414 25606 raft_consensus.cc:359] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.044054 25607 tablet_bootstrap.cc:492] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b: No bootstrap required, opened a new log
I20260709 13:21:39.043781 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:39.044750 25607 ts_tablet_manager.cc:1403] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.002s
I20260709 13:21:39.044860 25489 raft_consensus.cc:3060] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.046777 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dee54ceb3740cc84018666437f5291" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:39.047636 25491 raft_consensus.cc:3060] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.047559 25607 raft_consensus.cc:359] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.048399 25607 raft_consensus.cc:385] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.048669 25607 raft_consensus.cc:740] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.049304 25607 consensus_queue.cc:260] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.050509 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:39.051448 25490 raft_consensus.cc:2393] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1154092fa2c04526a55b392074c58a51 in current term 1: Already voted for candidate 8e513729a6434ea782461d121a035e0b in this term.
I20260709 13:21:39.051481 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:39.052446 25611 raft_consensus.cc:493] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.053231 25605 tablet_bootstrap.cc:492] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e: No bootstrap required, opened a new log
I20260709 13:21:39.052999 25611 raft_consensus.cc:515] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.053758 25605 ts_tablet_manager.cc:1403] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.006s
I20260709 13:21:39.054775 25607 ts_tablet_manager.cc:1434] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:39.055223 25611 leader_election.cc:290] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:39.044070 25606 raft_consensus.cc:385] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.055805 25606 raft_consensus.cc:740] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.056690 25606 consensus_queue.cc:260] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.057859 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabeec6c779444c9747beb9fa8afaa1" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
I20260709 13:21:39.058495 25562 raft_consensus.cc:2468] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0fadd57a0a64a98854b63eb61761a8e in term 0.
I20260709 13:21:39.058569 25490 raft_consensus.cc:2468] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0fadd57a0a64a98854b63eb61761a8e in term 0.
I20260709 13:21:39.057096 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a56844ee7848cfb953b32f3913868e" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:39.060598 25379 leader_election.cc:304] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:39.064365 25528 leader_election.cc:304] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1154092fa2c04526a55b392074c58a51; no voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:39.065219 25611 raft_consensus.cc:2804] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.065784 25611 raft_consensus.cc:493] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.066234 25611 raft_consensus.cc:3060] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.066679 25606 ts_tablet_manager.cc:1434] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 13:21:39.066897 25640 raft_consensus.cc:2749] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:39.067884 25606 tablet_bootstrap.cc:492] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51: Bootstrap starting.
I20260709 13:21:39.074700 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51"
W20260709 13:21:39.075322 25382 leader_election.cc:343] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.057960 25607 tablet_bootstrap.cc:492] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b: Bootstrap starting.
I20260709 13:21:39.075426 25561 raft_consensus.cc:3060] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.076292 25606 tablet_bootstrap.cc:654] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.080924 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabeec6c779444c9747beb9fa8afaa1" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:39.056982 25605 raft_consensus.cc:359] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.081670 25562 raft_consensus.cc:2468] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0fadd57a0a64a98854b63eb61761a8e in term 0.
I20260709 13:21:39.085831 25382 leader_election.cc:304] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0fadd57a0a64a98854b63eb61761a8e; no voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b
I20260709 13:21:39.082943 25605 raft_consensus.cc:385] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.088354 25607 tablet_bootstrap.cc:654] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.088742 25605 raft_consensus.cc:740] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.090197 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:39.089953 25643 raft_consensus.cc:2749] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:39.094305 25562 raft_consensus.cc:2393] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e513729a6434ea782461d121a035e0b in current term 1: Already voted for candidate 1154092fa2c04526a55b392074c58a51 in this term.
I20260709 13:21:39.091876 25605 consensus_queue.cc:260] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.092726 25489 raft_consensus.cc:2468] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0fadd57a0a64a98854b63eb61761a8e in term 1.
W20260709 13:21:39.096045 25457 leader_election.cc:343] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.096401 25605 ts_tablet_manager.cc:1434] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.002s
I20260709 13:21:39.096247 25379 leader_election.cc:304] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:39.097576 25605 tablet_bootstrap.cc:492] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:39.099236 25491 raft_consensus.cc:2468] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 1.
I20260709 13:21:39.100376 25528 leader_election.cc:304] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:39.101524 25640 raft_consensus.cc:2804] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.102002 25640 raft_consensus.cc:697] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:39.102843 25640 consensus_queue.cc:237] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.103775 25561 raft_consensus.cc:2468] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0fadd57a0a64a98854b63eb61761a8e in term 1.
I20260709 13:21:39.091977 25606 tablet_bootstrap.cc:492] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51: No bootstrap required, opened a new log
I20260709 13:21:39.104930 25606 ts_tablet_manager.cc:1403] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.002s
I20260709 13:21:39.105997 25643 raft_consensus.cc:2804] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.111874 25607 tablet_bootstrap.cc:492] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b: No bootstrap required, opened a new log
I20260709 13:21:39.112398 25607 ts_tablet_manager.cc:1403] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.007s
I20260709 13:21:39.112993 25457 leader_election.cc:304] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:39.109756 25606 raft_consensus.cc:359] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.113317 25413 raft_consensus.cc:2468] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 1.
I20260709 13:21:39.115464 25637 raft_consensus.cc:2764] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:21:39.115371 25611 raft_consensus.cc:515] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
W20260709 13:21:39.117120 25457 leader_election.cc:343] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.117825 25457 leader_election.cc:304] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e513729a6434ea782461d121a035e0b; no voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:39.114535 25606 raft_consensus.cc:385] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.119094 25606 raft_consensus.cc:740] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.119962 25606 consensus_queue.cc:260] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.122872 25611 leader_election.cc:290] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 election: Requested vote from peers 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:39.124490 25637 raft_consensus.cc:2749] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:39.123129 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabeec6c779444c9747beb9fa8afaa1" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:39.107627 25643 raft_consensus.cc:697] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 1 LEADER]: Becoming Leader. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Running, Role: LEADER
W20260709 13:21:39.126122 25457 leader_election.cc:343] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.127480 25643 consensus_queue.cc:237] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.128142 25457 leader_election.cc:304] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e513729a6434ea782461d121a035e0b; no voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:39.128988 25637 raft_consensus.cc:2749] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:39.129397 25457 leader_election.cc:343] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:39.130141 25457 leader_election.cc:343] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.131182 25457 leader_election.cc:304] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 1154092fa2c04526a55b392074c58a51
I20260709 13:21:39.131953 25637 raft_consensus.cc:2804] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.132344 25457 leader_election.cc:304] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e513729a6434ea782461d121a035e0b; no voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:39.133216 25636 raft_consensus.cc:2749] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:39.132458 25637 raft_consensus.cc:697] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Becoming Leader. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:39.126083 25561 raft_consensus.cc:3060] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.133637 25457 leader_election.cc:304] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 1154092fa2c04526a55b392074c58a51
I20260709 13:21:39.134655 25607 raft_consensus.cc:359] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.134513 25637 consensus_queue.cc:237] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.135440 25607 raft_consensus.cc:385] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.135748 25607 raft_consensus.cc:740] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.136700 25607 consensus_queue.cc:260] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.137718 25612 raft_consensus.cc:2804] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.139050 25612 raft_consensus.cc:697] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Becoming Leader. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:39.139384 25607 ts_tablet_manager.cc:1434] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:21:39.140477 25607 tablet_bootstrap.cc:492] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b: Bootstrap starting.
I20260709 13:21:39.140290 25612 consensus_queue.cc:237] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.133296 25312 catalog_manager.cc:5697] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:39.147353 25643 raft_consensus.cc:493] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.138805 25605 tablet_bootstrap.cc:654] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.148936 25643 raft_consensus.cc:515] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.153409 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabeec6c779444c9747beb9fa8afaa1" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:39.154129 25491 raft_consensus.cc:3060] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.154613 25643 leader_election.cc:290] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:39.156225 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd06cc431b74b61931554e409abfe77" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
I20260709 13:21:39.155784 25314 catalog_manager.cc:5697] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65). New cstate: current_term: 1 leader_uuid: "d0fadd57a0a64a98854b63eb61761a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:39.157747 25379 leader_election.cc:343] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.160261 25491 raft_consensus.cc:2468] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0fadd57a0a64a98854b63eb61761a8e in term 1.
I20260709 13:21:39.160526 25606 ts_tablet_manager.cc:1434] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.004s
I20260709 13:21:39.160980 25640 raft_consensus.cc:493] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.161494 25640 raft_consensus.cc:515] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.162417 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd06cc431b74b61931554e409abfe77" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:39.163645 25640 leader_election.cc:290] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
W20260709 13:21:39.164456 25382 leader_election.cc:343] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.164899 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
I20260709 13:21:39.165141 25606 tablet_bootstrap.cc:492] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51: Bootstrap starting.
I20260709 13:21:39.165356 25413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:39.166251 25489 raft_consensus.cc:2468] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 0.
I20260709 13:21:39.164932 25382 leader_election.cc:304] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0fadd57a0a64a98854b63eb61761a8e; no voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b
I20260709 13:21:39.168026 25528 leader_election.cc:304] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: 
I20260709 13:21:39.168644 25643 raft_consensus.cc:2749] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:39.169436 25531 leader_election.cc:343] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.171041 25640 raft_consensus.cc:2804] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.171540 25640 raft_consensus.cc:493] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.171908 25640 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.172040 25379 leader_election.cc:304] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:39.174417 25607 tablet_bootstrap.cc:654] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.176555 25646 raft_consensus.cc:2804] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.177224 25646 raft_consensus.cc:697] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 1 LEADER]: Becoming Leader. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Running, Role: LEADER
I20260709 13:21:39.177883 25561 raft_consensus.cc:2468] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0fadd57a0a64a98854b63eb61761a8e in term 1.
I20260709 13:21:39.178066 25646 consensus_queue.cc:237] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.186669 25607 tablet_bootstrap.cc:492] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b: No bootstrap required, opened a new log
I20260709 13:21:39.186877 25606 tablet_bootstrap.cc:654] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.187284 25607 ts_tablet_manager.cc:1403] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.001s
I20260709 13:21:39.187609 25640 raft_consensus.cc:515] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.190130 25413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
W20260709 13:21:39.191820 25531 leader_election.cc:343] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.192975 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:39.193670 25491 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.194217 25640 leader_election.cc:290] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:39.198513 25605 tablet_bootstrap.cc:492] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e: No bootstrap required, opened a new log
I20260709 13:21:39.199270 25605 ts_tablet_manager.cc:1403] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.002s
I20260709 13:21:39.203179 25605 raft_consensus.cc:359] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.203999 25605 raft_consensus.cc:385] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.204289 25605 raft_consensus.cc:740] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.206539 25606 tablet_bootstrap.cc:492] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51: No bootstrap required, opened a new log
I20260709 13:21:39.207159 25606 ts_tablet_manager.cc:1403] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.005s
I20260709 13:21:39.196237 25607 raft_consensus.cc:359] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.207734 25607 raft_consensus.cc:385] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.208035 25607 raft_consensus.cc:740] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.208590 25491 raft_consensus.cc:2468] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 1.
I20260709 13:21:39.210012 25528 leader_election.cc:304] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:39.210150 25606 raft_consensus.cc:359] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.210880 25606 raft_consensus.cc:385] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.211165 25606 raft_consensus.cc:740] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.211263 25640 raft_consensus.cc:2804] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.211755 25640 raft_consensus.cc:697] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:39.212142 25606 consensus_queue.cc:260] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.212577 25640 consensus_queue.cc:237] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.212451 25311 catalog_manager.cc:5697] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e513729a6434ea782461d121a035e0b (127.15.242.66). New cstate: current_term: 1 leader_uuid: "8e513729a6434ea782461d121a035e0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.214692 25606 ts_tablet_manager.cc:1434] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:21:39.215750 25606 tablet_bootstrap.cc:492] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51: Bootstrap starting.
I20260709 13:21:39.208830 25607 consensus_queue.cc:260] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.218364 25605 consensus_queue.cc:260] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.219772 25607 ts_tablet_manager.cc:1434] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:21:39.222288 25605 ts_tablet_manager.cc:1434] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:21:39.222731 25606 tablet_bootstrap.cc:654] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.223549 25605 tablet_bootstrap.cc:492] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:39.221570 25312 catalog_manager.cc:5697] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:39.230193 25612 raft_consensus.cc:493] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.230746 25612 raft_consensus.cc:515] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.232959 25612 leader_election.cc:290] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:39.233183 25605 tablet_bootstrap.cc:654] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.234760 25606 tablet_bootstrap.cc:492] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51: No bootstrap required, opened a new log
I20260709 13:21:39.235333 25606 ts_tablet_manager.cc:1403] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:21:39.235430 25413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:39.236665 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:39.237311 25561 raft_consensus.cc:2468] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 0.
I20260709 13:21:39.238869 25457 leader_election.cc:304] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: 
I20260709 13:21:39.239060 25606 raft_consensus.cc:359] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
W20260709 13:21:39.239836 25457 leader_election.cc:343] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.240207 25606 raft_consensus.cc:385] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.240644 25606 raft_consensus.cc:740] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.241895 25612 raft_consensus.cc:2804] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.241931 25606 consensus_queue.cc:260] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.244997 25612 raft_consensus.cc:493] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.245558 25612 raft_consensus.cc:3060] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.246407 25605 tablet_bootstrap.cc:492] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e: No bootstrap required, opened a new log
I20260709 13:21:39.245471 25313 catalog_manager.cc:5697] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e513729a6434ea782461d121a035e0b (127.15.242.66). New cstate: current_term: 1 leader_uuid: "8e513729a6434ea782461d121a035e0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.246944 25606 ts_tablet_manager.cc:1434] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:21:39.248047 25606 tablet_bootstrap.cc:492] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51: Bootstrap starting.
I20260709 13:21:39.246989 25605 ts_tablet_manager.cc:1403] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 13:21:39.251544 25314 catalog_manager.cc:5697] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e reported cstate change: term changed from 0 to 1, leader changed from <none> to d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65). New cstate: current_term: 1 leader_uuid: "d0fadd57a0a64a98854b63eb61761a8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.252302 25637 raft_consensus.cc:493] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.252882 25637 raft_consensus.cc:515] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.254561 25606 tablet_bootstrap.cc:654] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.254336 25612 raft_consensus.cc:515] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.255052 25637 leader_election.cc:290] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:39.256341 25646 raft_consensus.cc:493] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.254110 25605 raft_consensus.cc:359] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.256942 25646 raft_consensus.cc:515] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.257331 25605 raft_consensus.cc:385] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.257684 25605 raft_consensus.cc:740] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.258527 25605 consensus_queue.cc:260] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.259169 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:39.260841 25605 ts_tablet_manager.cc:1434] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:21:39.261885 25605 tablet_bootstrap.cc:492] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:39.262483 25412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:39.263072 25412 raft_consensus.cc:3060] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.264070 25413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a56844ee7848cfb953b32f3913868e" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:39.264710 25413 raft_consensus.cc:2468] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 0.
I20260709 13:21:39.259807 25562 raft_consensus.cc:3060] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.268147 25605 tablet_bootstrap.cc:654] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.270421 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a56844ee7848cfb953b32f3913868e" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:39.270745 25457 leader_election.cc:304] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:39.271140 25561 raft_consensus.cc:2468] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 0.
I20260709 13:21:39.271891 25637 raft_consensus.cc:2804] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.272271 25637 raft_consensus.cc:493] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.272622 25637 raft_consensus.cc:3060] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.273181 25646 leader_election.cc:290] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:39.274878 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
I20260709 13:21:39.275663 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "d0fadd57a0a64a98854b63eb61761a8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
I20260709 13:21:39.275684 25491 raft_consensus.cc:2393] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d0fadd57a0a64a98854b63eb61761a8e in current term 1: Already voted for candidate 1154092fa2c04526a55b392074c58a51 in this term.
I20260709 13:21:39.278477 25382 leader_election.cc:304] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0fadd57a0a64a98854b63eb61761a8e; no voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b
I20260709 13:21:39.278882 25562 raft_consensus.cc:2468] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 1.
I20260709 13:21:39.256428 25612 leader_election.cc:290] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:39.279690 25646 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.282277 25412 raft_consensus.cc:2468] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 1.
I20260709 13:21:39.282986 25457 leader_election.cc:304] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: 
I20260709 13:21:39.288187 25612 raft_consensus.cc:2804] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.288870 25612 raft_consensus.cc:697] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Becoming Leader. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:39.289968 25612 consensus_queue.cc:237] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.292665 25606 tablet_bootstrap.cc:492] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51: No bootstrap required, opened a new log
I20260709 13:21:39.292341 25637 raft_consensus.cc:515] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.293191 25606 ts_tablet_manager.cc:1403] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.007s
I20260709 13:21:39.295485 25412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a56844ee7848cfb953b32f3913868e" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:39.296082 25412 raft_consensus.cc:3060] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.297962 25606 raft_consensus.cc:359] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.298694 25606 raft_consensus.cc:385] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.298982 25606 raft_consensus.cc:740] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.299875 25606 consensus_queue.cc:260] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.302464 25606 ts_tablet_manager.cc:1434] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:39.303694 25606 tablet_bootstrap.cc:492] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51: Bootstrap starting.
I20260709 13:21:39.305402 25412 raft_consensus.cc:2468] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 1.
I20260709 13:21:39.306620 25457 leader_election.cc:304] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:39.307514 25636 raft_consensus.cc:2804] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.302482 25646 raft_consensus.cc:2749] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:39.321589 25637 leader_election.cc:290] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 1 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:39.323649 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a56844ee7848cfb953b32f3913868e" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:39.324200 25561 raft_consensus.cc:3060] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.328039 25606 tablet_bootstrap.cc:654] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.329759 25605 tablet_bootstrap.cc:492] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e: No bootstrap required, opened a new log
I20260709 13:21:39.330318 25605 ts_tablet_manager.cc:1403] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.013s
I20260709 13:21:39.322728 25636 raft_consensus.cc:697] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Becoming Leader. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:39.331872 25636 consensus_queue.cc:237] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.330303 25314 catalog_manager.cc:5697] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e513729a6434ea782461d121a035e0b (127.15.242.66). New cstate: current_term: 1 leader_uuid: "8e513729a6434ea782461d121a035e0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.335289 25605 raft_consensus.cc:359] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.336233 25605 raft_consensus.cc:385] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.336525 25605 raft_consensus.cc:740] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.337458 25605 consensus_queue.cc:260] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.341322 25640 raft_consensus.cc:493] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.341339 25605 ts_tablet_manager.cc:1434] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:21:39.341815 25640 raft_consensus.cc:515] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.342536 25605 tablet_bootstrap.cc:492] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:39.343760 25640 leader_election.cc:290] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:39.344523 25412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd06cc431b74b61931554e409abfe77" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:39.345192 25412 raft_consensus.cc:2468] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 0.
I20260709 13:21:39.345415 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd06cc431b74b61931554e409abfe77" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
I20260709 13:21:39.346123 25491 raft_consensus.cc:2468] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 0.
I20260709 13:21:39.346414 25531 leader_election.cc:304] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:39.347849 25640 raft_consensus.cc:2804] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.340674 25561 raft_consensus.cc:2468] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 1.
I20260709 13:21:39.348282 25605 tablet_bootstrap.cc:654] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.348229 25640 raft_consensus.cc:493] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.348827 25640 raft_consensus.cc:3060] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.350814 25606 tablet_bootstrap.cc:492] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51: No bootstrap required, opened a new log
I20260709 13:21:39.353335 25606 ts_tablet_manager.cc:1403] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.002s
I20260709 13:21:39.356252 25640 raft_consensus.cc:515] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.356730 25606 raft_consensus.cc:359] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.357683 25606 raft_consensus.cc:385] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.358040 25606 raft_consensus.cc:740] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.358912 25606 consensus_queue.cc:260] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.359206 25412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd06cc431b74b61931554e409abfe77" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:39.359464 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd06cc431b74b61931554e409abfe77" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:39.359975 25412 raft_consensus.cc:3060] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.360013 25491 raft_consensus.cc:3060] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.361290 25606 ts_tablet_manager.cc:1434] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:39.367298 25412 raft_consensus.cc:2468] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 1.
I20260709 13:21:39.367398 25640 leader_election.cc:290] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:39.367298 25491 raft_consensus.cc:2468] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 1.
I20260709 13:21:39.368853 25531 leader_election.cc:304] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:39.369699 25640 raft_consensus.cc:2804] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.370409 25640 raft_consensus.cc:697] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:39.371317 25640 consensus_queue.cc:237] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.377573 25605 tablet_bootstrap.cc:492] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e: No bootstrap required, opened a new log
I20260709 13:21:39.378180 25605 ts_tablet_manager.cc:1403] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.014s
I20260709 13:21:39.377430 25314 catalog_manager.cc:5697] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e513729a6434ea782461d121a035e0b (127.15.242.66). New cstate: current_term: 1 leader_uuid: "8e513729a6434ea782461d121a035e0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.381001 25605 raft_consensus.cc:359] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.381680 25605 raft_consensus.cc:385] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.381939 25605 raft_consensus.cc:740] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.382632 25605 consensus_queue.cc:260] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.384795 25605 ts_tablet_manager.cc:1434] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:39.386065 25312 catalog_manager.cc:5697] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:39.425737 25640 raft_consensus.cc:493] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.426398 25640 raft_consensus.cc:515] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.428427 25640 leader_election.cc:290] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:39.429139 25412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:39.429622 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
I20260709 13:21:39.430146 25412 raft_consensus.cc:2393] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1154092fa2c04526a55b392074c58a51 in current term 1: Already voted for candidate 8e513729a6434ea782461d121a035e0b in this term.
I20260709 13:21:39.431357 25531 leader_election.cc:304] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1154092fa2c04526a55b392074c58a51; no voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:39.432169 25640 raft_consensus.cc:3060] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.437583 25640 raft_consensus.cc:2749] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:39.499552 25640 raft_consensus.cc:493] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.500083 25640 raft_consensus.cc:515] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.501927 25640 leader_election.cc:290] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:39.503027 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4026ade6660a484b9592984bfac572d6" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
I20260709 13:21:39.502966 25412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4026ade6660a484b9592984bfac572d6" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e" is_pre_election: true
I20260709 13:21:39.503948 25491 raft_consensus.cc:2468] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 0.
I20260709 13:21:39.503978 25412 raft_consensus.cc:2468] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 0.
I20260709 13:21:39.505529 25528 leader_election.cc:304] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: 
I20260709 13:21:39.506343 25640 raft_consensus.cc:2804] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.506721 25640 raft_consensus.cc:493] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.507025 25640 raft_consensus.cc:3060] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.513967 25640 raft_consensus.cc:515] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.516050 25640 leader_election.cc:290] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:39.516847 25412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4026ade6660a484b9592984bfac572d6" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:39.517130 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4026ade6660a484b9592984bfac572d6" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:39.517414 25412 raft_consensus.cc:3060] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.517774 25491 raft_consensus.cc:3060] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.523118 25491 raft_consensus.cc:2468] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 1.
I20260709 13:21:39.523379 25412 raft_consensus.cc:2468] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 1.
I20260709 13:21:39.524328 25528 leader_election.cc:304] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: 
I20260709 13:21:39.525480 25640 raft_consensus.cc:2804] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.526120 25640 raft_consensus.cc:697] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:39.527016 25640 consensus_queue.cc:237] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:39.535223 25314 catalog_manager.cc:5697] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:39.580802 25636 consensus_queue.cc:1048] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:39.593940 25612 consensus_queue.cc:1048] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:39.597080 25612 consensus_queue.cc:1048] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:39.601009 25640 consensus_queue.cc:1048] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:39.631531 25665 consensus_queue.cc:1048] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:39.636888 25639 consensus_queue.cc:1048] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:39.642937 25646 consensus_queue.cc:1048] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:39.646596 25416 raft_consensus.cc:3060] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.654376 25639 consensus_queue.cc:1048] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:39.660912 25639 consensus_queue.cc:1048] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:39.668870 25611 consensus_queue.cc:1048] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:39.675777 25646 consensus_queue.cc:1048] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:39.708482 25646 consensus_queue.cc:1048] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:39.713404 16329 ts_manager.cc:295] Set tserver state for d0fadd57a0a64a98854b63eb61761a8e to MAINTENANCE_MODE
I20260709 13:21:39.714768 16329 tablet_server.cc:179] TabletServer@127.15.242.65:0 shutting down...
W20260709 13:21:39.735525 25457 consensus_peers.cc:597] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:39.758503 25665 consensus_queue.cc:1048] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:39.771204 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:39.773628 16329 tablet_replica.cc:333] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e: stopping tablet replica
I20260709 13:21:39.774411 16329 raft_consensus.cc:2243] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.774904 16329 raft_consensus.cc:2272] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.779675 16329 tablet_replica.cc:333] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e: stopping tablet replica
I20260709 13:21:39.780519 16329 raft_consensus.cc:2243] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.781016 16329 raft_consensus.cc:2272] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.783305 16329 tablet_replica.cc:333] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e: stopping tablet replica
I20260709 13:21:39.783841 16329 raft_consensus.cc:2243] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.784164 16329 raft_consensus.cc:2272] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.785744 16329 tablet_replica.cc:333] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e: stopping tablet replica
I20260709 13:21:39.786305 16329 raft_consensus.cc:2243] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.786671 16329 raft_consensus.cc:2272] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.788795 16329 tablet_replica.cc:333] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e: stopping tablet replica
I20260709 13:21:39.789312 16329 raft_consensus.cc:2243] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.789734 16329 raft_consensus.cc:2272] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.792325 16329 tablet_replica.cc:333] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e: stopping tablet replica
I20260709 13:21:39.792891 16329 raft_consensus.cc:2243] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.793313 16329 raft_consensus.cc:2272] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.795842 16329 tablet_replica.cc:333] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e: stopping tablet replica
I20260709 13:21:39.796438 16329 raft_consensus.cc:2243] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:39.797308 16329 raft_consensus.cc:2272] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.800551 16329 tablet_replica.cc:333] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e: stopping tablet replica
I20260709 13:21:39.801446 16329 raft_consensus.cc:2243] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:39.802521 16329 raft_consensus.cc:2272] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:39.803109 25531 consensus_peers.cc:597] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:39.804883 16329 tablet_replica.cc:333] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e: stopping tablet replica
I20260709 13:21:39.805464 16329 raft_consensus.cc:2243] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.805822 16329 raft_consensus.cc:2272] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:39.808029 16329 tablet_replica.cc:333] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e: stopping tablet replica
I20260709 13:21:39.808519 16329 raft_consensus.cc:2243] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:39.808861 16329 raft_consensus.cc:2272] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:39.822158 25457 consensus_peers.cc:597] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:39.839486 16329 tablet_server.cc:196] TabletServer@127.15.242.65:0 shutdown complete.
I20260709 13:21:39.859608 25665 consensus_queue.cc:1048] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:39.897576 25685 consensus_queue.cc:1048] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:39.930220 25685 consensus_queue.cc:1048] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:39.946890 25531 consensus_peers.cc:597] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.101454 25457 consensus_peers.cc:597] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.194571 25457 consensus_peers.cc:597] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.202221 25531 consensus_peers.cc:597] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.260011 25531 consensus_peers.cc:597] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.727341 25362 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:40.829499 25531 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111) [suppressed 131 similar messages]
I20260709 13:21:41.166489 25612 raft_consensus.cc:493] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d0fadd57a0a64a98854b63eb61761a8e)
I20260709 13:21:41.166949 25612 raft_consensus.cc:515] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:41.168531 25612 leader_election.cc:290] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:41.170293 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
W20260709 13:21:41.172719 25457 leader_election.cc:336] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111)
I20260709 13:21:41.173169 25457 leader_election.cc:304] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e513729a6434ea782461d121a035e0b; no voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:41.173883 25612 raft_consensus.cc:2749] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:41.174214 25685 raft_consensus.cc:493] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d0fadd57a0a64a98854b63eb61761a8e)
I20260709 13:21:41.174878 25685 raft_consensus.cc:515] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:41.177074 25685 leader_election.cc:290] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:41.178151 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
I20260709 13:21:41.178823 25489 raft_consensus.cc:2468] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 1.
I20260709 13:21:41.180140 25528 leader_election.cc:304] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: 
I20260709 13:21:41.180931 25685 raft_consensus.cc:2804] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:41.181351 25685 raft_consensus.cc:493] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d0fadd57a0a64a98854b63eb61761a8e)
W20260709 13:21:41.181565 25531 leader_election.cc:336] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111)
I20260709 13:21:41.182013 25685 raft_consensus.cc:3060] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:41.191718 25685 raft_consensus.cc:515] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:41.193401 25685 leader_election.cc:290] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:41.194659 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:41.195406 25489 raft_consensus.cc:3060] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:41.197686 25531 leader_election.cc:336] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111)
I20260709 13:21:41.201924 25489 raft_consensus.cc:2468] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 2.
I20260709 13:21:41.203438 25528 leader_election.cc:304] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:41.204166 25685 raft_consensus.cc:2804] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:41.204681 25685 raft_consensus.cc:697] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:41.205472 25685 consensus_queue.cc:237] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:41.209936 25685 raft_consensus.cc:493] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d0fadd57a0a64a98854b63eb61761a8e)
I20260709 13:21:41.210529 25685 raft_consensus.cc:515] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:41.212455 25685 leader_election.cc:290] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:41.213167 25612 raft_consensus.cc:493] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d0fadd57a0a64a98854b63eb61761a8e)
I20260709 13:21:41.213979 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabeec6c779444c9747beb9fa8afaa1" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b" is_pre_election: true
I20260709 13:21:41.213796 25612 raft_consensus.cc:515] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:41.215180 25489 raft_consensus.cc:2468] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 1.
I20260709 13:21:41.214859 25311 catalog_manager.cc:5697] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 1 to 2, leader changed from d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65) to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:41.216606 25528 leader_election.cc:304] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: 
I20260709 13:21:41.217919 25685 raft_consensus.cc:2804] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:21:41.218071 25531 leader_election.cc:336] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111)
I20260709 13:21:41.218498 25685 raft_consensus.cc:493] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d0fadd57a0a64a98854b63eb61761a8e)
I20260709 13:21:41.219049 25685 raft_consensus.cc:3060] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:41.219880 25612 leader_election.cc:290] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:41.222827 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabeec6c779444c9747beb9fa8afaa1" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1154092fa2c04526a55b392074c58a51" is_pre_election: true
W20260709 13:21:41.223840 25457 leader_election.cc:336] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111)
I20260709 13:21:41.227610 25685 raft_consensus.cc:515] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:41.229291 25561 raft_consensus.cc:2393] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e513729a6434ea782461d121a035e0b in current term 2: Already voted for candidate 1154092fa2c04526a55b392074c58a51 in this term.
I20260709 13:21:41.231246 25685 leader_election.cc:290] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:41.231761 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabeec6c779444c9747beb9fa8afaa1" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:41.232234 25457 leader_election.cc:304] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e513729a6434ea782461d121a035e0b; no voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:41.232460 25489 raft_consensus.cc:3060] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:41.235261 25531 leader_election.cc:336] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111)
I20260709 13:21:41.241513 25489 raft_consensus.cc:2468] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 2.
I20260709 13:21:41.242111 25612 raft_consensus.cc:2749] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:41.243067 25528 leader_election.cc:304] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: d0fadd57a0a64a98854b63eb61761a8e
I20260709 13:21:41.244114 25685 raft_consensus.cc:2804] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:41.244693 25685 raft_consensus.cc:697] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:41.245657 25685 consensus_queue.cc:237] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:41.253997 25311 catalog_manager.cc:5697] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 1 to 2, leader changed from d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65) to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:41.653280 25489 raft_consensus.cc:1275] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.654597 25685 consensus_queue.cc:1048] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:41.668344 25531 consensus_peers.cc:597] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.728392 25362 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:41.811106 25531 consensus_peers.cc:597] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:41.830653 25489 raft_consensus.cc:1275] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.832193 25705 consensus_queue.cc:1048] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:42.161752 25457 consensus_peers.cc:597] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:42.226882 25457 consensus_peers.cc:597] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:42.422519 25531 consensus_peers.cc:597] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:42.524705 25457 consensus_peers.cc:597] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:42.552994 25457 consensus_peers.cc:597] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:42.583599 25531 consensus_peers.cc:597] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:42.639220 25531 consensus_peers.cc:597] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:42.729496 25362 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:42.809760 25531 consensus_peers.cc:597] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:43.730733 25362 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:44.340838 25531 consensus_peers.cc:597] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:44.425552 25531 consensus_peers.cc:597] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:44.732137 25362 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:44.806187 25457 consensus_peers.cc:597] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:44.834864 25457 consensus_peers.cc:597] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:44.859256 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:44.868379 25711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:44.868594 25710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:44.869897 25713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:44.869968 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:44.872617 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:44.872838 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:44.873075 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603304873037 us; error 0 us; skew 500 ppm
I20260709 13:21:44.873741 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:44.878507 16329 webserver.cc:533] Webserver started at http://127.15.242.65:40279/ using document root <none> and password file <none>
I20260709 13:21:44.879485 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:44.879747 16329 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:21:44.885051 16329 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:21:44.889725 25718 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:44.890748 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:21:44.891104 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-0-root
uuid: "d0fadd57a0a64a98854b63eb61761a8e"
format_stamp: "Formatted at 2026-07-09 13:21:37 on dist-test-slave-fh5z"
I20260709 13:21:44.891649 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603035614178-16329-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:44.917867 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:44.919378 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:44.921241 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:44.925477 25725 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:21:44.986723 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:21:44.987080 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.063s	user 0.001s	sys 0.002s
I20260709 13:21:44.987433 16329 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:21:44.995482 25725 tablet_bootstrap.cc:492] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
W20260709 13:21:44.996222 25531 consensus_peers.cc:597] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:45.013065 25725 tablet_bootstrap.cc:492] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:45.014175 25725 tablet_bootstrap.cc:492] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap complete.
I20260709 13:21:45.014951 25725 ts_tablet_manager.cc:1403] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:21:45.018309 25725 raft_consensus.cc:359] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.019546 25725 raft_consensus.cc:740] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:45.020879 25725 consensus_queue.cc:260] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.025472 25725 ts_tablet_manager.cc:1434] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:21:45.027002 25725 tablet_bootstrap.cc:492] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:45.046003 25725 tablet_bootstrap.cc:492] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:45.047237 25725 tablet_bootstrap.cc:492] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap complete.
I20260709 13:21:45.047973 25725 ts_tablet_manager.cc:1403] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:21:45.050221 25725 raft_consensus.cc:359] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.050776 25725 raft_consensus.cc:740] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:45.051458 25725 consensus_queue.cc:260] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.053234 25725 ts_tablet_manager.cc:1434] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:45.054029 25725 tablet_bootstrap.cc:492] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
W20260709 13:21:45.057876 25531 consensus_peers.cc:597] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:45.060130 16329 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:21:45.060465 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.073s	user 0.070s	sys 0.001s
I20260709 13:21:45.067976 25725 tablet_bootstrap.cc:492] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:45.068810 25725 tablet_bootstrap.cc:492] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap complete.
I20260709 13:21:45.069427 25725 ts_tablet_manager.cc:1403] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:21:45.072373 25725 raft_consensus.cc:359] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.072999 25725 raft_consensus.cc:740] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:45.073704 25725 consensus_queue.cc:260] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.075515 25725 ts_tablet_manager.cc:1434] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:21:45.076422 25725 tablet_bootstrap.cc:492] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
W20260709 13:21:45.086807 25457 consensus_peers.cc:597] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:45.093760 25725 tablet_bootstrap.cc:492] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:45.095095 25725 tablet_bootstrap.cc:492] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap complete.
I20260709 13:21:45.095959 25725 ts_tablet_manager.cc:1403] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 13:21:45.098740 25725 raft_consensus.cc:359] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.099382 25725 raft_consensus.cc:740] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:45.100239 25725 consensus_queue.cc:260] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.102612 25725 ts_tablet_manager.cc:1434] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:21:45.103520 25725 tablet_bootstrap.cc:492] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
W20260709 13:21:45.119416 25531 consensus_peers.cc:597] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:45.124541 25725 tablet_bootstrap.cc:492] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:45.125756 25725 tablet_bootstrap.cc:492] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap complete.
I20260709 13:21:45.126407 25725 ts_tablet_manager.cc:1403] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.023s	user 0.022s	sys 0.000s
I20260709 13:21:45.128988 25725 raft_consensus.cc:359] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.130240 25725 raft_consensus.cc:740] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:45.131305 25725 consensus_queue.cc:260] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.133636 25725 ts_tablet_manager.cc:1434] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:21:45.134470 25725 tablet_bootstrap.cc:492] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:45.137899 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.65:45161
I20260709 13:21:45.138085 25787 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.65:45161 every 8 connection(s)
I20260709 13:21:45.143814 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:45.153803 25725 tablet_bootstrap.cc:492] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:45.155151 25725 tablet_bootstrap.cc:492] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap complete.
I20260709 13:21:45.155901 25725 ts_tablet_manager.cc:1403] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.001s
I20260709 13:21:45.158592 25725 raft_consensus.cc:359] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.159808 25725 raft_consensus.cc:740] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:45.161196 25725 consensus_queue.cc:260] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.163902 25725 ts_tablet_manager.cc:1434] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:45.164847 25725 tablet_bootstrap.cc:492] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:45.168900 25788 heartbeater.cc:344] Connected to a master server at 127.15.242.126:39199
I20260709 13:21:45.169498 25788 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:45.170640 25788 heartbeater.cc:507] Master 127.15.242.126:39199 requested a full tablet report, sending...
I20260709 13:21:45.174623 25562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
mode: GRACEFUL
new_leader_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:47916
I20260709 13:21:45.175434 25562 raft_consensus.cc:606] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Received request to transfer leadership to TS 8e513729a6434ea782461d121a035e0b
I20260709 13:21:45.178795 25562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fd06cc431b74b61931554e409abfe77"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
mode: GRACEFUL
new_leader_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:47916
I20260709 13:21:45.179373 25313 ts_manager.cc:194] Re-registered known tserver with Master: d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161)
I20260709 13:21:45.179422 25562 raft_consensus.cc:606] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Received request to transfer leadership to TS 8e513729a6434ea782461d121a035e0b
I20260709 13:21:45.181350 25725 tablet_bootstrap.cc:492] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:45.182512 25725 tablet_bootstrap.cc:492] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap complete.
I20260709 13:21:45.183318 25725 ts_tablet_manager.cc:1403] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:21:45.187310 25725 raft_consensus.cc:359] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.188437 25725 raft_consensus.cc:740] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:45.189502 25725 consensus_queue.cc:260] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.192770 25725 ts_tablet_manager.cc:1434] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:45.193696 25725 tablet_bootstrap.cc:492] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:45.194238 25313 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43806
I20260709 13:21:45.197590 25788 heartbeater.cc:499] Master 127.15.242.126:39199 was elected leader, sending a full tablet report...
I20260709 13:21:45.204164 25489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
mode: GRACEFUL
new_leader_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:51534
I20260709 13:21:45.204793 25489 raft_consensus.cc:606] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Received request to transfer leadership to TS 1154092fa2c04526a55b392074c58a51
I20260709 13:21:45.206908 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:45.207639 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:45.208628 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:45.210342 25725 tablet_bootstrap.cc:492] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:45.211149 25725 tablet_bootstrap.cc:492] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap complete.
I20260709 13:21:45.211678 25725 ts_tablet_manager.cc:1403] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:21:45.213860 25725 raft_consensus.cc:359] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.214519 25725 raft_consensus.cc:740] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:45.215193 25725 consensus_queue.cc:260] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.217178 25725 ts_tablet_manager.cc:1434] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:21:45.217999 25725 tablet_bootstrap.cc:492] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:45.229996 25725 tablet_bootstrap.cc:492] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:45.230810 25725 tablet_bootstrap.cc:492] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap complete.
I20260709 13:21:45.231359 25725 ts_tablet_manager.cc:1403] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.006s
I20260709 13:21:45.233340 25725 raft_consensus.cc:359] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.233862 25725 raft_consensus.cc:740] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:45.234547 25725 consensus_queue.cc:260] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.236218 25725 ts_tablet_manager.cc:1434] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:21:45.237251 25725 tablet_bootstrap.cc:492] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap starting.
I20260709 13:21:45.251614 25725 tablet_bootstrap.cc:492] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:45.252441 25725 tablet_bootstrap.cc:492] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e: Bootstrap complete.
I20260709 13:21:45.253063 25725 ts_tablet_manager.cc:1403] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:21:45.255136 25725 raft_consensus.cc:359] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.255651 25725 raft_consensus.cc:740] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fadd57a0a64a98854b63eb61761a8e, State: Initialized, Role: FOLLOWER
I20260709 13:21:45.256304 25725 consensus_queue.cc:260] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.258065 25725 ts_tablet_manager.cc:1434] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:21:45.358311 25705 raft_consensus.cc:993] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51: : Instructing follower 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:45.358924 25803 raft_consensus.cc:1081] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Signalling peer 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:45.360949 25489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fd06cc431b74b61931554e409abfe77"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:56032
I20260709 13:21:45.361637 25489 raft_consensus.cc:493] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.362074 25489 raft_consensus.cc:3060] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.370932 25489 raft_consensus.cc:515] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.372637 25489 leader_election.cc:290] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 2 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:45.373826 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd06cc431b74b61931554e409abfe77" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:45.373732 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd06cc431b74b61931554e409abfe77" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:45.374670 25562 raft_consensus.cc:3055] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:45.374835 25762 raft_consensus.cc:3060] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.375010 25562 raft_consensus.cc:740] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:45.376129 25562 consensus_queue.cc:260] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.377220 25562 raft_consensus.cc:3060] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.380959 25762 raft_consensus.cc:2468] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 2.
I20260709 13:21:45.382257 25457 leader_election.cc:304] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:45.383085 25709 raft_consensus.cc:2804] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:45.384030 25562 raft_consensus.cc:2468] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 2.
I20260709 13:21:45.384349 25709 raft_consensus.cc:697] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 2 LEADER]: Becoming Leader. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:45.385504 25709 consensus_queue.cc:237] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.394279 25313 catalog_manager.cc:5697] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b reported cstate change: term changed from 1 to 2, leader changed from 1154092fa2c04526a55b392074c58a51 (127.15.242.67) to 8e513729a6434ea782461d121a035e0b (127.15.242.66). New cstate: current_term: 2 leader_uuid: "8e513729a6434ea782461d121a035e0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.437469 25762 raft_consensus.cc:3060] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.489355 25762 raft_consensus.cc:3060] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.497267 25705 raft_consensus.cc:993] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51: : Instructing follower 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:45.497923 25803 raft_consensus.cc:1081] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Signalling peer 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:45.499931 25489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:56032
I20260709 13:21:45.500547 25489 raft_consensus.cc:493] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.500950 25489 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.507043 25489 raft_consensus.cc:515] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.508801 25489 leader_election.cc:290] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 2 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:45.509467 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:45.509720 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:45.510159 25762 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.510417 25562 raft_consensus.cc:3055] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:45.511082 25562 raft_consensus.cc:740] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:45.511994 25562 consensus_queue.cc:260] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.513007 25562 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.516312 25762 raft_consensus.cc:2468] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 2.
I20260709 13:21:45.517381 25457 leader_election.cc:304] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:45.518066 25709 raft_consensus.cc:2804] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:45.518551 25709 raft_consensus.cc:697] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 2 LEADER]: Becoming Leader. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:45.519490 25709 consensus_queue.cc:237] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.520071 25562 raft_consensus.cc:2468] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 2.
I20260709 13:21:45.527609 25313 catalog_manager.cc:5697] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b reported cstate change: term changed from 1 to 2, leader changed from 1154092fa2c04526a55b392074c58a51 (127.15.242.67) to 8e513729a6434ea782461d121a035e0b (127.15.242.66). New cstate: current_term: 2 leader_uuid: "8e513729a6434ea782461d121a035e0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.719391 25804 raft_consensus.cc:993] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b: : Instructing follower 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:45.719954 25709 raft_consensus.cc:1081] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Signalling peer 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:45.721562 25562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:34838
I20260709 13:21:45.722273 25562 raft_consensus.cc:493] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.722656 25562 raft_consensus.cc:3060] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.730512 25562 raft_consensus.cc:515] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.732105 25562 leader_election.cc:290] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:45.733019 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
W20260709 13:21:45.733327 25362 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:45.733726 25762 raft_consensus.cc:3060] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.733364 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:45.734591 25489 raft_consensus.cc:3055] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:45.734846 25489 raft_consensus.cc:740] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:45.735716 25489 consensus_queue.cc:260] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.736871 25489 raft_consensus.cc:3060] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.739660 25762 raft_consensus.cc:2468] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 2.
I20260709 13:21:45.740796 25531 leader_election.cc:304] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:45.741787 25815 raft_consensus.cc:2804] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:45.742239 25815 raft_consensus.cc:697] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:45.743182 25489 raft_consensus.cc:2468] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 2.
I20260709 13:21:45.743139 25815 consensus_queue.cc:237] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:45.751489 25313 catalog_manager.cc:5697] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 1 to 2, leader changed from 8e513729a6434ea782461d121a035e0b (127.15.242.66) to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:45.871899 25762 raft_consensus.cc:1275] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.873281 25818 consensus_queue.cc:1048] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:45.886696 25562 raft_consensus.cc:1275] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.888031 25709 consensus_queue.cc:1048] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:45.959236 25562 raft_consensus.cc:1275] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.960898 25709 consensus_queue.cc:1048] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:45.972927 25762 raft_consensus.cc:1275] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.974697 25804 consensus_queue.cc:1048] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.220209 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:46.227506 25489 raft_consensus.cc:1275] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.229444 25815 consensus_queue.cc:1048] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.229993 25489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
mode: GRACEFUL
new_leader_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:51534
I20260709 13:21:46.230636 25489 raft_consensus.cc:606] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 2 LEADER]: Received request to transfer leadership to TS 1154092fa2c04526a55b392074c58a51
I20260709 13:21:46.233481 25562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62dee54ceb3740cc84018666437f5291"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
mode: GRACEFUL
new_leader_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:47916
I20260709 13:21:46.234156 25562 raft_consensus.cc:606] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Received request to transfer leadership to TS 8e513729a6434ea782461d121a035e0b
I20260709 13:21:46.237751 25490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
mode: GRACEFUL
new_leader_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:51534
I20260709 13:21:46.238503 25490 raft_consensus.cc:606] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Received request to transfer leadership to TS 1154092fa2c04526a55b392074c58a51
I20260709 13:21:46.239928 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:46.240548 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:46.241582 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:46.240532 25762 raft_consensus.cc:1275] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.244637 25803 consensus_queue.cc:1048] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.361733 25804 raft_consensus.cc:993] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b: : Instructing follower 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:46.362290 25818 raft_consensus.cc:1081] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Signalling peer 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:46.363950 25562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:34838
I20260709 13:21:46.364449 25562 raft_consensus.cc:493] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:46.364771 25562 raft_consensus.cc:3060] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.371536 25562 raft_consensus.cc:515] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:46.373695 25562 leader_election.cc:290] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:46.374451 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:46.374845 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:46.375276 25762 raft_consensus.cc:3060] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.375543 25490 raft_consensus.cc:3055] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:46.375950 25490 raft_consensus.cc:740] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:46.376964 25490 consensus_queue.cc:260] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:46.378556 25490 raft_consensus.cc:3060] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.384300 25762 raft_consensus.cc:2468] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 2.
I20260709 13:21:46.386198 25531 leader_election.cc:304] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:46.387552 25815 raft_consensus.cc:2804] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:46.387450 25490 raft_consensus.cc:2468] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 2.
I20260709 13:21:46.388475 25815 raft_consensus.cc:697] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:46.389701 25815 consensus_queue.cc:237] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:46.397976 25313 catalog_manager.cc:5697] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 1 to 2, leader changed from 8e513729a6434ea782461d121a035e0b (127.15.242.66) to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:46.399636 25705 raft_consensus.cc:993] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51: : Instructing follower 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:46.400388 25815 raft_consensus.cc:1081] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Signalling peer 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:46.402688 25490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62dee54ceb3740cc84018666437f5291"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:56032
I20260709 13:21:46.403209 25490 raft_consensus.cc:493] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:46.403671 25490 raft_consensus.cc:3060] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.410177 25490 raft_consensus.cc:515] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:46.411913 25490 leader_election.cc:290] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 2 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:46.412925 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dee54ceb3740cc84018666437f5291" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:46.412948 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dee54ceb3740cc84018666437f5291" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:46.413811 25762 raft_consensus.cc:3060] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.413919 25562 raft_consensus.cc:3055] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:46.414463 25562 raft_consensus.cc:740] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:46.415283 25562 consensus_queue.cc:260] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:46.416345 25562 raft_consensus.cc:3060] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.419643 25762 raft_consensus.cc:2468] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 2.
I20260709 13:21:46.421067 25457 leader_election.cc:304] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:46.421739 25562 raft_consensus.cc:2468] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 2.
I20260709 13:21:46.421922 25818 raft_consensus.cc:2804] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:46.422433 25818 raft_consensus.cc:697] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 2 LEADER]: Becoming Leader. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:46.423365 25818 consensus_queue.cc:237] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:46.430537 25313 catalog_manager.cc:5697] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b reported cstate change: term changed from 1 to 2, leader changed from 1154092fa2c04526a55b392074c58a51 (127.15.242.67) to 8e513729a6434ea782461d121a035e0b (127.15.242.66). New cstate: current_term: 2 leader_uuid: "8e513729a6434ea782461d121a035e0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.515468 25804 raft_consensus.cc:993] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b: : Instructing follower 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:46.515929 25818 raft_consensus.cc:1081] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 2 LEADER]: Signalling peer 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:46.517594 25562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:34838
I20260709 13:21:46.518076 25562 raft_consensus.cc:493] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:46.518342 25562 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:46.524174 25562 raft_consensus.cc:515] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:46.525825 25562 leader_election.cc:290] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 3 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:46.526803 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:46.526945 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:46.527590 25762 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:46.527637 25490 raft_consensus.cc:3055] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:46.528175 25490 raft_consensus.cc:740] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:46.529039 25490 consensus_queue.cc:260] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:46.530375 25490 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:46.535122 25762 raft_consensus.cc:2468] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 3.
I20260709 13:21:46.536501 25531 leader_election.cc:304] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:46.537372 25815 raft_consensus.cc:2804] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:46.537429 25490 raft_consensus.cc:2468] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 3.
I20260709 13:21:46.538059 25815 raft_consensus.cc:697] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 3 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:46.539055 25815 consensus_queue.cc:237] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:46.546250 25313 catalog_manager.cc:5697] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 2 to 3, leader changed from 8e513729a6434ea782461d121a035e0b (127.15.242.66) to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 3 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:46.734625 25362 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:46.770007 25762 raft_consensus.cc:1275] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.771479 25815 consensus_queue.cc:1048] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.789297 25490 raft_consensus.cc:1275] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.790841 25815 consensus_queue.cc:1048] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.835832 25562 raft_consensus.cc:1275] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.837147 25818 consensus_queue.cc:1048] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.842837 25762 raft_consensus.cc:1275] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.844750 25817 consensus_queue.cc:1048] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.930362 25490 raft_consensus.cc:1275] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:46.931749 25833 consensus_queue.cc:1048] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:46.939848 25762 raft_consensus.cc:1275] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:46.941911 25833 consensus_queue.cc:1048] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:47.254815 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:47.265923 25562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
mode: GRACEFUL
new_leader_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:47916
I20260709 13:21:47.266791 25562 raft_consensus.cc:606] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 3 LEADER]: Received request to transfer leadership to TS 8e513729a6434ea782461d121a035e0b
I20260709 13:21:47.269531 25490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81a56844ee7848cfb953b32f3913868e"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
mode: GRACEFUL
new_leader_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:51534
I20260709 13:21:47.270305 25490 raft_consensus.cc:606] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Received request to transfer leadership to TS 1154092fa2c04526a55b392074c58a51
I20260709 13:21:47.273270 25562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
mode: GRACEFUL
new_leader_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:47916
I20260709 13:21:47.273883 25562 raft_consensus.cc:606] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Received request to transfer leadership to TS 8e513729a6434ea782461d121a035e0b
I20260709 13:21:47.275027 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:47.275593 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:47.276171 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:47.359280 25705 raft_consensus.cc:993] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51: : Instructing follower 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:47.359818 25833 raft_consensus.cc:1081] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 3 LEADER]: Signalling peer 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:47.361304 25490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:56032
I20260709 13:21:47.361773 25490 raft_consensus.cc:493] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:47.362124 25490 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:47.370160 25490 raft_consensus.cc:515] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:47.372189 25490 leader_election.cc:290] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 4 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:47.372850 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:47.373193 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:47.373574 25762 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:47.373812 25562 raft_consensus.cc:3055] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:47.374225 25562 raft_consensus.cc:740] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:47.375030 25562 consensus_queue.cc:260] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:47.376178 25562 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:47.382176 25762 raft_consensus.cc:2468] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 4.
I20260709 13:21:47.383370 25457 leader_election.cc:304] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:47.384155 25841 raft_consensus.cc:2804] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:47.384866 25841 raft_consensus.cc:697] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 4 LEADER]: Becoming Leader. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:47.384781 25562 raft_consensus.cc:2468] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 4.
I20260709 13:21:47.385859 25841 consensus_queue.cc:237] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:47.392011 25311 catalog_manager.cc:5697] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b reported cstate change: term changed from 3 to 4, leader changed from 1154092fa2c04526a55b392074c58a51 (127.15.242.67) to 8e513729a6434ea782461d121a035e0b (127.15.242.66). New cstate: current_term: 4 leader_uuid: "8e513729a6434ea782461d121a035e0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:47.543027 25705 raft_consensus.cc:993] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51: : Instructing follower 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:47.543545 25705 raft_consensus.cc:1081] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Signalling peer 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:47.545969 25490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:56032
I20260709 13:21:47.546561 25490 raft_consensus.cc:493] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:47.546849 25490 raft_consensus.cc:3060] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:47.552971 25490 raft_consensus.cc:515] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:47.554888 25490 leader_election.cc:290] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 3 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:47.555768 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:47.555994 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:47.556475 25762 raft_consensus.cc:3060] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:47.556579 25562 raft_consensus.cc:3055] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:47.557026 25562 raft_consensus.cc:740] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:47.557623 25562 consensus_queue.cc:260] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:47.558524 25562 raft_consensus.cc:3060] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:47.562953 25562 raft_consensus.cc:2468] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 3.
I20260709 13:21:47.562953 25762 raft_consensus.cc:2468] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 3.
I20260709 13:21:47.564195 25457 leader_election.cc:304] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, 8e513729a6434ea782461d121a035e0b; no voters: 
I20260709 13:21:47.564868 25841 raft_consensus.cc:2804] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:47.565323 25841 raft_consensus.cc:697] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 3 LEADER]: Becoming Leader. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:47.566116 25841 consensus_queue.cc:237] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:47.573589 25311 catalog_manager.cc:5697] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b reported cstate change: term changed from 2 to 3, leader changed from 1154092fa2c04526a55b392074c58a51 (127.15.242.67) to 8e513729a6434ea782461d121a035e0b (127.15.242.66). New cstate: current_term: 3 leader_uuid: "8e513729a6434ea782461d121a035e0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:47.735632 25362 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:47.759796 25842 raft_consensus.cc:993] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b: : Instructing follower 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:47.760390 25841 raft_consensus.cc:1081] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Signalling peer 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:47.762321 25561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81a56844ee7848cfb953b32f3913868e"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:34838
I20260709 13:21:47.762887 25561 raft_consensus.cc:493] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:47.763361 25561 raft_consensus.cc:3060] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:47.769279 25561 raft_consensus.cc:515] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:47.770998 25561 leader_election.cc:290] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:47.771932 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a56844ee7848cfb953b32f3913868e" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:47.772115 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a56844ee7848cfb953b32f3913868e" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:47.772593 25762 raft_consensus.cc:3060] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:47.772680 25490 raft_consensus.cc:3055] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:47.773051 25490 raft_consensus.cc:740] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:47.773870 25490 consensus_queue.cc:260] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:47.775255 25490 raft_consensus.cc:3060] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:47.779714 25762 raft_consensus.cc:2468] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 2.
I20260709 13:21:47.781263 25531 leader_election.cc:304] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:47.782557 25833 raft_consensus.cc:2804] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:47.783402 25833 raft_consensus.cc:697] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:47.783903 25490 raft_consensus.cc:2468] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 2.
I20260709 13:21:47.785136 25833 consensus_queue.cc:237] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:47.796380 25311 catalog_manager.cc:5697] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 1 to 2, leader changed from 8e513729a6434ea782461d121a035e0b (127.15.242.66) to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:47.849030 25762 raft_consensus.cc:1275] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 4 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:47.850320 25841 consensus_queue.cc:1048] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:47.861012 25561 raft_consensus.cc:1275] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 4 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:47.863168 25842 consensus_queue.cc:1048] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:48.038511 25762 raft_consensus.cc:1275] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:48.039892 25842 consensus_queue.cc:1048] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:48.049903 25561 raft_consensus.cc:1275] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:48.051796 25817 consensus_queue.cc:1048] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:48.270049 25762 raft_consensus.cc:1275] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:48.271351 25705 consensus_queue.cc:1048] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:48.281373 25490 raft_consensus.cc:1275] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:48.283715 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:48.283568 25705 consensus_queue.cc:1048] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:48.298599 25489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
mode: GRACEFUL
new_leader_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:51534
I20260709 13:21:48.299362 25489 raft_consensus.cc:606] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 4 LEADER]: Received request to transfer leadership to TS 1154092fa2c04526a55b392074c58a51
I20260709 13:21:48.304986 25561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
mode: GRACEFUL
new_leader_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:47916
I20260709 13:21:48.305620 25561 raft_consensus.cc:606] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Received request to transfer leadership to TS 8e513729a6434ea782461d121a035e0b
I20260709 13:21:48.309337 25490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
mode: GRACEFUL
new_leader_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:51534
I20260709 13:21:48.309976 25490 raft_consensus.cc:606] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Received request to transfer leadership to TS 1154092fa2c04526a55b392074c58a51
I20260709 13:21:48.311266 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:48.311914 25817 raft_consensus.cc:993] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b: : Instructing follower 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:48.311910 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:48.312611 25817 raft_consensus.cc:1081] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Signalling peer 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:48.312981 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:48.314339 25561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:34838
I20260709 13:21:48.314966 25561 raft_consensus.cc:493] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:48.315295 25561 raft_consensus.cc:3060] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.321141 25561 raft_consensus.cc:515] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:48.323231 25561 leader_election.cc:290] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:48.324296 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:48.325081 25762 raft_consensus.cc:3060] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.324965 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:48.325914 25490 raft_consensus.cc:3055] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:48.326309 25490 raft_consensus.cc:740] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:48.327180 25490 consensus_queue.cc:260] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:48.328274 25490 raft_consensus.cc:3060] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.330510 25762 raft_consensus.cc:2468] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 2.
I20260709 13:21:48.331213 25761 raft_consensus.cc:1240] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Rejecting Update request from peer 8e513729a6434ea782461d121a035e0b for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:48.331707 25531 leader_election.cc:304] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:48.332819 25855 raft_consensus.cc:2804] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:48.333351 25855 raft_consensus.cc:697] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:48.334368 25855 consensus_queue.cc:237] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:48.335013 25490 raft_consensus.cc:2468] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 2.
I20260709 13:21:48.341748 25313 catalog_manager.cc:5697] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 1 to 2, leader changed from 8e513729a6434ea782461d121a035e0b (127.15.242.66) to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:48.355566 25841 raft_consensus.cc:993] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b: : Instructing follower 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:48.356069 25817 raft_consensus.cc:1081] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 4 LEADER]: Signalling peer 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:48.357661 25561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:34838
I20260709 13:21:48.358245 25561 raft_consensus.cc:493] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:48.358706 25561 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:48.364068 25561 raft_consensus.cc:515] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:48.365933 25561 leader_election.cc:290] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 5 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:48.366931 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:48.367208 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b251600b0c341c4911c9a9621879f87" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:48.367691 25761 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:48.367867 25490 raft_consensus.cc:3055] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:21:48.368523 25490 raft_consensus.cc:740] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:48.369448 25490 consensus_queue.cc:260] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:48.370728 25490 raft_consensus.cc:3060] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:48.374351 25761 raft_consensus.cc:2468] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 5.
I20260709 13:21:48.375667 25531 leader_election.cc:304] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:48.376530 25855 raft_consensus.cc:2804] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:21:48.376964 25855 raft_consensus.cc:697] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 5 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:48.377194 25490 raft_consensus.cc:2468] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 5.
I20260709 13:21:48.377728 25855 consensus_queue.cc:237] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:48.386210 25313 catalog_manager.cc:5697] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 4 to 5, leader changed from 8e513729a6434ea782461d121a035e0b (127.15.242.66) to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 5 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:48.525198 25833 raft_consensus.cc:993] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51: : Instructing follower 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:48.525874 25855 raft_consensus.cc:1081] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Signalling peer 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:48.528417 25490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:56032
I20260709 13:21:48.528986 25490 raft_consensus.cc:493] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:48.529320 25490 raft_consensus.cc:3060] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.534458 25490 raft_consensus.cc:515] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:48.536150 25490 leader_election.cc:290] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 3 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:48.537060 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:48.537330 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caba5eac714345ba2babf42a20afa2" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:48.537797 25761 raft_consensus.cc:3060] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.537930 25561 raft_consensus.cc:3055] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:48.538410 25561 raft_consensus.cc:740] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:48.539445 25561 consensus_queue.cc:260] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:48.540917 25561 raft_consensus.cc:3060] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.546772 25761 raft_consensus.cc:2468] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 3.
I20260709 13:21:48.548249 25457 leader_election.cc:304] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:48.549023 25561 raft_consensus.cc:2468] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 3.
I20260709 13:21:48.549360 25817 raft_consensus.cc:2804] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:48.550149 25817 raft_consensus.cc:697] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 3 LEADER]: Becoming Leader. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:48.551092 25817 consensus_queue.cc:237] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:48.558668 25313 catalog_manager.cc:5697] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b reported cstate change: term changed from 2 to 3, leader changed from 1154092fa2c04526a55b392074c58a51 (127.15.242.67) to 8e513729a6434ea782461d121a035e0b (127.15.242.66). New cstate: current_term: 3 leader_uuid: "8e513729a6434ea782461d121a035e0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:48.736552 25362 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:48.837308 25762 raft_consensus.cc:1275] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 5 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:21:48.838769 25855 consensus_queue.cc:1048] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:21:48.852936 25489 raft_consensus.cc:1275] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 5 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:21:48.855526 25855 consensus_queue.cc:1048] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:21:48.923779 25762 raft_consensus.cc:1275] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:48.925168 25855 consensus_queue.cc:1048] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:48.936026 25489 raft_consensus.cc:1275] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:48.937747 25833 consensus_queue.cc:1048] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:49.160717 25561 raft_consensus.cc:1275] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:49.162173 25817 consensus_queue.cc:1048] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:49.175339 25762 raft_consensus.cc:1275] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:49.177196 25873 consensus_queue.cc:1048] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:49.320588 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:49.328810 25561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
mode: GRACEFUL
new_leader_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:47916
I20260709 13:21:49.329434 25561 raft_consensus.cc:606] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Received request to transfer leadership to TS 8e513729a6434ea782461d121a035e0b
I20260709 13:21:49.332086 25561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
mode: GRACEFUL
new_leader_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:47916
I20260709 13:21:49.332568 25561 raft_consensus.cc:606] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Received request to transfer leadership to TS 8e513729a6434ea782461d121a035e0b
I20260709 13:21:49.335143 25489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
mode: GRACEFUL
new_leader_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:51534
I20260709 13:21:49.335664 25489 raft_consensus.cc:606] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 3 LEADER]: Received request to transfer leadership to TS 1154092fa2c04526a55b392074c58a51
I20260709 13:21:49.336902 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:49.337459 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:49.338140 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:49.434657 25866 raft_consensus.cc:993] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51: : Instructing follower 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:49.435189 25833 raft_consensus.cc:1081] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Signalling peer 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:49.436691 25489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:56032
I20260709 13:21:49.437090 25489 raft_consensus.cc:493] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:49.437315 25489 raft_consensus.cc:3060] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:49.442112 25489 raft_consensus.cc:515] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:49.443634 25489 leader_election.cc:290] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 3 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:49.444499 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:49.444707 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee289b8af0f41ffb1bdfa3cf42fc743" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:49.445082 25762 raft_consensus.cc:3060] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:49.445361 25561 raft_consensus.cc:3055] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:49.445688 25561 raft_consensus.cc:740] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:49.446502 25561 consensus_queue.cc:260] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:49.447500 25561 raft_consensus.cc:3060] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:49.449999 25762 raft_consensus.cc:2468] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 3.
I20260709 13:21:49.451227 25457 leader_election.cc:304] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:49.451891 25873 raft_consensus.cc:2804] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:49.452376 25873 raft_consensus.cc:697] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 3 LEADER]: Becoming Leader. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:49.452466 25561 raft_consensus.cc:2468] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 3.
I20260709 13:21:49.453226 25873 consensus_queue.cc:237] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:49.460661 25311 catalog_manager.cc:5697] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b reported cstate change: term changed from 2 to 3, leader changed from 1154092fa2c04526a55b392074c58a51 (127.15.242.67) to 8e513729a6434ea782461d121a035e0b (127.15.242.66). New cstate: current_term: 3 leader_uuid: "8e513729a6434ea782461d121a035e0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.530303 25866 raft_consensus.cc:993] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51: : Instructing follower 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:49.530786 25833 raft_consensus.cc:1081] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Signalling peer 8e513729a6434ea782461d121a035e0b to start an election
I20260709 13:21:49.532655 25489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6"
dest_uuid: "8e513729a6434ea782461d121a035e0b"
 from {username='slave'} at 127.0.0.1:56032
I20260709 13:21:49.533207 25489 raft_consensus.cc:493] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:49.533565 25489 raft_consensus.cc:3060] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:49.538771 25489 raft_consensus.cc:515] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:49.540503 25489 leader_election.cc:290] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 3 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 1154092fa2c04526a55b392074c58a51 (127.15.242.67:45617)
I20260709 13:21:49.541364 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:49.541540 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb70474b2f243e5b038f3203af329d6" candidate_uuid: "8e513729a6434ea782461d121a035e0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1154092fa2c04526a55b392074c58a51"
I20260709 13:21:49.542093 25762 raft_consensus.cc:3060] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:49.542198 25561 raft_consensus.cc:3055] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:49.542646 25561 raft_consensus.cc:740] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:49.543443 25561 consensus_queue.cc:260] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:49.544441 25561 raft_consensus.cc:3060] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:49.547108 25762 raft_consensus.cc:2468] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 3.
I20260709 13:21:49.548264 25457 leader_election.cc:304] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e513729a6434ea782461d121a035e0b, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:49.548940 25873 raft_consensus.cc:2804] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:49.549470 25873 raft_consensus.cc:697] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 3 LEADER]: Becoming Leader. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:49.550102 25561 raft_consensus.cc:2468] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e513729a6434ea782461d121a035e0b in term 3.
I20260709 13:21:49.550405 25873 consensus_queue.cc:237] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:49.559089 25311 catalog_manager.cc:5697] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b reported cstate change: term changed from 2 to 3, leader changed from 1154092fa2c04526a55b392074c58a51 (127.15.242.67) to 8e513729a6434ea782461d121a035e0b (127.15.242.66). New cstate: current_term: 3 leader_uuid: "8e513729a6434ea782461d121a035e0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.704872 25872 raft_consensus.cc:993] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b: : Instructing follower 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:49.705379 25817 raft_consensus.cc:1081] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 3 LEADER]: Signalling peer 1154092fa2c04526a55b392074c58a51 to start an election
I20260709 13:21:49.707103 25561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e"
dest_uuid: "1154092fa2c04526a55b392074c58a51"
 from {username='slave'} at 127.0.0.1:34838
I20260709 13:21:49.707621 25561 raft_consensus.cc:493] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:49.707994 25561 raft_consensus.cc:3060] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:49.712910 25561 raft_consensus.cc:515] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:49.714689 25561 leader_election.cc:290] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 4 election: Requested vote from peers d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161), 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197)
I20260709 13:21:49.715449 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d0fadd57a0a64a98854b63eb61761a8e"
I20260709 13:21:49.716112 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebd3633bdd24bec89f1d2ec9673a05e" candidate_uuid: "1154092fa2c04526a55b392074c58a51" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8e513729a6434ea782461d121a035e0b"
I20260709 13:21:49.716135 25762 raft_consensus.cc:3060] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:49.716702 25489 raft_consensus.cc:3055] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:49.717046 25489 raft_consensus.cc:740] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e513729a6434ea782461d121a035e0b, State: Running, Role: LEADER
I20260709 13:21:49.717844 25489 consensus_queue.cc:260] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:49.719188 25489 raft_consensus.cc:3060] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:49.723940 25762 raft_consensus.cc:2468] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 4.
I20260709 13:21:49.725277 25531 leader_election.cc:304] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1154092fa2c04526a55b392074c58a51, d0fadd57a0a64a98854b63eb61761a8e; no voters: 
I20260709 13:21:49.726145 25833 raft_consensus.cc:2804] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:49.726346 25489 raft_consensus.cc:2468] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1154092fa2c04526a55b392074c58a51 in term 4.
I20260709 13:21:49.726691 25833 raft_consensus.cc:697] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 4 LEADER]: Becoming Leader. State: Replica: 1154092fa2c04526a55b392074c58a51, State: Running, Role: LEADER
I20260709 13:21:49.727849 25833 consensus_queue.cc:237] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } }
I20260709 13:21:49.736483 25311 catalog_manager.cc:5697] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 reported cstate change: term changed from 3 to 4, leader changed from 8e513729a6434ea782461d121a035e0b (127.15.242.66) to 1154092fa2c04526a55b392074c58a51 (127.15.242.67). New cstate: current_term: 4 leader_uuid: "1154092fa2c04526a55b392074c58a51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:49.737526 25362 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:50.013284 25762 raft_consensus.cc:1275] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:50.013617 25761 raft_consensus.cc:1275] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:50.014592 25872 consensus_queue.cc:1048] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:50.014951 25817 consensus_queue.cc:1048] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:50.034497 25561 raft_consensus.cc:1275] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:50.035754 25562 raft_consensus.cc:1275] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Refusing update from remote peer 8e513729a6434ea782461d121a035e0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:50.035969 25872 consensus_queue.cc:1048] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:50.037508 25872 consensus_queue.cc:1048] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1154092fa2c04526a55b392074c58a51" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:50.284458 25489 raft_consensus.cc:1275] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 4 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:50.285768 25866 consensus_queue.cc:1048] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e513729a6434ea782461d121a035e0b" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:50.296031 25761 raft_consensus.cc:1275] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 4 FOLLOWER]: Refusing update from remote peer 1154092fa2c04526a55b392074c58a51: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:50.298604 25833 consensus_queue.cc:1048] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fadd57a0a64a98854b63eb61761a8e" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:50.346114 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:50.375155 16329 tablet_server.cc:179] TabletServer@127.15.242.65:45161 shutting down...
W20260709 13:21:50.384088 25457 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 87 similar messages]
W20260709 13:21:50.388037 25457 consensus_peers.cc:597] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.400239 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:50.401160 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.401830 16329 raft_consensus.cc:2243] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.402314 16329 raft_consensus.cc:2272] T beabeec6c779444c9747beb9fa8afaa1 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.404299 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.404832 16329 raft_consensus.cc:2243] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.405221 16329 raft_consensus.cc:2272] T cebd3633bdd24bec89f1d2ec9673a05e P d0fadd57a0a64a98854b63eb61761a8e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.407666 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.408190 16329 raft_consensus.cc:2243] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.408604 16329 raft_consensus.cc:2272] T 1b251600b0c341c4911c9a9621879f87 P d0fadd57a0a64a98854b63eb61761a8e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.410377 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.410851 16329 raft_consensus.cc:2243] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.411211 16329 raft_consensus.cc:2272] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.413393 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.413995 16329 raft_consensus.cc:2243] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.414507 16329 raft_consensus.cc:2272] T 22caba5eac714345ba2babf42a20afa2 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.416301 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.416854 16329 raft_consensus.cc:2243] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.417289 16329 raft_consensus.cc:2272] T 4eb70474b2f243e5b038f3203af329d6 P d0fadd57a0a64a98854b63eb61761a8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.419705 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.420272 16329 raft_consensus.cc:2243] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.420710 16329 raft_consensus.cc:2272] T 5fd06cc431b74b61931554e409abfe77 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.422725 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.423280 16329 raft_consensus.cc:2243] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.423705 16329 raft_consensus.cc:2272] T 62dee54ceb3740cc84018666437f5291 P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.425642 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.426205 16329 raft_consensus.cc:2243] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.426625 16329 raft_consensus.cc:2272] T 4026ade6660a484b9592984bfac572d6 P d0fadd57a0a64a98854b63eb61761a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.428408 16329 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.428882 16329 raft_consensus.cc:2243] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.429294 16329 raft_consensus.cc:2272] T 81a56844ee7848cfb953b32f3913868e P d0fadd57a0a64a98854b63eb61761a8e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.451038 25457 consensus_peers.cc:597] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.460175 16329 tablet_server.cc:196] TabletServer@127.15.242.65:45161 shutdown complete.
W20260709 13:21:50.467118 25531 consensus_peers.cc:597] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.482374 16329 tablet_server.cc:179] TabletServer@127.15.242.66:0 shutting down...
W20260709 13:21:50.496529 25531 consensus_peers.cc:597] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.519146 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:50.520027 16329 tablet_replica.cc:333] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b: stopping tablet replica
I20260709 13:21:50.520912 16329 raft_consensus.cc:2243] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.521816 16329 raft_consensus.cc:2272] T 5fd06cc431b74b61931554e409abfe77 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.524199 16329 tablet_replica.cc:333] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b: stopping tablet replica
I20260709 13:21:50.524807 16329 raft_consensus.cc:2243] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.525570 16329 raft_consensus.cc:2272] T 4eb70474b2f243e5b038f3203af329d6 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.528527 16329 tablet_replica.cc:333] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b: stopping tablet replica
I20260709 13:21:50.529313 16329 raft_consensus.cc:2243] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.529790 16329 raft_consensus.cc:2272] T beabeec6c779444c9747beb9fa8afaa1 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.532032 16329 tablet_replica.cc:333] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b: stopping tablet replica
I20260709 13:21:50.532653 16329 raft_consensus.cc:2243] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.533494 16329 raft_consensus.cc:2272] T 22caba5eac714345ba2babf42a20afa2 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.536015 16329 tablet_replica.cc:333] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b: stopping tablet replica
I20260709 13:21:50.536568 16329 raft_consensus.cc:2243] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.536981 16329 raft_consensus.cc:2272] T 1b251600b0c341c4911c9a9621879f87 P 8e513729a6434ea782461d121a035e0b [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.538769 25531 consensus_peers.cc:597] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 -> Peer d0fadd57a0a64a98854b63eb61761a8e (127.15.242.65:45161): Couldn't send request to peer d0fadd57a0a64a98854b63eb61761a8e. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:45161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.539399 16329 tablet_replica.cc:333] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b: stopping tablet replica
I20260709 13:21:50.540248 16329 raft_consensus.cc:2243] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.541221 16329 raft_consensus.cc:2272] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 8e513729a6434ea782461d121a035e0b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.544394 16329 tablet_replica.cc:333] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b: stopping tablet replica
I20260709 13:21:50.545071 16329 raft_consensus.cc:2243] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.545940 16329 raft_consensus.cc:2272] T 62dee54ceb3740cc84018666437f5291 P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.548452 16329 tablet_replica.cc:333] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b: stopping tablet replica
I20260709 13:21:50.549041 16329 raft_consensus.cc:2243] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.549463 16329 raft_consensus.cc:2272] T cebd3633bdd24bec89f1d2ec9673a05e P 8e513729a6434ea782461d121a035e0b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.552512 16329 tablet_replica.cc:333] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b: stopping tablet replica
I20260709 13:21:50.553083 16329 raft_consensus.cc:2243] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.553503 16329 raft_consensus.cc:2272] T 81a56844ee7848cfb953b32f3913868e P 8e513729a6434ea782461d121a035e0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.555698 16329 tablet_replica.cc:333] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b: stopping tablet replica
I20260709 13:21:50.556151 16329 raft_consensus.cc:2243] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.556579 16329 raft_consensus.cc:2272] T 4026ade6660a484b9592984bfac572d6 P 8e513729a6434ea782461d121a035e0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.591449 16329 tablet_server.cc:196] TabletServer@127.15.242.66:0 shutdown complete.
I20260709 13:21:50.617764 16329 tablet_server.cc:179] TabletServer@127.15.242.67:0 shutting down...
I20260709 13:21:50.649487 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:50.650377 16329 tablet_replica.cc:333] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51: stopping tablet replica
I20260709 13:21:50.651075 16329 raft_consensus.cc:2243] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.651925 16329 raft_consensus.cc:2272] T cebd3633bdd24bec89f1d2ec9673a05e P 1154092fa2c04526a55b392074c58a51 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.655344 16329 tablet_replica.cc:333] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51: stopping tablet replica
I20260709 13:21:50.656347 16329 raft_consensus.cc:2243] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.657593 16329 raft_consensus.cc:2272] T 4026ade6660a484b9592984bfac572d6 P 1154092fa2c04526a55b392074c58a51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.660756 16329 tablet_replica.cc:333] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51: stopping tablet replica
I20260709 13:21:50.661351 16329 raft_consensus.cc:2243] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.662497 16329 raft_consensus.cc:2272] T 81a56844ee7848cfb953b32f3913868e P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.665148 16329 tablet_replica.cc:333] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51: stopping tablet replica
I20260709 13:21:50.665867 16329 raft_consensus.cc:2243] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:50.666400 25528 consensus_peers.cc:597] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 -> Peer 8e513729a6434ea782461d121a035e0b (127.15.242.66:46197): Couldn't send request to peer 8e513729a6434ea782461d121a035e0b. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:46197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.666419 16329 raft_consensus.cc:2272] T 22caba5eac714345ba2babf42a20afa2 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.668936 16329 tablet_replica.cc:333] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51: stopping tablet replica
I20260709 13:21:50.669572 16329 raft_consensus.cc:2243] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.670481 16329 raft_consensus.cc:2272] T beabeec6c779444c9747beb9fa8afaa1 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.672835 16329 tablet_replica.cc:333] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51: stopping tablet replica
I20260709 13:21:50.673520 16329 raft_consensus.cc:2243] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.673990 16329 raft_consensus.cc:2272] T 62dee54ceb3740cc84018666437f5291 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.676198 16329 tablet_replica.cc:333] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51: stopping tablet replica
I20260709 13:21:50.676795 16329 raft_consensus.cc:2243] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.677731 16329 raft_consensus.cc:2272] T 5fd06cc431b74b61931554e409abfe77 P 1154092fa2c04526a55b392074c58a51 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.680200 16329 tablet_replica.cc:333] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51: stopping tablet replica
I20260709 13:21:50.680831 16329 raft_consensus.cc:2243] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.681299 16329 raft_consensus.cc:2272] T 4eb70474b2f243e5b038f3203af329d6 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.684801 16329 tablet_replica.cc:333] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51: stopping tablet replica
I20260709 13:21:50.685565 16329 raft_consensus.cc:2243] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.686430 16329 raft_consensus.cc:2272] T 1b251600b0c341c4911c9a9621879f87 P 1154092fa2c04526a55b392074c58a51 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.688441 16329 tablet_replica.cc:333] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51: stopping tablet replica
I20260709 13:21:50.689013 16329 raft_consensus.cc:2243] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.689486 16329 raft_consensus.cc:2272] T 8ee289b8af0f41ffb1bdfa3cf42fc743 P 1154092fa2c04526a55b392074c58a51 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.724777 16329 tablet_server.cc:196] TabletServer@127.15.242.67:0 shutdown complete.
W20260709 13:21:50.738857 25362 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:50.752380 16329 master.cc:562] Master@127.15.242.126:39199 shutting down...
I20260709 13:21:50.783741 16329 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.784309 16329 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.784641 16329 tablet_replica.cc:333] T 00000000000000000000000000000000 P a2f114307adc44a79430127f52cdb54d: stopping tablet replica
I20260709 13:21:50.806874 16329 master.cc:584] Master@127.15.242.126:39199 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13291 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:21:50.858573 16329 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.242.126:42931
I20260709 13:21:50.859859 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:50.866006 25901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:50.867401 25902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:50.868096 25904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:50.868783 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:50.869748 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:50.869925 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:50.870103 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603310870079 us; error 0 us; skew 500 ppm
I20260709 13:21:50.870590 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:50.873240 16329 webserver.cc:533] Webserver started at http://127.15.242.126:39459/ using document root <none> and password file <none>
I20260709 13:21:50.873787 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:50.873962 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:50.874308 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:50.875528 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/master-0-root/instance:
uuid: "64a4e314b82c40cb9df4f9afe2fc83f7"
format_stamp: "Formatted at 2026-07-09 13:21:50 on dist-test-slave-fh5z"
I20260709 13:21:50.881762 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:50.886703 25909 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:50.887912 16329 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:21:50.888322 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/master-0-root
uuid: "64a4e314b82c40cb9df4f9afe2fc83f7"
format_stamp: "Formatted at 2026-07-09 13:21:50 on dist-test-slave-fh5z"
I20260709 13:21:50.888685 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:50.926858 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:50.928117 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:50.973457 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.126:42931
I20260709 13:21:50.973601 25960 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.126:42931 every 8 connection(s)
I20260709 13:21:50.977557 25961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.989061 25961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7: Bootstrap starting.
I20260709 13:21:50.994194 25961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.998471 25961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7: No bootstrap required, opened a new log
I20260709 13:21:51.001708 25961 raft_consensus.cc:359] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a4e314b82c40cb9df4f9afe2fc83f7" member_type: VOTER }
I20260709 13:21:51.002377 25961 raft_consensus.cc:385] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.002725 25961 raft_consensus.cc:740] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a4e314b82c40cb9df4f9afe2fc83f7, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.003607 25961 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a4e314b82c40cb9df4f9afe2fc83f7" member_type: VOTER }
I20260709 13:21:51.004366 25961 raft_consensus.cc:399] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:51.004716 25961 raft_consensus.cc:493] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:51.005120 25961 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.010756 25961 raft_consensus.cc:515] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a4e314b82c40cb9df4f9afe2fc83f7" member_type: VOTER }
I20260709 13:21:51.011358 25961 leader_election.cc:304] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64a4e314b82c40cb9df4f9afe2fc83f7; no voters: 
I20260709 13:21:51.012563 25961 leader_election.cc:290] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:51.012907 25964 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.014346 25964 raft_consensus.cc:697] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [term 1 LEADER]: Becoming Leader. State: Replica: 64a4e314b82c40cb9df4f9afe2fc83f7, State: Running, Role: LEADER
I20260709 13:21:51.015018 25964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a4e314b82c40cb9df4f9afe2fc83f7" member_type: VOTER }
I20260709 13:21:51.015789 25961 sys_catalog.cc:565] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:51.020392 25966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64a4e314b82c40cb9df4f9afe2fc83f7. Latest consensus state: current_term: 1 leader_uuid: "64a4e314b82c40cb9df4f9afe2fc83f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a4e314b82c40cb9df4f9afe2fc83f7" member_type: VOTER } }
I20260709 13:21:51.022192 25966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:51.020434 25965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64a4e314b82c40cb9df4f9afe2fc83f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a4e314b82c40cb9df4f9afe2fc83f7" member_type: VOTER } }
I20260709 13:21:51.023008 25965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:51.024340 25970 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:51.031059 25970 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:51.033905 16329 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:51.041769 25970 catalog_manager.cc:1383] Generated new cluster ID: 525db44e22f64936b0f6fc8d77a58961
I20260709 13:21:51.042172 25970 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:51.058102 25970 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:51.059612 25970 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:51.073607 25970 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7: Generated new TSK 0
I20260709 13:21:51.074294 25970 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:51.100816 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:51.107195 25982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:51.108393 25983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:51.110870 16329 server_base.cc:1061] running on GCE node
W20260709 13:21:51.110954 25985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:51.112358 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:51.112604 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:51.112756 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603311112744 us; error 0 us; skew 500 ppm
I20260709 13:21:51.113317 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:51.115732 16329 webserver.cc:533] Webserver started at http://127.15.242.65:44165/ using document root <none> and password file <none>
I20260709 13:21:51.116235 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:51.116417 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:51.116725 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:51.118103 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-0-root/instance:
uuid: "c09671213ca842139f01292e0bd8c1df"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-fh5z"
I20260709 13:21:51.123245 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:21:51.126794 25990 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.127985 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:21:51.128394 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-0-root
uuid: "c09671213ca842139f01292e0bd8c1df"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-fh5z"
I20260709 13:21:51.128823 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:51.141258 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:51.142556 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:51.144093 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:51.146337 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:51.146514 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.146791 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:51.146991 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.192912 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.65:39105
I20260709 13:21:51.193032 26052 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.65:39105 every 8 connection(s)
I20260709 13:21:51.199276 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:51.207155 26057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:51.208854 26058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:51.211902 26060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:51.212090 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:51.213713 26053 heartbeater.cc:344] Connected to a master server at 127.15.242.126:42931
I20260709 13:21:51.213781 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:51.214344 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:51.214398 26053 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:51.214560 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603311214542 us; error 0 us; skew 500 ppm
I20260709 13:21:51.215467 26053 heartbeater.cc:507] Master 127.15.242.126:42931 requested a full tablet report, sending...
I20260709 13:21:51.215467 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:51.218127 25926 ts_manager.cc:194] Registered new tserver with Master: c09671213ca842139f01292e0bd8c1df (127.15.242.65:39105)
I20260709 13:21:51.219255 16329 webserver.cc:533] Webserver started at http://127.15.242.66:34629/ using document root <none> and password file <none>
I20260709 13:21:51.220000 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:51.220240 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:51.220551 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:51.220911 25926 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40520
I20260709 13:21:51.222064 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-1-root/instance:
uuid: "1f09efc278ba4360b99f3c01eb60fd18"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-fh5z"
I20260709 13:21:51.227284 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:21:51.231364 26065 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.232334 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:21:51.232611 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-1-root
uuid: "1f09efc278ba4360b99f3c01eb60fd18"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-fh5z"
I20260709 13:21:51.232856 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:51.248631 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:51.249884 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:51.251710 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:51.254253 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:51.254490 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.254781 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:51.254935 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.299299 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.66:40253
I20260709 13:21:51.299484 26127 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.66:40253 every 8 connection(s)
I20260709 13:21:51.304308 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:51.312014 26131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:51.313882 26132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:51.317466 26134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:51.318892 26128 heartbeater.cc:344] Connected to a master server at 127.15.242.126:42931
I20260709 13:21:51.319648 26128 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:51.321152 26128 heartbeater.cc:507] Master 127.15.242.126:42931 requested a full tablet report, sending...
I20260709 13:21:51.322415 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:51.323424 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:21:51.323354 25926 ts_manager.cc:194] Registered new tserver with Master: 1f09efc278ba4360b99f3c01eb60fd18 (127.15.242.66:40253)
W20260709 13:21:51.323808 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:51.324062 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603311324038 us; error 0 us; skew 500 ppm
I20260709 13:21:51.324724 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:51.325368 25926 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40528
I20260709 13:21:51.327589 16329 webserver.cc:533] Webserver started at http://127.15.242.67:39381/ using document root <none> and password file <none>
I20260709 13:21:51.328172 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:51.328414 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:51.328675 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:51.329843 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-2-root/instance:
uuid: "66b412913fbd494ba3658aa399d58289"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-fh5z"
I20260709 13:21:51.334805 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:21:51.338539 26139 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.339478 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:21:51.339838 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-2-root
uuid: "66b412913fbd494ba3658aa399d58289"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-fh5z"
I20260709 13:21:51.340171 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603035614178-16329-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:51.350203 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:51.351426 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:51.352934 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:51.355449 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:51.355736 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.356010 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:51.356211 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.402189 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.67:36309
I20260709 13:21:51.402372 26201 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.67:36309 every 8 connection(s)
I20260709 13:21:51.417128 26202 heartbeater.cc:344] Connected to a master server at 127.15.242.126:42931
I20260709 13:21:51.417644 26202 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:51.418370 26202 heartbeater.cc:507] Master 127.15.242.126:42931 requested a full tablet report, sending...
I20260709 13:21:51.420398 25926 ts_manager.cc:194] Registered new tserver with Master: 66b412913fbd494ba3658aa399d58289 (127.15.242.67:36309)
I20260709 13:21:51.420549 16329 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015138646s
I20260709 13:21:51.421959 25926 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40532
I20260709 13:21:51.448611 25926 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40540:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:51.450975 25926 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:51.512287 26167 tablet_service.cc:1511] Processing CreateTablet for tablet 42cb141dbbbf466ab6008861828e5e37 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fd41de15294d4da8ad279d2a19790472]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:51.512903 26166 tablet_service.cc:1511] Processing CreateTablet for tablet cf8065eb99c343cc9a0569e62ac77ad3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fd41de15294d4da8ad279d2a19790472]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:51.515528 26018 tablet_service.cc:1511] Processing CreateTablet for tablet 42cb141dbbbf466ab6008861828e5e37 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fd41de15294d4da8ad279d2a19790472]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:51.515630 26093 tablet_service.cc:1511] Processing CreateTablet for tablet 42cb141dbbbf466ab6008861828e5e37 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fd41de15294d4da8ad279d2a19790472]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:51.516029 26017 tablet_service.cc:1511] Processing CreateTablet for tablet cf8065eb99c343cc9a0569e62ac77ad3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fd41de15294d4da8ad279d2a19790472]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:51.516151 26092 tablet_service.cc:1511] Processing CreateTablet for tablet cf8065eb99c343cc9a0569e62ac77ad3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fd41de15294d4da8ad279d2a19790472]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:51.517204 26093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42cb141dbbbf466ab6008861828e5e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.517161 26018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42cb141dbbbf466ab6008861828e5e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.513908 26167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42cb141dbbbf466ab6008861828e5e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.518543 26092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8065eb99c343cc9a0569e62ac77ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.521145 26166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8065eb99c343cc9a0569e62ac77ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.524422 26017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8065eb99c343cc9a0569e62ac77ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.546404 26218 tablet_bootstrap.cc:492] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df: Bootstrap starting.
I20260709 13:21:51.551766 26217 tablet_bootstrap.cc:492] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18: Bootstrap starting.
I20260709 13:21:51.555908 26218 tablet_bootstrap.cc:654] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.570233 26218 tablet_bootstrap.cc:492] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df: No bootstrap required, opened a new log
I20260709 13:21:51.570895 26218 ts_tablet_manager.cc:1403] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.003s
I20260709 13:21:51.571221 26217 tablet_bootstrap.cc:654] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.573284 26220 tablet_bootstrap.cc:492] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289: Bootstrap starting.
I20260709 13:21:51.574383 26218 raft_consensus.cc:359] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } }
I20260709 13:21:51.575202 26218 raft_consensus.cc:385] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.575829 26218 raft_consensus.cc:740] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c09671213ca842139f01292e0bd8c1df, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.577101 26218 consensus_queue.cc:260] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } }
I20260709 13:21:51.579012 26217 tablet_bootstrap.cc:492] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18: No bootstrap required, opened a new log
I20260709 13:21:51.579473 26053 heartbeater.cc:499] Master 127.15.242.126:42931 was elected leader, sending a full tablet report...
I20260709 13:21:51.579675 26217 ts_tablet_manager.cc:1403] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.005s
I20260709 13:21:51.579880 26218 ts_tablet_manager.cc:1434] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.006s
I20260709 13:21:51.580789 26218 tablet_bootstrap.cc:492] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df: Bootstrap starting.
I20260709 13:21:51.583078 26217 raft_consensus.cc:359] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.583897 26217 raft_consensus.cc:385] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.584211 26217 raft_consensus.cc:740] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f09efc278ba4360b99f3c01eb60fd18, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.584980 26217 consensus_queue.cc:260] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.585538 26220 tablet_bootstrap.cc:654] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.588462 26218 tablet_bootstrap.cc:654] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.594177 26217 ts_tablet_manager.cc:1434] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.009s
I20260709 13:21:51.594473 26128 heartbeater.cc:499] Master 127.15.242.126:42931 was elected leader, sending a full tablet report...
I20260709 13:21:51.595431 26217 tablet_bootstrap.cc:492] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18: Bootstrap starting.
I20260709 13:21:51.601444 26222 raft_consensus.cc:493] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.602376 26218 tablet_bootstrap.cc:492] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df: No bootstrap required, opened a new log
I20260709 13:21:51.603251 26218 ts_tablet_manager.cc:1403] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.005s
I20260709 13:21:51.602190 26222 raft_consensus.cc:515] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } }
I20260709 13:21:51.605827 26222 leader_election.cc:290] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66b412913fbd494ba3658aa399d58289 (127.15.242.67:36309), 1f09efc278ba4360b99f3c01eb60fd18 (127.15.242.66:40253)
I20260709 13:21:51.607342 26217 tablet_bootstrap.cc:654] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.607080 26218 raft_consensus.cc:359] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.608035 26218 raft_consensus.cc:385] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.608035 26220 tablet_bootstrap.cc:492] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289: No bootstrap required, opened a new log
I20260709 13:21:51.608575 26218 raft_consensus.cc:740] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c09671213ca842139f01292e0bd8c1df, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.608918 26220 ts_tablet_manager.cc:1403] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.006s
I20260709 13:21:51.609526 26218 consensus_queue.cc:260] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.612102 26218 ts_tablet_manager.cc:1434] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:21:51.614444 26220 raft_consensus.cc:359] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.615293 26220 raft_consensus.cc:385] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.615610 26217 tablet_bootstrap.cc:492] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18: No bootstrap required, opened a new log
I20260709 13:21:51.615651 26220 raft_consensus.cc:740] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66b412913fbd494ba3658aa399d58289, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.616343 26217 ts_tablet_manager.cc:1403] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 13:21:51.616734 26220 consensus_queue.cc:260] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.620193 26217 raft_consensus.cc:359] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } }
I20260709 13:21:51.621306 26217 raft_consensus.cc:385] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.621742 26217 raft_consensus.cc:740] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f09efc278ba4360b99f3c01eb60fd18, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.622823 26217 consensus_queue.cc:260] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } }
I20260709 13:21:51.626282 26217 ts_tablet_manager.cc:1434] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:21:51.631444 26202 heartbeater.cc:499] Master 127.15.242.126:42931 was elected leader, sending a full tablet report...
I20260709 13:21:51.631213 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cb141dbbbf466ab6008861828e5e37" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b412913fbd494ba3658aa399d58289" is_pre_election: true
W20260709 13:21:51.633181 25993 leader_election.cc:343] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66b412913fbd494ba3658aa399d58289 (127.15.242.67:36309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.632091 26220 ts_tablet_manager.cc:1434] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.012s
I20260709 13:21:51.635430 26220 tablet_bootstrap.cc:492] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289: Bootstrap starting.
I20260709 13:21:51.640522 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cb141dbbbf466ab6008861828e5e37" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f09efc278ba4360b99f3c01eb60fd18" is_pre_election: true
I20260709 13:21:51.641450 26103 raft_consensus.cc:2468] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 0.
I20260709 13:21:51.643253 25993 leader_election.cc:304] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f09efc278ba4360b99f3c01eb60fd18, c09671213ca842139f01292e0bd8c1df; no voters: 66b412913fbd494ba3658aa399d58289
I20260709 13:21:51.644454 26222 raft_consensus.cc:2804] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.644815 26222 raft_consensus.cc:493] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.645148 26222 raft_consensus.cc:3060] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.645440 26220 tablet_bootstrap.cc:654] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.651163 26220 tablet_bootstrap.cc:492] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289: No bootstrap required, opened a new log
I20260709 13:21:51.651643 26220 ts_tablet_manager.cc:1403] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:21:51.651605 26222 raft_consensus.cc:515] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } }
I20260709 13:21:51.653504 26222 leader_election.cc:290] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 election: Requested vote from peers 66b412913fbd494ba3658aa399d58289 (127.15.242.67:36309), 1f09efc278ba4360b99f3c01eb60fd18 (127.15.242.66:40253)
I20260709 13:21:51.654466 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cb141dbbbf466ab6008861828e5e37" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b412913fbd494ba3658aa399d58289"
I20260709 13:21:51.654942 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cb141dbbbf466ab6008861828e5e37" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f09efc278ba4360b99f3c01eb60fd18"
I20260709 13:21:51.655583 26103 raft_consensus.cc:3060] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.655095 26220 raft_consensus.cc:359] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } }
I20260709 13:21:51.656008 26220 raft_consensus.cc:385] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.656327 26220 raft_consensus.cc:740] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66b412913fbd494ba3658aa399d58289, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.657227 26220 consensus_queue.cc:260] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } }
I20260709 13:21:51.657974 26177 raft_consensus.cc:3060] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.658991 26220 ts_tablet_manager.cc:1434] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:51.663995 26103 raft_consensus.cc:2468] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 1.
I20260709 13:21:51.665346 25993 leader_election.cc:304] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f09efc278ba4360b99f3c01eb60fd18, c09671213ca842139f01292e0bd8c1df; no voters: 
I20260709 13:21:51.666218 26222 raft_consensus.cc:2804] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.666406 26177 raft_consensus.cc:2468] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 1.
I20260709 13:21:51.667960 26222 raft_consensus.cc:697] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 1 LEADER]: Becoming Leader. State: Replica: c09671213ca842139f01292e0bd8c1df, State: Running, Role: LEADER
I20260709 13:21:51.668974 26222 consensus_queue.cc:237] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } }
I20260709 13:21:51.678130 25924 catalog_manager.cc:5697] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df reported cstate change: term changed from 0 to 1, leader changed from <none> to c09671213ca842139f01292e0bd8c1df (127.15.242.65). New cstate: current_term: 1 leader_uuid: "c09671213ca842139f01292e0bd8c1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:51.799320 26222 raft_consensus.cc:493] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.799968 26222 raft_consensus.cc:515] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.801826 26222 leader_election.cc:290] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f09efc278ba4360b99f3c01eb60fd18 (127.15.242.66:40253), 66b412913fbd494ba3658aa399d58289 (127.15.242.67:36309)
I20260709 13:21:51.802843 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8065eb99c343cc9a0569e62ac77ad3" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f09efc278ba4360b99f3c01eb60fd18" is_pre_election: true
I20260709 13:21:51.803143 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8065eb99c343cc9a0569e62ac77ad3" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b412913fbd494ba3658aa399d58289" is_pre_election: true
I20260709 13:21:51.803574 26103 raft_consensus.cc:2468] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 0.
I20260709 13:21:51.803886 26177 raft_consensus.cc:2468] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 0.
I20260709 13:21:51.804934 25993 leader_election.cc:304] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f09efc278ba4360b99f3c01eb60fd18, c09671213ca842139f01292e0bd8c1df; no voters: 
I20260709 13:21:51.805688 26222 raft_consensus.cc:2804] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.806126 26222 raft_consensus.cc:493] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.806463 26222 raft_consensus.cc:3060] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.811892 26222 raft_consensus.cc:515] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.813763 26222 leader_election.cc:290] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 election: Requested vote from peers 1f09efc278ba4360b99f3c01eb60fd18 (127.15.242.66:40253), 66b412913fbd494ba3658aa399d58289 (127.15.242.67:36309)
I20260709 13:21:51.814739 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8065eb99c343cc9a0569e62ac77ad3" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f09efc278ba4360b99f3c01eb60fd18"
I20260709 13:21:51.814893 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8065eb99c343cc9a0569e62ac77ad3" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b412913fbd494ba3658aa399d58289"
I20260709 13:21:51.815647 26103 raft_consensus.cc:3060] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.815712 26177 raft_consensus.cc:3060] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.824265 26103 raft_consensus.cc:2468] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 1.
I20260709 13:21:51.824265 26177 raft_consensus.cc:2468] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 1.
I20260709 13:21:51.825610 25993 leader_election.cc:304] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f09efc278ba4360b99f3c01eb60fd18, c09671213ca842139f01292e0bd8c1df; no voters: 
I20260709 13:21:51.826342 26222 raft_consensus.cc:2804] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.826809 26222 raft_consensus.cc:697] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 1 LEADER]: Becoming Leader. State: Replica: c09671213ca842139f01292e0bd8c1df, State: Running, Role: LEADER
I20260709 13:21:51.827726 26222 consensus_queue.cc:237] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.835222 25924 catalog_manager.cc:5697] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df reported cstate change: term changed from 0 to 1, leader changed from <none> to c09671213ca842139f01292e0bd8c1df (127.15.242.65). New cstate: current_term: 1 leader_uuid: "c09671213ca842139f01292e0bd8c1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:51.920022 25924 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57844:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:51.921897 25924 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:51.948455 26017 tablet_service.cc:1511] Processing CreateTablet for tablet 46b6460b493b444fbba31ae7577dfee8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ad06d1a028a24c6db1e8f622338b2e42]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:51.949920 26017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b6460b493b444fbba31ae7577dfee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.949767 26093 tablet_service.cc:1511] Processing CreateTablet for tablet 46b6460b493b444fbba31ae7577dfee8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ad06d1a028a24c6db1e8f622338b2e42]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:51.951304 26093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b6460b493b444fbba31ae7577dfee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.953151 26166 tablet_service.cc:1511] Processing CreateTablet for tablet 46b6460b493b444fbba31ae7577dfee8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ad06d1a028a24c6db1e8f622338b2e42]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:51.954628 26166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b6460b493b444fbba31ae7577dfee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.955389 26018 tablet_service.cc:1511] Processing CreateTablet for tablet 592d63080af84af5af49b9b11b37fff4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ad06d1a028a24c6db1e8f622338b2e42]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:51.956395 26092 tablet_service.cc:1511] Processing CreateTablet for tablet 592d63080af84af5af49b9b11b37fff4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ad06d1a028a24c6db1e8f622338b2e42]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:51.956723 26018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 592d63080af84af5af49b9b11b37fff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.957670 26092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 592d63080af84af5af49b9b11b37fff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.955389 26167 tablet_service.cc:1511] Processing CreateTablet for tablet 592d63080af84af5af49b9b11b37fff4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ad06d1a028a24c6db1e8f622338b2e42]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:51.963676 26167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 592d63080af84af5af49b9b11b37fff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.968618 26217 tablet_bootstrap.cc:492] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18: Bootstrap starting.
I20260709 13:21:51.971483 26220 tablet_bootstrap.cc:492] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289: Bootstrap starting.
I20260709 13:21:51.974427 26218 tablet_bootstrap.cc:492] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df: Bootstrap starting.
I20260709 13:21:51.975488 26217 tablet_bootstrap.cc:654] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.979296 26220 tablet_bootstrap.cc:654] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.981833 26218 tablet_bootstrap.cc:654] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.989730 26217 tablet_bootstrap.cc:492] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18: No bootstrap required, opened a new log
I20260709 13:21:51.990476 26217 ts_tablet_manager.cc:1403] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:21:51.992523 26218 tablet_bootstrap.cc:492] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df: No bootstrap required, opened a new log
I20260709 13:21:51.992635 26220 tablet_bootstrap.cc:492] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289: No bootstrap required, opened a new log
I20260709 13:21:51.993214 26218 ts_tablet_manager.cc:1403] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.006s
I20260709 13:21:51.993343 26220 ts_tablet_manager.cc:1403] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 13:21:51.994267 26217 raft_consensus.cc:359] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.995206 26217 raft_consensus.cc:385] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.995600 26217 raft_consensus.cc:740] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f09efc278ba4360b99f3c01eb60fd18, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.996245 26218 raft_consensus.cc:359] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.996662 26217 consensus_queue.cc:260] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.996803 26220 raft_consensus.cc:359] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.997848 26220 raft_consensus.cc:385] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.998241 26220 raft_consensus.cc:740] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66b412913fbd494ba3658aa399d58289, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.999496 26217 ts_tablet_manager.cc:1434] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:21:51.999174 26220 consensus_queue.cc:260] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:51.997094 26218 raft_consensus.cc:385] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.000383 26218 raft_consensus.cc:740] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c09671213ca842139f01292e0bd8c1df, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.001828 26220 ts_tablet_manager.cc:1434] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:52.003019 26218 consensus_queue.cc:260] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.005533 26218 ts_tablet_manager.cc:1434] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:21:52.009084 26223 raft_consensus.cc:493] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.009673 26223 raft_consensus.cc:515] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.014523 26218 tablet_bootstrap.cc:492] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df: Bootstrap starting.
I20260709 13:21:52.015116 26217 tablet_bootstrap.cc:492] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18: Bootstrap starting.
I20260709 13:21:52.015520 26223 leader_election.cc:290] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c09671213ca842139f01292e0bd8c1df (127.15.242.65:39105), 66b412913fbd494ba3658aa399d58289 (127.15.242.67:36309)
W20260709 13:21:52.029546 25974 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:52.038290 26218 tablet_bootstrap.cc:654] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.043427 26220 tablet_bootstrap.cc:492] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289: Bootstrap starting.
I20260709 13:21:52.045680 26217 tablet_bootstrap.cc:654] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.053943 26220 tablet_bootstrap.cc:654] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.057519 26218 tablet_bootstrap.cc:492] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df: No bootstrap required, opened a new log
I20260709 13:21:52.057837 26028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b6460b493b444fbba31ae7577dfee8" candidate_uuid: "1f09efc278ba4360b99f3c01eb60fd18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c09671213ca842139f01292e0bd8c1df" is_pre_election: true
W20260709 13:21:52.059672 26066 leader_election.cc:343] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c09671213ca842139f01292e0bd8c1df (127.15.242.65:39105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.058130 26218 ts_tablet_manager.cc:1403] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.003s
I20260709 13:21:52.060662 26217 tablet_bootstrap.cc:492] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18: No bootstrap required, opened a new log
I20260709 13:21:52.061523 26217 ts_tablet_manager.cc:1403] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.005s
I20260709 13:21:52.064100 26218 raft_consensus.cc:359] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.064920 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b6460b493b444fbba31ae7577dfee8" candidate_uuid: "1f09efc278ba4360b99f3c01eb60fd18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b412913fbd494ba3658aa399d58289" is_pre_election: true
I20260709 13:21:52.064716 26217 raft_consensus.cc:359] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.065332 26218 raft_consensus.cc:385] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.065604 26217 raft_consensus.cc:385] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.065711 26177 raft_consensus.cc:2468] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f09efc278ba4360b99f3c01eb60fd18 in term 0.
I20260709 13:21:52.065857 26218 raft_consensus.cc:740] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c09671213ca842139f01292e0bd8c1df, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.066052 26217 raft_consensus.cc:740] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f09efc278ba4360b99f3c01eb60fd18, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.067154 26217 consensus_queue.cc:260] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.067528 26068 leader_election.cc:304] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f09efc278ba4360b99f3c01eb60fd18, 66b412913fbd494ba3658aa399d58289; no voters: c09671213ca842139f01292e0bd8c1df
I20260709 13:21:52.067169 26218 consensus_queue.cc:260] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.069726 26217 ts_tablet_manager.cc:1434] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:52.070082 26218 ts_tablet_manager.cc:1434] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:52.071661 26223 raft_consensus.cc:2804] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.072062 26223 raft_consensus.cc:493] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.072301 26223 raft_consensus.cc:3060] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.075044 26220 tablet_bootstrap.cc:492] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289: No bootstrap required, opened a new log
I20260709 13:21:52.075682 26220 ts_tablet_manager.cc:1403] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.009s
I20260709 13:21:52.080085 26220 raft_consensus.cc:359] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.080797 26220 raft_consensus.cc:385] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.081223 26220 raft_consensus.cc:740] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66b412913fbd494ba3658aa399d58289, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.082314 26220 consensus_queue.cc:260] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.084707 26223 raft_consensus.cc:515] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.087715 26223 leader_election.cc:290] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [CANDIDATE]: Term 1 election: Requested vote from peers c09671213ca842139f01292e0bd8c1df (127.15.242.65:39105), 66b412913fbd494ba3658aa399d58289 (127.15.242.67:36309)
I20260709 13:21:52.087847 26028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b6460b493b444fbba31ae7577dfee8" candidate_uuid: "1f09efc278ba4360b99f3c01eb60fd18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c09671213ca842139f01292e0bd8c1df"
I20260709 13:21:52.088546 26028 raft_consensus.cc:3060] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.089973 26220 ts_tablet_manager.cc:1434] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:21:52.092962 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b6460b493b444fbba31ae7577dfee8" candidate_uuid: "1f09efc278ba4360b99f3c01eb60fd18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b412913fbd494ba3658aa399d58289"
I20260709 13:21:52.093577 26177 raft_consensus.cc:3060] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.095633 26028 raft_consensus.cc:2468] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f09efc278ba4360b99f3c01eb60fd18 in term 1.
I20260709 13:21:52.097146 26066 leader_election.cc:304] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f09efc278ba4360b99f3c01eb60fd18, c09671213ca842139f01292e0bd8c1df; no voters: 
I20260709 13:21:52.098183 26223 raft_consensus.cc:2804] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.099200 26223 raft_consensus.cc:697] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 LEADER]: Becoming Leader. State: Replica: 1f09efc278ba4360b99f3c01eb60fd18, State: Running, Role: LEADER
I20260709 13:21:52.100212 26223 consensus_queue.cc:237] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.102918 26177 raft_consensus.cc:2468] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f09efc278ba4360b99f3c01eb60fd18 in term 1.
I20260709 13:21:52.108351 25926 catalog_manager.cc:5697] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f09efc278ba4360b99f3c01eb60fd18 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "1f09efc278ba4360b99f3c01eb60fd18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.135711 26222 consensus_queue.cc:1048] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.149675 26251 consensus_queue.cc:1048] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:52.254917 26251 consensus_queue.cc:1048] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.267866 26222 consensus_queue.cc:1048] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.284341 26222 raft_consensus.cc:493] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.285017 26222 raft_consensus.cc:515] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.288254 26222 leader_election.cc:290] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f09efc278ba4360b99f3c01eb60fd18 (127.15.242.66:40253), 66b412913fbd494ba3658aa399d58289 (127.15.242.67:36309)
I20260709 13:21:52.289261 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d63080af84af5af49b9b11b37fff4" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f09efc278ba4360b99f3c01eb60fd18" is_pre_election: true
I20260709 13:21:52.290053 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d63080af84af5af49b9b11b37fff4" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b412913fbd494ba3658aa399d58289" is_pre_election: true
I20260709 13:21:52.290072 26103 raft_consensus.cc:2468] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 0.
I20260709 13:21:52.290948 26177 raft_consensus.cc:2468] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 0.
I20260709 13:21:52.291580 25993 leader_election.cc:304] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f09efc278ba4360b99f3c01eb60fd18, c09671213ca842139f01292e0bd8c1df; no voters: 
I20260709 13:21:52.292310 26222 raft_consensus.cc:2804] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.292714 26222 raft_consensus.cc:493] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.293038 26222 raft_consensus.cc:3060] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.300422 26222 raft_consensus.cc:515] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.303651 26222 leader_election.cc:290] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 election: Requested vote from peers 1f09efc278ba4360b99f3c01eb60fd18 (127.15.242.66:40253), 66b412913fbd494ba3658aa399d58289 (127.15.242.67:36309)
I20260709 13:21:52.304838 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d63080af84af5af49b9b11b37fff4" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f09efc278ba4360b99f3c01eb60fd18"
I20260709 13:21:52.305972 26103 raft_consensus.cc:3060] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.306455 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d63080af84af5af49b9b11b37fff4" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b412913fbd494ba3658aa399d58289"
I20260709 13:21:52.307130 26177 raft_consensus.cc:3060] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.313642 26103 raft_consensus.cc:2468] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 1.
I20260709 13:21:52.314239 26177 raft_consensus.cc:2468] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 1.
I20260709 13:21:52.315510 25993 leader_election.cc:304] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66b412913fbd494ba3658aa399d58289, c09671213ca842139f01292e0bd8c1df; no voters: 
I20260709 13:21:52.317173 26222 raft_consensus.cc:2804] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.317723 26222 raft_consensus.cc:697] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 1 LEADER]: Becoming Leader. State: Replica: c09671213ca842139f01292e0bd8c1df, State: Running, Role: LEADER
I20260709 13:21:52.318552 26222 consensus_queue.cc:237] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.329399 25925 catalog_manager.cc:5697] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df reported cstate change: term changed from 0 to 1, leader changed from <none> to c09671213ca842139f01292e0bd8c1df (127.15.242.65). New cstate: current_term: 1 leader_uuid: "c09671213ca842139f01292e0bd8c1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.397533 26028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf8065eb99c343cc9a0569e62ac77ad3"
dest_uuid: "c09671213ca842139f01292e0bd8c1df"
mode: GRACEFUL
new_leader_uuid: "1f09efc278ba4360b99f3c01eb60fd18"
 from {username='slave'} at 127.0.0.1:37228
I20260709 13:21:52.398144 26028 raft_consensus.cc:606] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 1 LEADER]: Received request to transfer leadership to TS 1f09efc278ba4360b99f3c01eb60fd18
I20260709 13:21:52.417191 26103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46b6460b493b444fbba31ae7577dfee8"
dest_uuid: "1f09efc278ba4360b99f3c01eb60fd18"
mode: GRACEFUL
new_leader_uuid: "c09671213ca842139f01292e0bd8c1df"
 from {username='slave'} at 127.0.0.1:38566
I20260709 13:21:52.417986 26103 raft_consensus.cc:606] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 LEADER]: Received request to transfer leadership to TS c09671213ca842139f01292e0bd8c1df
I20260709 13:21:52.523061 26223 consensus_queue.cc:1048] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.535537 26223 consensus_queue.cc:1048] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:52.557732 26247 raft_consensus.cc:993] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18: : Instructing follower c09671213ca842139f01292e0bd8c1df to start an election
I20260709 13:21:52.558243 26261 raft_consensus.cc:1081] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 LEADER]: Signalling peer c09671213ca842139f01292e0bd8c1df to start an election
I20260709 13:21:52.562335 26028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46b6460b493b444fbba31ae7577dfee8"
dest_uuid: "c09671213ca842139f01292e0bd8c1df"
 from {username='slave'} at 127.0.0.1:37226
I20260709 13:21:52.562878 26028 raft_consensus.cc:493] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:52.563525 26028 raft_consensus.cc:3060] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.572381 26028 raft_consensus.cc:515] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.574115 26028 leader_election.cc:290] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 2 election: Requested vote from peers 1f09efc278ba4360b99f3c01eb60fd18 (127.15.242.66:40253), 66b412913fbd494ba3658aa399d58289 (127.15.242.67:36309)
I20260709 13:21:52.575207 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b6460b493b444fbba31ae7577dfee8" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f09efc278ba4360b99f3c01eb60fd18"
I20260709 13:21:52.575486 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b6460b493b444fbba31ae7577dfee8" candidate_uuid: "c09671213ca842139f01292e0bd8c1df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66b412913fbd494ba3658aa399d58289"
I20260709 13:21:52.576012 26103 raft_consensus.cc:3055] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:52.576116 26177 raft_consensus.cc:3060] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.576490 26103 raft_consensus.cc:740] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f09efc278ba4360b99f3c01eb60fd18, State: Running, Role: LEADER
I20260709 13:21:52.577674 26103 consensus_queue.cc:260] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.581471 26103 raft_consensus.cc:3060] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.586990 26177 raft_consensus.cc:2468] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 2.
I20260709 13:21:52.588999 25993 leader_election.cc:304] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66b412913fbd494ba3658aa399d58289, c09671213ca842139f01292e0bd8c1df; no voters: 
I20260709 13:21:52.589991 26222 raft_consensus.cc:2804] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:52.590791 26222 raft_consensus.cc:697] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 2 LEADER]: Becoming Leader. State: Replica: c09671213ca842139f01292e0bd8c1df, State: Running, Role: LEADER
I20260709 13:21:52.591697 26103 raft_consensus.cc:2468] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c09671213ca842139f01292e0bd8c1df in term 2.
I20260709 13:21:52.591877 26222 consensus_queue.cc:237] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.599036 25924 catalog_manager.cc:5697] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df reported cstate change: term changed from 1 to 2, leader changed from 1f09efc278ba4360b99f3c01eb60fd18 (127.15.242.66) to c09671213ca842139f01292e0bd8c1df (127.15.242.65). New cstate: current_term: 2 leader_uuid: "c09671213ca842139f01292e0bd8c1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.668469 26251 raft_consensus.cc:993] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df: : Instructing follower 1f09efc278ba4360b99f3c01eb60fd18 to start an election
I20260709 13:21:52.669278 26222 raft_consensus.cc:1081] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 1 LEADER]: Signalling peer 1f09efc278ba4360b99f3c01eb60fd18 to start an election
I20260709 13:21:52.671324 26103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf8065eb99c343cc9a0569e62ac77ad3"
dest_uuid: "1f09efc278ba4360b99f3c01eb60fd18"
 from {username='slave'} at 127.0.0.1:38552
I20260709 13:21:52.671921 26103 raft_consensus.cc:493] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:52.672298 26103 raft_consensus.cc:3060] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.677597 26103 raft_consensus.cc:515] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.679559 26103 leader_election.cc:290] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [CANDIDATE]: Term 2 election: Requested vote from peers c09671213ca842139f01292e0bd8c1df (127.15.242.65:39105), 66b412913fbd494ba3658aa399d58289 (127.15.242.67:36309)
I20260709 13:21:52.680596 26028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8065eb99c343cc9a0569e62ac77ad3" candidate_uuid: "1f09efc278ba4360b99f3c01eb60fd18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c09671213ca842139f01292e0bd8c1df"
I20260709 13:21:52.680596 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8065eb99c343cc9a0569e62ac77ad3" candidate_uuid: "1f09efc278ba4360b99f3c01eb60fd18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66b412913fbd494ba3658aa399d58289"
I20260709 13:21:52.681660 26028 raft_consensus.cc:3055] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:52.681660 26177 raft_consensus.cc:3060] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.682494 26028 raft_consensus.cc:740] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c09671213ca842139f01292e0bd8c1df, State: Running, Role: LEADER
I20260709 13:21:52.683521 26028 consensus_queue.cc:260] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.685103 26028 raft_consensus.cc:3060] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.690164 26177 raft_consensus.cc:2468] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f09efc278ba4360b99f3c01eb60fd18 in term 2.
I20260709 13:21:52.691587 26068 leader_election.cc:304] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f09efc278ba4360b99f3c01eb60fd18, 66b412913fbd494ba3658aa399d58289; no voters: 
I20260709 13:21:52.692322 26261 raft_consensus.cc:2804] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:52.692370 26028 raft_consensus.cc:2468] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f09efc278ba4360b99f3c01eb60fd18 in term 2.
I20260709 13:21:52.692888 26261 raft_consensus.cc:697] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 2 LEADER]: Becoming Leader. State: Replica: 1f09efc278ba4360b99f3c01eb60fd18, State: Running, Role: LEADER
I20260709 13:21:52.693753 26261 consensus_queue.cc:237] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.700282 25924 catalog_manager.cc:5697] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 reported cstate change: term changed from 1 to 2, leader changed from c09671213ca842139f01292e0bd8c1df (127.15.242.65) to 1f09efc278ba4360b99f3c01eb60fd18 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "1f09efc278ba4360b99f3c01eb60fd18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.744650 16329 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:21:52.746272 16329 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:21:52.746611 16329 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:21:52.760327 26028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "592d63080af84af5af49b9b11b37fff4"
dest_uuid: "c09671213ca842139f01292e0bd8c1df"
mode: GRACEFUL
new_leader_uuid: "66b412913fbd494ba3658aa399d58289"
 from {username='slave'} at 127.0.0.1:37232
I20260709 13:21:52.760819 26028 raft_consensus.cc:606] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 1 LEADER]: Received request to transfer leadership to TS 66b412913fbd494ba3658aa399d58289
I20260709 13:21:52.762219 16329 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:21:52.783156 26222 consensus_queue.cc:1048] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.790722 26251 raft_consensus.cc:993] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df: : Instructing follower 66b412913fbd494ba3658aa399d58289 to start an election
I20260709 13:21:52.791242 26251 raft_consensus.cc:1081] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 1 LEADER]: Signalling peer 66b412913fbd494ba3658aa399d58289 to start an election
I20260709 13:21:52.795117 26176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "592d63080af84af5af49b9b11b37fff4"
dest_uuid: "66b412913fbd494ba3658aa399d58289"
 from {username='slave'} at 127.0.0.1:42714
I20260709 13:21:52.795739 26176 raft_consensus.cc:493] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:52.796114 26176 raft_consensus.cc:3060] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.798322 26251 consensus_queue.cc:1048] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:52.803941 26176 raft_consensus.cc:515] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.818912 26176 leader_election.cc:290] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [CANDIDATE]: Term 2 election: Requested vote from peers c09671213ca842139f01292e0bd8c1df (127.15.242.65:39105), 1f09efc278ba4360b99f3c01eb60fd18 (127.15.242.66:40253)
I20260709 13:21:52.821290 26028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d63080af84af5af49b9b11b37fff4" candidate_uuid: "66b412913fbd494ba3658aa399d58289" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c09671213ca842139f01292e0bd8c1df"
I20260709 13:21:52.821976 26028 raft_consensus.cc:3055] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:52.822667 26028 raft_consensus.cc:740] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c09671213ca842139f01292e0bd8c1df, State: Running, Role: LEADER
I20260709 13:21:52.823590 26028 consensus_queue.cc:260] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.824836 26028 raft_consensus.cc:3060] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.829885 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "592d63080af84af5af49b9b11b37fff4" candidate_uuid: "66b412913fbd494ba3658aa399d58289" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f09efc278ba4360b99f3c01eb60fd18"
I20260709 13:21:52.830992 26103 raft_consensus.cc:3060] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.832259 26028 raft_consensus.cc:2468] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66b412913fbd494ba3658aa399d58289 in term 2.
I20260709 13:21:52.833446 26140 leader_election.cc:304] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66b412913fbd494ba3658aa399d58289, c09671213ca842139f01292e0bd8c1df; no voters: 
I20260709 13:21:52.834389 26228 raft_consensus.cc:2804] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:52.835961 26228 raft_consensus.cc:697] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 2 LEADER]: Becoming Leader. State: Replica: 66b412913fbd494ba3658aa399d58289, State: Running, Role: LEADER
I20260709 13:21:52.836923 26228 consensus_queue.cc:237] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } }
I20260709 13:21:52.837234 26103 raft_consensus.cc:2468] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66b412913fbd494ba3658aa399d58289 in term 2.
I20260709 13:21:52.844292 25924 catalog_manager.cc:5697] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 reported cstate change: term changed from 1 to 2, leader changed from c09671213ca842139f01292e0bd8c1df (127.15.242.65) to 66b412913fbd494ba3658aa399d58289 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "66b412913fbd494ba3658aa399d58289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c09671213ca842139f01292e0bd8c1df" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 39105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f09efc278ba4360b99f3c01eb60fd18" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66b412913fbd494ba3658aa399d58289" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 36309 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:52.860297 16329 tablet_server.cc:179] TabletServer@127.15.242.65:0 shutting down...
I20260709 13:21:52.882619 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:52.883250 16329 tablet_replica.cc:333] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df: stopping tablet replica
I20260709 13:21:52.883802 16329 raft_consensus.cc:2243] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.884258 16329 raft_consensus.cc:2272] T 592d63080af84af5af49b9b11b37fff4 P c09671213ca842139f01292e0bd8c1df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.886528 16329 tablet_replica.cc:333] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df: stopping tablet replica
I20260709 13:21:52.887059 16329 raft_consensus.cc:2243] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.887452 16329 raft_consensus.cc:2272] T cf8065eb99c343cc9a0569e62ac77ad3 P c09671213ca842139f01292e0bd8c1df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.889731 16329 tablet_replica.cc:333] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df: stopping tablet replica
I20260709 13:21:52.890376 16329 raft_consensus.cc:2243] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.890969 16329 pending_rounds.cc:70] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df: Trying to abort 1 pending ops.
I20260709 13:21:52.891131 16329 pending_rounds.cc:77] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639168385540096 op_type: NO_OP noop_request { }
I20260709 13:21:52.891378 16329 raft_consensus.cc:2889] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:52.891600 16329 raft_consensus.cc:2272] T 46b6460b493b444fbba31ae7577dfee8 P c09671213ca842139f01292e0bd8c1df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.894170 16329 tablet_replica.cc:333] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df: stopping tablet replica
I20260709 13:21:52.894668 16329 raft_consensus.cc:2243] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.895434 16329 raft_consensus.cc:2272] T 42cb141dbbbf466ab6008861828e5e37 P c09671213ca842139f01292e0bd8c1df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.919519 16329 tablet_server.cc:196] TabletServer@127.15.242.65:0 shutdown complete.
I20260709 13:21:52.932193 16329 tablet_server.cc:179] TabletServer@127.15.242.66:0 shutting down...
I20260709 13:21:52.958822 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:52.959477 16329 tablet_replica.cc:333] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18: stopping tablet replica
I20260709 13:21:52.960021 16329 raft_consensus.cc:2243] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.960457 16329 raft_consensus.cc:2272] T 592d63080af84af5af49b9b11b37fff4 P 1f09efc278ba4360b99f3c01eb60fd18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.963186 16329 tablet_replica.cc:333] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18: stopping tablet replica
I20260709 13:21:52.963729 16329 raft_consensus.cc:2243] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.964123 16329 raft_consensus.cc:2272] T 46b6460b493b444fbba31ae7577dfee8 P 1f09efc278ba4360b99f3c01eb60fd18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.966697 16329 tablet_replica.cc:333] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18: stopping tablet replica
I20260709 13:21:52.967180 16329 raft_consensus.cc:2243] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.967569 16329 raft_consensus.cc:2272] T 42cb141dbbbf466ab6008861828e5e37 P 1f09efc278ba4360b99f3c01eb60fd18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.969914 16329 tablet_replica.cc:333] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18: stopping tablet replica
I20260709 13:21:52.970458 16329 raft_consensus.cc:2243] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.971005 16329 pending_rounds.cc:70] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18: Trying to abort 1 pending ops.
I20260709 13:21:52.971159 16329 pending_rounds.cc:77] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639168800845824 op_type: NO_OP noop_request { }
I20260709 13:21:52.971391 16329 raft_consensus.cc:2889] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:52.971606 16329 raft_consensus.cc:2272] T cf8065eb99c343cc9a0569e62ac77ad3 P 1f09efc278ba4360b99f3c01eb60fd18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.994654 16329 tablet_server.cc:196] TabletServer@127.15.242.66:0 shutdown complete.
I20260709 13:21:53.008285 16329 tablet_server.cc:179] TabletServer@127.15.242.67:0 shutting down...
I20260709 13:21:53.029428 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:53.030267 16329 tablet_replica.cc:333] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289: stopping tablet replica
I20260709 13:21:53.031031 16329 raft_consensus.cc:2243] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.031858 16329 pending_rounds.cc:70] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289: Trying to abort 1 pending ops.
I20260709 13:21:53.032105 16329 pending_rounds.cc:77] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639169390063616 op_type: NO_OP noop_request { }
I20260709 13:21:53.032446 16329 raft_consensus.cc:2889] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:53.032793 16329 raft_consensus.cc:2272] T 592d63080af84af5af49b9b11b37fff4 P 66b412913fbd494ba3658aa399d58289 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.035773 16329 tablet_replica.cc:333] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289: stopping tablet replica
I20260709 13:21:53.036561 16329 raft_consensus.cc:2243] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.037128 16329 raft_consensus.cc:2272] T 46b6460b493b444fbba31ae7577dfee8 P 66b412913fbd494ba3658aa399d58289 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.040218 16329 tablet_replica.cc:333] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289: stopping tablet replica
I20260709 13:21:53.041023 16329 raft_consensus.cc:2243] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.041492 16329 raft_consensus.cc:2272] T 42cb141dbbbf466ab6008861828e5e37 P 66b412913fbd494ba3658aa399d58289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.044029 16329 tablet_replica.cc:333] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289: stopping tablet replica
I20260709 13:21:53.044479 16329 raft_consensus.cc:2243] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.044852 16329 raft_consensus.cc:2272] T cf8065eb99c343cc9a0569e62ac77ad3 P 66b412913fbd494ba3658aa399d58289 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.067662 16329 tablet_server.cc:196] TabletServer@127.15.242.67:0 shutdown complete.
I20260709 13:21:53.080365 16329 master.cc:562] Master@127.15.242.126:42931 shutting down...
I20260709 13:21:53.102619 16329 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.103232 16329 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.103588 16329 tablet_replica.cc:333] T 00000000000000000000000000000000 P 64a4e314b82c40cb9df4f9afe2fc83f7: stopping tablet replica
I20260709 13:21:53.123953 16329 master.cc:584] Master@127.15.242.126:42931 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2299 ms)
[----------] 6 tests from LeaderRebalancerTest (277371 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:21:53.157389 16329 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.242.126:40707
I20260709 13:21:53.158771 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:53.167198 26270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:53.167292 26269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:53.168144 26272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:53.169413 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:53.170332 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:53.170501 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:53.170670 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603313170656 us; error 0 us; skew 500 ppm
I20260709 13:21:53.171245 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:53.173591 16329 webserver.cc:533] Webserver started at http://127.15.242.126:35387/ using document root <none> and password file <none>
I20260709 13:21:53.174136 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:53.174322 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:53.174595 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:53.175655 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/master-0-root/instance:
uuid: "0b9161d86b5d4c06bb873435df44a31a"
format_stamp: "Formatted at 2026-07-09 13:21:53 on dist-test-slave-fh5z"
I20260709 13:21:53.180102 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:21:53.184190 26277 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:53.185199 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:21:53.185462 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/master-0-root
uuid: "0b9161d86b5d4c06bb873435df44a31a"
format_stamp: "Formatted at 2026-07-09 13:21:53 on dist-test-slave-fh5z"
I20260709 13:21:53.185781 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:53.199060 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:53.200125 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:53.240530 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.126:40707
I20260709 13:21:53.240656 26328 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.126:40707 every 8 connection(s)
I20260709 13:21:53.245266 26329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.256935 26329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a: Bootstrap starting.
I20260709 13:21:53.261802 26329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.266064 26329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a: No bootstrap required, opened a new log
I20260709 13:21:53.268337 26329 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b9161d86b5d4c06bb873435df44a31a" member_type: VOTER }
I20260709 13:21:53.268761 26329 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.268965 26329 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9161d86b5d4c06bb873435df44a31a, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.269743 26329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b9161d86b5d4c06bb873435df44a31a" member_type: VOTER }
I20260709 13:21:53.270272 26329 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:53.270471 26329 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:53.270689 26329 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.275565 26329 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b9161d86b5d4c06bb873435df44a31a" member_type: VOTER }
I20260709 13:21:53.276088 26329 leader_election.cc:304] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b9161d86b5d4c06bb873435df44a31a; no voters: 
I20260709 13:21:53.277433 26329 leader_election.cc:290] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:53.277959 26332 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.279594 26332 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [term 1 LEADER]: Becoming Leader. State: Replica: 0b9161d86b5d4c06bb873435df44a31a, State: Running, Role: LEADER
I20260709 13:21:53.280332 26332 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b9161d86b5d4c06bb873435df44a31a" member_type: VOTER }
I20260709 13:21:53.280675 26329 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:53.283288 26333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b9161d86b5d4c06bb873435df44a31a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b9161d86b5d4c06bb873435df44a31a" member_type: VOTER } }
I20260709 13:21:53.284430 26333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:53.283291 26334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b9161d86b5d4c06bb873435df44a31a. Latest consensus state: current_term: 1 leader_uuid: "0b9161d86b5d4c06bb873435df44a31a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b9161d86b5d4c06bb873435df44a31a" member_type: VOTER } }
I20260709 13:21:53.287200 26334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:53.290088 26337 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:53.295053 26337 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:53.299490 16329 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:53.304711 26337 catalog_manager.cc:1383] Generated new cluster ID: 28058dc789ba4b87b6b4b22f842f43d4
I20260709 13:21:53.305083 26337 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:53.321067 26337 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:53.322679 26337 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:53.347218 26337 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a: Generated new TSK 0
I20260709 13:21:53.347904 26337 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:53.366348 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:53.372133 26350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:53.373394 26351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:53.374924 26353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:53.376045 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:53.376940 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:53.377140 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:53.377274 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603313377262 us; error 0 us; skew 500 ppm
I20260709 13:21:53.377797 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:53.380676 16329 webserver.cc:533] Webserver started at http://127.15.242.65:38477/ using document root <none> and password file <none>
I20260709 13:21:53.381142 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:53.381302 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:53.381518 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:53.382709 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-0-root/instance:
uuid: "3b34bd6ec671409d9e228156d3e81d08"
format_stamp: "Formatted at 2026-07-09 13:21:53 on dist-test-slave-fh5z"
I20260709 13:21:53.387388 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:53.391402 26358 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:53.392377 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:21:53.392683 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-0-root
uuid: "3b34bd6ec671409d9e228156d3e81d08"
format_stamp: "Formatted at 2026-07-09 13:21:53 on dist-test-slave-fh5z"
I20260709 13:21:53.392970 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:53.433283 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:53.434687 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:53.436333 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:53.438959 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:53.439214 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:53.439498 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:53.439687 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:53.483727 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.65:41201
I20260709 13:21:53.483839 26420 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.65:41201 every 8 connection(s)
I20260709 13:21:53.490062 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:53.498510 26426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:53.498510 26425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:53.501166 26428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:53.502013 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:53.504141 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:53.504426 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:53.504621 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603313504606 us; error 0 us; skew 500 ppm
I20260709 13:21:53.505167 26421 heartbeater.cc:344] Connected to a master server at 127.15.242.126:40707
I20260709 13:21:53.505255 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:53.505764 26421 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:53.506721 26421 heartbeater.cc:507] Master 127.15.242.126:40707 requested a full tablet report, sending...
I20260709 13:21:53.508623 16329 webserver.cc:533] Webserver started at http://127.15.242.66:42905/ using document root <none> and password file <none>
I20260709 13:21:53.509207 26294 ts_manager.cc:194] Registered new tserver with Master: 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201)
I20260709 13:21:53.509433 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:53.509915 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:53.510327 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:53.511381 26294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40408
I20260709 13:21:53.511507 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-1-root/instance:
uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
format_stamp: "Formatted at 2026-07-09 13:21:53 on dist-test-slave-fh5z"
I20260709 13:21:53.516294 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:21:53.519951 26433 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:53.520931 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:21:53.521255 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-1-root
uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
format_stamp: "Formatted at 2026-07-09 13:21:53 on dist-test-slave-fh5z"
I20260709 13:21:53.521819 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:53.541446 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:53.542689 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:53.544751 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:53.547885 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:53.548192 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:53.548532 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:53.548866 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:53.599066 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.66:36511
I20260709 13:21:53.599167 26495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.66:36511 every 8 connection(s)
I20260709 13:21:53.604689 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:53.613775 26499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:53.614264 26500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:53.616375 26502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:53.618367 16329 server_base.cc:1061] running on GCE node
I20260709 13:21:53.619127 26496 heartbeater.cc:344] Connected to a master server at 127.15.242.126:40707
I20260709 13:21:53.619525 26496 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:53.619603 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:53.619935 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:53.620144 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603313620127 us; error 0 us; skew 500 ppm
I20260709 13:21:53.620460 26496 heartbeater.cc:507] Master 127.15.242.126:40707 requested a full tablet report, sending...
I20260709 13:21:53.620838 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:53.622900 26294 ts_manager.cc:194] Registered new tserver with Master: 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:21:53.625535 26294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40422
I20260709 13:21:53.626530 16329 webserver.cc:533] Webserver started at http://127.15.242.67:36819/ using document root <none> and password file <none>
I20260709 13:21:53.627274 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:53.627553 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:53.627926 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:53.629329 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-2-root/instance:
uuid: "cc109b784081414e8f56d12601021038"
format_stamp: "Formatted at 2026-07-09 13:21:53 on dist-test-slave-fh5z"
I20260709 13:21:53.635046 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:21:53.638803 26507 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:53.639856 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:21:53.640244 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-2-root
uuid: "cc109b784081414e8f56d12601021038"
format_stamp: "Formatted at 2026-07-09 13:21:53 on dist-test-slave-fh5z"
I20260709 13:21:53.640552 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603035614178-16329-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:53.656455 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:53.657586 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:53.659309 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:53.661818 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:53.662213 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:21:53.662530 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:53.662732 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:53.711267 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.67:33635
I20260709 13:21:53.711380 26569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.67:33635 every 8 connection(s)
I20260709 13:21:53.727295 26570 heartbeater.cc:344] Connected to a master server at 127.15.242.126:40707
I20260709 13:21:53.727772 26570 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:53.728471 26570 heartbeater.cc:507] Master 127.15.242.126:40707 requested a full tablet report, sending...
I20260709 13:21:53.730590 26294 ts_manager.cc:194] Registered new tserver with Master: cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:53.731281 16329 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016255258s
I20260709 13:21:53.732134 26294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40432
I20260709 13:21:53.758268 26294 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40442:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:53.760823 26294 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:53.833768 26385 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa4f09dd99e42179348398f40bc0b85 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:53.835362 26385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa4f09dd99e42179348398f40bc0b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.837833 26535 tablet_service.cc:1511] Processing CreateTablet for tablet 5d777176544b4503aa820d1ea113c030 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:53.832547 26386 tablet_service.cc:1511] Processing CreateTablet for tablet 5d777176544b4503aa820d1ea113c030 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:53.839347 26535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d777176544b4503aa820d1ea113c030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.839421 26386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d777176544b4503aa820d1ea113c030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.842972 26533 tablet_service.cc:1511] Processing CreateTablet for tablet b31d79fbf0f741c8a12aae40574ead69 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:53.843940 26384 tablet_service.cc:1511] Processing CreateTablet for tablet b31d79fbf0f741c8a12aae40574ead69 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:53.844429 26533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31d79fbf0f741c8a12aae40574ead69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.845371 26384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31d79fbf0f741c8a12aae40574ead69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.845525 26534 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa4f09dd99e42179348398f40bc0b85 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:53.846940 26534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa4f09dd99e42179348398f40bc0b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.851161 26532 tablet_service.cc:1511] Processing CreateTablet for tablet 500a08b742ec4334a594fd79f3659ada (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:53.851879 26383 tablet_service.cc:1511] Processing CreateTablet for tablet 500a08b742ec4334a594fd79f3659ada (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:53.852713 26532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500a08b742ec4334a594fd79f3659ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.853231 26383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500a08b742ec4334a594fd79f3659ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.856094 26382 tablet_service.cc:1511] Processing CreateTablet for tablet a997e7b3074942dda1c719a2364af4da (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:53.857708 26382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a997e7b3074942dda1c719a2364af4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.859133 26530 tablet_service.cc:1511] Processing CreateTablet for tablet 95ea1805d9bc47c9b613ab623731e1f7 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:53.860095 26381 tablet_service.cc:1511] Processing CreateTablet for tablet 95ea1805d9bc47c9b613ab623731e1f7 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:53.861725 26531 tablet_service.cc:1511] Processing CreateTablet for tablet a997e7b3074942dda1c719a2364af4da (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:53.860630 26530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ea1805d9bc47c9b613ab623731e1f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.864037 26380 tablet_service.cc:1511] Processing CreateTablet for tablet 09d23b56b7c544b9a1ed8ea154954a29 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:53.864972 26529 tablet_service.cc:1511] Processing CreateTablet for tablet 09d23b56b7c544b9a1ed8ea154954a29 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:53.866315 26529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09d23b56b7c544b9a1ed8ea154954a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.870426 26531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a997e7b3074942dda1c719a2364af4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.874434 26380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09d23b56b7c544b9a1ed8ea154954a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.875468 26381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ea1805d9bc47c9b613ab623731e1f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.883213 26379 tablet_service.cc:1511] Processing CreateTablet for tablet 6047b437ca3f41bf9665b38f2bf4add6 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:53.884737 26379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6047b437ca3f41bf9665b38f2bf4add6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.892732 26528 tablet_service.cc:1511] Processing CreateTablet for tablet 6047b437ca3f41bf9665b38f2bf4add6 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:53.894827 26528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6047b437ca3f41bf9665b38f2bf4add6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.895908 26461 tablet_service.cc:1511] Processing CreateTablet for tablet 5d777176544b4503aa820d1ea113c030 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:53.897284 26461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d777176544b4503aa820d1ea113c030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.897955 26456 tablet_service.cc:1511] Processing CreateTablet for tablet 95ea1805d9bc47c9b613ab623731e1f7 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:53.899336 26456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ea1805d9bc47c9b613ab623731e1f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.899135 26460 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa4f09dd99e42179348398f40bc0b85 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:53.900453 26460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa4f09dd99e42179348398f40bc0b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.901161 26455 tablet_service.cc:1511] Processing CreateTablet for tablet 09d23b56b7c544b9a1ed8ea154954a29 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:53.902557 26455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09d23b56b7c544b9a1ed8ea154954a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.902307 26459 tablet_service.cc:1511] Processing CreateTablet for tablet b31d79fbf0f741c8a12aae40574ead69 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:53.903625 26459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31d79fbf0f741c8a12aae40574ead69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.907135 26458 tablet_service.cc:1511] Processing CreateTablet for tablet 500a08b742ec4334a594fd79f3659ada (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:53.908592 26458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500a08b742ec4334a594fd79f3659ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.911243 26457 tablet_service.cc:1511] Processing CreateTablet for tablet a997e7b3074942dda1c719a2364af4da (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:53.911706 26454 tablet_service.cc:1511] Processing CreateTablet for tablet 6047b437ca3f41bf9665b38f2bf4add6 (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:53.912750 26457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a997e7b3074942dda1c719a2364af4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.913841 26378 tablet_service.cc:1511] Processing CreateTablet for tablet a7908957d3f848418cc01e408814977d (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:53.914419 26454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6047b437ca3f41bf9665b38f2bf4add6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.915217 26378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7908957d3f848418cc01e408814977d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.922546 26527 tablet_service.cc:1511] Processing CreateTablet for tablet a7908957d3f848418cc01e408814977d (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:53.924109 26527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7908957d3f848418cc01e408814977d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:53.951822 26453 tablet_service.cc:1511] Processing CreateTablet for tablet a7908957d3f848418cc01e408814977d (DEFAULT_TABLE table=test-workload [id=ff25fef348954499abd362389c3dff67]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:53.953300 26453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7908957d3f848418cc01e408814977d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:54.049060 26278 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.242.65:41201, user_credentials={real_user=slave}} blocked reactor thread for 61459.4us
I20260709 13:21:54.063817 26585 tablet_bootstrap.cc:492] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:21:54.066248 26588 tablet_bootstrap.cc:492] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:21:54.071199 26585 tablet_bootstrap.cc:654] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.077862 26588 tablet_bootstrap.cc:654] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.090587 26588 tablet_bootstrap.cc:492] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:21:54.091110 26588 ts_tablet_manager.cc:1403] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 13:21:54.098589 26586 tablet_bootstrap.cc:492] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:21:54.103579 26585 tablet_bootstrap.cc:492] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:21:54.104215 26588 raft_consensus.cc:359] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.104919 26585 ts_tablet_manager.cc:1403] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.004s
I20260709 13:21:54.105173 26588 raft_consensus.cc:385] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.105592 26586 tablet_bootstrap.cc:654] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.105803 26588 raft_consensus.cc:740] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.150669 26585 raft_consensus.cc:359] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:54.153031 26585 raft_consensus.cc:385] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.153506 26585 raft_consensus.cc:740] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.166560 26588 consensus_queue.cc:260] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.167824 26585 consensus_queue.cc:260] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:54.185171 26588 ts_tablet_manager.cc:1434] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.094s	user 0.011s	sys 0.008s
I20260709 13:21:54.186918 26496 heartbeater.cc:499] Master 127.15.242.126:40707 was elected leader, sending a full tablet report...
I20260709 13:21:54.192471 26588 tablet_bootstrap.cc:492] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:21:54.193338 26570 heartbeater.cc:499] Master 127.15.242.126:40707 was elected leader, sending a full tablet report...
I20260709 13:21:54.194343 26585 ts_tablet_manager.cc:1434] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.089s	user 0.016s	sys 0.010s
I20260709 13:21:54.194573 26586 tablet_bootstrap.cc:492] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:21:54.207187 26585 tablet_bootstrap.cc:492] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:21:54.209168 26586 ts_tablet_manager.cc:1403] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.111s	user 0.020s	sys 0.018s
I20260709 13:21:54.212774 26586 raft_consensus.cc:359] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.213415 26586 raft_consensus.cc:385] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.213701 26586 raft_consensus.cc:740] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.214699 26586 consensus_queue.cc:260] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.215797 26585 tablet_bootstrap.cc:654] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.216405 26588 tablet_bootstrap.cc:654] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.225059 26586 ts_tablet_manager.cc:1434] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:21:54.226425 26592 raft_consensus.cc:493] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.226482 26421 heartbeater.cc:499] Master 127.15.242.126:40707 was elected leader, sending a full tablet report...
I20260709 13:21:54.227588 26592 raft_consensus.cc:515] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.232929 26592 leader_election.cc:290] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.243697 26586 tablet_bootstrap.cc:492] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:21:54.266937 26585 tablet_bootstrap.cc:492] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:21:54.267673 26585 ts_tablet_manager.cc:1403] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.037s
I20260709 13:21:54.271346 26585 raft_consensus.cc:359] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.272207 26585 raft_consensus.cc:385] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.272528 26585 raft_consensus.cc:740] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.273376 26585 consensus_queue.cc:260] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.277333 26585 ts_tablet_manager.cc:1434] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:21:54.278635 26585 tablet_bootstrap.cc:492] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:21:54.285895 26586 tablet_bootstrap.cc:654] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.286231 26396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7908957d3f848418cc01e408814977d" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:21:54.288120 26585 tablet_bootstrap.cc:654] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:54.288717 26434 leader_election.cc:343] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:54.295121 26342 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:54.298619 26593 raft_consensus.cc:493] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.299464 26593 raft_consensus.cc:515] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.308053 26588 tablet_bootstrap.cc:492] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:21:54.315164 26593 leader_election.cc:290] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:21:54.316561 26588 ts_tablet_manager.cc:1403] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.130s	user 0.030s	sys 0.035s
I20260709 13:21:54.318251 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7908957d3f848418cc01e408814977d" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
W20260709 13:21:54.320227 26437 leader_election.cc:343] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc109b784081414e8f56d12601021038 (127.15.242.67:33635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.321904 26437 leader_election.cc:304] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038
I20260709 13:21:54.323241 26592 raft_consensus.cc:2749] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.321452 26588 raft_consensus.cc:359] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.324637 26588 raft_consensus.cc:385] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.325084 26588 raft_consensus.cc:740] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.326138 26585 tablet_bootstrap.cc:492] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:21:54.326928 26585 ts_tablet_manager.cc:1403] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.015s
I20260709 13:21:54.326207 26588 consensus_queue.cc:260] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.328718 26586 tablet_bootstrap.cc:492] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:21:54.328828 26588 ts_tablet_manager.cc:1434] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:21:54.329402 26586 ts_tablet_manager.cc:1403] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.021s
I20260709 13:21:54.330338 26588 tablet_bootstrap.cc:492] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:21:54.333196 26586 raft_consensus.cc:359] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.333767 26586 raft_consensus.cc:385] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.334025 26586 raft_consensus.cc:740] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.335855 26585 raft_consensus.cc:359] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.336879 26585 raft_consensus.cc:385] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.337466 26585 raft_consensus.cc:740] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.337364 26586 consensus_queue.cc:260] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.338939 26585 consensus_queue.cc:260] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.341060 26588 tablet_bootstrap.cc:654] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.342420 26585 ts_tablet_manager.cc:1434] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:21:54.343770 26585 tablet_bootstrap.cc:492] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:21:54.348315 26586 ts_tablet_manager.cc:1434] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:21:54.351123 26585 tablet_bootstrap.cc:654] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.353878 26588 tablet_bootstrap.cc:492] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:21:54.354444 26588 ts_tablet_manager.cc:1403] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.013s
I20260709 13:21:54.357589 26588 raft_consensus.cc:359] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.358497 26588 raft_consensus.cc:385] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.358796 26588 raft_consensus.cc:740] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.359724 26588 consensus_queue.cc:260] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.363579 26588 ts_tablet_manager.cc:1434] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:21:54.364820 26588 tablet_bootstrap.cc:492] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:21:54.359722 26586 tablet_bootstrap.cc:492] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:21:54.372105 26588 tablet_bootstrap.cc:654] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.377485 26588 tablet_bootstrap.cc:492] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:21:54.377974 26588 ts_tablet_manager.cc:1403] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:21:54.381021 26588 raft_consensus.cc:359] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.381747 26588 raft_consensus.cc:385] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.382045 26588 raft_consensus.cc:740] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.383028 26588 consensus_queue.cc:260] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.385459 26588 ts_tablet_manager.cc:1434] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:54.385231 26396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d23b56b7c544b9a1ed8ea154954a29" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:21:54.386781 26588 tablet_bootstrap.cc:492] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
W20260709 13:21:54.387621 26508 leader_election.cc:343] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.391251 26586 tablet_bootstrap.cc:654] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.396757 26585 tablet_bootstrap.cc:492] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:21:54.396972 26588 tablet_bootstrap.cc:654] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.397475 26585 ts_tablet_manager.cc:1403] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.054s	user 0.028s	sys 0.022s
I20260709 13:21:54.401888 26585 raft_consensus.cc:359] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.402963 26585 raft_consensus.cc:385] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.403357 26585 raft_consensus.cc:740] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.404552 26585 consensus_queue.cc:260] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.407670 26585 ts_tablet_manager.cc:1434] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:21:54.409184 26585 tablet_bootstrap.cc:492] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:21:54.419952 26585 tablet_bootstrap.cc:654] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.429433 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d23b56b7c544b9a1ed8ea154954a29" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
W20260709 13:21:54.432449 26509 leader_election.cc:343] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.433082 26509 leader_election.cc:304] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc109b784081414e8f56d12601021038; no voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa
I20260709 13:21:54.434305 26593 raft_consensus.cc:2749] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.434653 26585 tablet_bootstrap.cc:492] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:21:54.435142 26586 tablet_bootstrap.cc:492] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:21:54.435232 26588 tablet_bootstrap.cc:492] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:21:54.435252 26585 ts_tablet_manager.cc:1403] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.011s
I20260709 13:21:54.435842 26586 ts_tablet_manager.cc:1403] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.076s	user 0.028s	sys 0.025s
I20260709 13:21:54.435966 26588 ts_tablet_manager.cc:1403] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.028s
I20260709 13:21:54.438313 26585 raft_consensus.cc:359] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.438956 26585 raft_consensus.cc:385] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.439224 26585 raft_consensus.cc:740] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.439232 26588 raft_consensus.cc:359] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.439461 26586 raft_consensus.cc:359] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:54.439983 26585 consensus_queue.cc:260] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.440201 26588 raft_consensus.cc:385] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.440251 26586 raft_consensus.cc:385] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.440920 26588 raft_consensus.cc:740] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.440960 26586 raft_consensus.cc:740] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.441977 26588 consensus_queue.cc:260] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.443622 26585 ts_tablet_manager.cc:1434] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:54.444393 26588 ts_tablet_manager.cc:1434] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:54.442101 26586 consensus_queue.cc:260] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:54.445500 26588 tablet_bootstrap.cc:492] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:21:54.447019 26586 ts_tablet_manager.cc:1434] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:21:54.448237 26586 tablet_bootstrap.cc:492] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:21:54.444922 26585 tablet_bootstrap.cc:492] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:21:54.453850 26588 tablet_bootstrap.cc:654] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.455168 26586 tablet_bootstrap.cc:654] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.459278 26592 raft_consensus.cc:493] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.459838 26592 raft_consensus.cc:515] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.464811 26592 leader_election.cc:290] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.459820 26585 tablet_bootstrap.cc:654] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.466423 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a08b742ec4334a594fd79f3659ada" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:21:54.467464 26545 raft_consensus.cc:2468] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 0.
I20260709 13:21:54.468608 26396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a08b742ec4334a594fd79f3659ada" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:21:54.470570 26437 leader_election.cc:304] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:54.471886 26592 raft_consensus.cc:2804] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.472373 26592 raft_consensus.cc:493] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.472805 26592 raft_consensus.cc:3060] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:54.478991 26434 leader_election.cc:343] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.480509 26585 tablet_bootstrap.cc:492] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:21:54.481405 26585 ts_tablet_manager.cc:1403] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.001s
I20260709 13:21:54.486320 26585 raft_consensus.cc:359] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.487654 26585 raft_consensus.cc:385] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.488222 26585 raft_consensus.cc:740] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.490011 26585 consensus_queue.cc:260] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.502888 26593 raft_consensus.cc:493] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.503710 26593 raft_consensus.cc:515] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.514699 26396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea1805d9bc47c9b613ab623731e1f7" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
W20260709 13:21:54.516888 26508 leader_election.cc:343] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.522620 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea1805d9bc47c9b613ab623731e1f7" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
W20260709 13:21:54.525102 26509 leader_election.cc:343] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.525835 26509 leader_election.cc:304] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc109b784081414e8f56d12601021038; no voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa
I20260709 13:21:54.531764 26593 leader_election.cc:290] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:21:54.539942 26592 raft_consensus.cc:515] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.546380 26593 raft_consensus.cc:493] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.547434 26593 raft_consensus.cc:515] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.566653 26396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6047b437ca3f41bf9665b38f2bf4add6" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
W20260709 13:21:54.569061 26508 leader_election.cc:343] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.571491 26614 raft_consensus.cc:2749] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.572476 26614 raft_consensus.cc:493] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.573112 26614 raft_consensus.cc:515] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:54.577427 26588 tablet_bootstrap.cc:492] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:21:54.577931 26588 ts_tablet_manager.cc:1403] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.133s	user 0.045s	sys 0.084s
I20260709 13:21:54.578238 26594 raft_consensus.cc:493] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.579013 26594 raft_consensus.cc:515] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.581879 26588 raft_consensus.cc:359] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:54.582834 26588 raft_consensus.cc:385] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.583182 26588 raft_consensus.cc:740] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.584271 26588 consensus_queue.cc:260] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:54.585341 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6047b437ca3f41bf9665b38f2bf4add6" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
W20260709 13:21:54.587606 26509 leader_election.cc:343] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.588271 26509 leader_election.cc:304] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc109b784081414e8f56d12601021038; no voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa
I20260709 13:21:54.592651 26586 tablet_bootstrap.cc:492] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:21:54.593108 26592 leader_election.cc:290] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.593470 26586 ts_tablet_manager.cc:1403] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.145s	user 0.040s	sys 0.086s
I20260709 13:21:54.589762 26613 raft_consensus.cc:2749] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.594484 26593 leader_election.cc:290] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:21:54.594129 26594 leader_election.cc:290] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.619840 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a08b742ec4334a594fd79f3659ada" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:54.613408 26592 raft_consensus.cc:493] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.624171 26594 raft_consensus.cc:493] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.626231 26592 raft_consensus.cc:515] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.629779 26594 raft_consensus.cc:515] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.631268 26614 leader_election.cc:290] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:21:54.624835 26545 raft_consensus.cc:3060] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.632997 26586 raft_consensus.cc:359] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.636715 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d777176544b4503aa820d1ea113c030" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:21:54.638659 26471 raft_consensus.cc:2468] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 0.
I20260709 13:21:54.640780 26509 leader_election.cc:304] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:54.642268 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:21:54.643272 26594 leader_election.cc:290] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.644560 26396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d777176544b4503aa820d1ea113c030" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:21:54.645344 26396 raft_consensus.cc:2468] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 0.
I20260709 13:21:54.646006 26618 raft_consensus.cc:493] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.646715 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a08b742ec4334a594fd79f3659ada" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:21:54.647253 26592 leader_election.cc:290] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.647455 26618 raft_consensus.cc:515] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:54.648643 26394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:21:54.642375 26586 raft_consensus.cc:385] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.649425 26394 raft_consensus.cc:2468] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 0.
I20260709 13:21:54.650867 26588 ts_tablet_manager.cc:1434] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.073s	user 0.027s	sys 0.036s
I20260709 13:21:54.649758 26586 raft_consensus.cc:740] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.651764 26585 ts_tablet_manager.cc:1434] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.170s	user 0.042s	sys 0.081s
I20260709 13:21:54.652329 26586 consensus_queue.cc:260] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
W20260709 13:21:54.648279 26437 leader_election.cc:343] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc109b784081414e8f56d12601021038 (127.15.242.67:33635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.661876 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4f09dd99e42179348398f40bc0b85" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:21:54.642283 26614 raft_consensus.cc:2804] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.662585 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:21:54.662724 26434 leader_election.cc:304] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: cc109b784081414e8f56d12601021038
I20260709 13:21:54.663300 26470 raft_consensus.cc:2468] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:21:54.663470 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d777176544b4503aa820d1ea113c030" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:21:54.663524 26592 raft_consensus.cc:493] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:54.664188 26434 leader_election.cc:343] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.664268 26469 raft_consensus.cc:2468] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:21:54.652138 26588 tablet_bootstrap.cc:492] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:21:54.662752 26471 raft_consensus.cc:2468] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:21:54.653030 26585 tablet_bootstrap.cc:492] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:21:54.660059 26618 leader_election.cc:290] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc109b784081414e8f56d12601021038 (127.15.242.67:33635), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:21:54.663025 26614 raft_consensus.cc:493] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.667590 26614 raft_consensus.cc:3060] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.668584 26586 ts_tablet_manager.cc:1434] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.000s
I20260709 13:21:54.664827 26360 leader_election.cc:304] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:21:54.669059 26616 raft_consensus.cc:2804] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.670259 26616 raft_consensus.cc:493] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.670652 26616 raft_consensus.cc:3060] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.672601 26588 tablet_bootstrap.cc:654] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.673296 26586 tablet_bootstrap.cc:492] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:21:54.664367 26592 raft_consensus.cc:515] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.646013 26545 raft_consensus.cc:2468] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 1.
I20260709 13:21:54.675247 26437 leader_election.cc:304] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 3b34bd6ec671409d9e228156d3e81d08
I20260709 13:21:54.680055 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4f09dd99e42179348398f40bc0b85" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:21:54.680824 26545 raft_consensus.cc:2468] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:21:54.683030 26614 raft_consensus.cc:515] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:54.685235 26592 leader_election.cc:290] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.685907 26592 raft_consensus.cc:2804] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.686416 26592 raft_consensus.cc:697] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Becoming Leader. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:21:54.686450 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:21:54.687348 26594 raft_consensus.cc:2804] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.687716 26585 tablet_bootstrap.cc:654] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.688138 26594 raft_consensus.cc:493] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.687904 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d777176544b4503aa820d1ea113c030" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:21:54.688650 26594 raft_consensus.cc:3060] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.689220 26544 raft_consensus.cc:2393] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34bd6ec671409d9e228156d3e81d08 in current term 1: Already voted for candidate cc109b784081414e8f56d12601021038 in this term.
I20260709 13:21:54.689538 26362 leader_election.cc:304] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038; no voters: 
W20260709 13:21:54.690618 26362 leader_election.cc:343] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc109b784081414e8f56d12601021038 (127.15.242.67:33635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.686765 26586 tablet_bootstrap.cc:654] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.692444 26618 raft_consensus.cc:2804] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.692965 26618 raft_consensus.cc:493] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.693439 26618 raft_consensus.cc:3060] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.701180 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d777176544b4503aa820d1ea113c030" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:21:54.701944 26614 leader_election.cc:290] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:21:54.702116 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d777176544b4503aa820d1ea113c030" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:21:54.702147 26471 raft_consensus.cc:3060] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.705997 26588 tablet_bootstrap.cc:492] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:21:54.706696 26395 raft_consensus.cc:3060] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.713476 26616 raft_consensus.cc:515] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.717849 26471 raft_consensus.cc:2468] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 1.
I20260709 13:21:54.719957 26509 leader_election.cc:304] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:54.721190 26614 raft_consensus.cc:2804] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.721946 26592 consensus_queue.cc:237] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.722747 26616 leader_election.cc:290] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.721956 26614 raft_consensus.cc:697] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Becoming Leader. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:21:54.717792 26594 raft_consensus.cc:515] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.725996 26588 ts_tablet_manager.cc:1403] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.009s
I20260709 13:21:54.724462 26614 consensus_queue.cc:237] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:54.726795 26394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a997e7b3074942dda1c719a2364af4da" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:21:54.727990 26360 leader_election.cc:304] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: cc109b784081414e8f56d12601021038
I20260709 13:21:54.728749 26394 raft_consensus.cc:2468] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 0.
I20260709 13:21:54.725522 26594 leader_election.cc:290] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.730012 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
W20260709 13:21:54.730374 26437 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:33635, user_credentials={real_user=slave}} blocked reactor thread for 55226us
W20260709 13:21:54.731756 26362 leader_election.cc:343] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc109b784081414e8f56d12601021038 (127.15.242.67:33635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.732712 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:54.732751 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a997e7b3074942dda1c719a2364af4da" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:21:54.733006 26395 raft_consensus.cc:2468] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 1.
I20260709 13:21:54.733887 26586 tablet_bootstrap.cc:492] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
W20260709 13:21:54.734320 26437 leader_election.cc:343] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc109b784081414e8f56d12601021038 (127.15.242.67:33635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.734484 26586 ts_tablet_manager.cc:1403] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.002s
I20260709 13:21:54.734678 26594 raft_consensus.cc:2764] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:21:54.738806 26585 tablet_bootstrap.cc:492] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:21:54.739369 26585 ts_tablet_manager.cc:1403] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.005s
W20260709 13:21:54.735997 26437 leader_election.cc:343] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc109b784081414e8f56d12601021038 (127.15.242.67:33635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.740124 26588 raft_consensus.cc:359] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.740928 26588 raft_consensus.cc:385] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.741235 26588 raft_consensus.cc:740] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.742008 26588 consensus_queue.cc:260] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.746814 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:21:54.747562 26586 raft_consensus.cc:359] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.748412 26586 raft_consensus.cc:385] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.748509 26588 ts_tablet_manager.cc:1434] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:21:54.748752 26586 raft_consensus.cc:740] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.748838 26395 raft_consensus.cc:2393] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 44056cb5a49d4c92b2e2e120f0f233fa in current term 1: Already voted for candidate 3b34bd6ec671409d9e228156d3e81d08 in this term.
I20260709 13:21:54.749606 26586 consensus_queue.cc:260] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.752611 26586 ts_tablet_manager.cc:1434] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:21:54.742983 26585 raft_consensus.cc:359] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.743546 26434 leader_election.cc:304] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: cc109b784081414e8f56d12601021038
I20260709 13:21:54.753161 26585 raft_consensus.cc:385] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.753515 26585 raft_consensus.cc:740] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.753697 26586 tablet_bootstrap.cc:492] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:21:54.754340 26434 leader_election.cc:304] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038
I20260709 13:21:54.754413 26585 consensus_queue.cc:260] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.756079 26616 raft_consensus.cc:2804] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.756454 26616 raft_consensus.cc:493] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.756840 26616 raft_consensus.cc:3060] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.759078 26588 tablet_bootstrap.cc:492] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:21:54.759711 26619 raft_consensus.cc:2749] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.758330 26291 catalog_manager.cc:5697] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc109b784081414e8f56d12601021038 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "cc109b784081414e8f56d12601021038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.761694 26586 tablet_bootstrap.cc:654] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.744886 26618 raft_consensus.cc:515] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.765228 26618 leader_election.cc:290] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.743963 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:21:54.767459 26471 raft_consensus.cc:2393] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34bd6ec671409d9e228156d3e81d08 in current term 1: Already voted for candidate 44056cb5a49d4c92b2e2e120f0f233fa in this term.
I20260709 13:21:54.767704 26588 tablet_bootstrap.cc:654] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.769611 26360 leader_election.cc:304] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08; no voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038
I20260709 13:21:54.767616 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4f09dd99e42179348398f40bc0b85" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:54.771725 26545 raft_consensus.cc:3060] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.772028 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4f09dd99e42179348398f40bc0b85" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:21:54.772396 26585 ts_tablet_manager.cc:1434] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:21:54.772682 26469 raft_consensus.cc:3060] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.774164 26585 tablet_bootstrap.cc:492] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:21:54.779332 26618 raft_consensus.cc:2749] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.785137 26585 tablet_bootstrap.cc:654] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.786763 26469 raft_consensus.cc:2468] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:21:54.788079 26360 leader_election.cc:304] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:21:54.789004 26618 raft_consensus.cc:2804] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.789574 26618 raft_consensus.cc:697] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:21:54.789847 26545 raft_consensus.cc:2468] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:21:54.790623 26618 consensus_queue.cc:237] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.794325 26594 raft_consensus.cc:493] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.795589 26588 tablet_bootstrap.cc:492] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:21:54.795122 26594 raft_consensus.cc:515] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.796376 26588 ts_tablet_manager.cc:1403] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.000s
I20260709 13:21:54.798827 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7908957d3f848418cc01e408814977d" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:21:54.799589 26471 raft_consensus.cc:2468] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:21:54.800949 26360 leader_election.cc:304] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:21:54.800947 26588 raft_consensus.cc:359] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.802058 26623 raft_consensus.cc:2804] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.802412 26588 raft_consensus.cc:385] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.802640 26623 raft_consensus.cc:493] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.803088 26588 raft_consensus.cc:740] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.803318 26623 raft_consensus.cc:3060] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.806811 26588 consensus_queue.cc:260] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.809943 26588 ts_tablet_manager.cc:1434] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:21:54.811465 26588 tablet_bootstrap.cc:492] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:21:54.812464 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7908957d3f848418cc01e408814977d" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:21:54.813215 26545 raft_consensus.cc:2468] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:21:54.814847 26594 leader_election.cc:290] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.816305 26586 tablet_bootstrap.cc:492] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:21:54.816988 26586 ts_tablet_manager.cc:1403] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.022s
I20260709 13:21:54.816802 26290 catalog_manager.cc:5697] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66). New cstate: current_term: 1 leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.820459 26586 raft_consensus.cc:359] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.821259 26586 raft_consensus.cc:385] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.821571 26586 raft_consensus.cc:740] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.822219 26616 raft_consensus.cc:515] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.824307 26586 consensus_queue.cc:260] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.827736 26586 ts_tablet_manager.cc:1434] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:21:54.829298 26586 tablet_bootstrap.cc:492] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:21:54.830322 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a997e7b3074942dda1c719a2364af4da" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:21:54.831065 26395 raft_consensus.cc:3060] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.827262 26623 raft_consensus.cc:515] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.834658 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7908957d3f848418cc01e408814977d" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:21:54.835870 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a997e7b3074942dda1c719a2364af4da" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
W20260709 13:21:54.837342 26437 leader_election.cc:343] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc109b784081414e8f56d12601021038 (127.15.242.67:33635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.835480 26469 raft_consensus.cc:3060] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.839144 26588 tablet_bootstrap.cc:654] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.844462 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7908957d3f848418cc01e408814977d" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:54.845244 26545 raft_consensus.cc:3060] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.846398 26586 tablet_bootstrap.cc:654] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.848734 26395 raft_consensus.cc:2468] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 1.
I20260709 13:21:54.853976 26545 raft_consensus.cc:2468] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:21:54.859671 26434 leader_election.cc:304] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: cc109b784081414e8f56d12601021038
I20260709 13:21:54.867023 26592 raft_consensus.cc:2804] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.867774 26592 raft_consensus.cc:697] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Becoming Leader. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:21:54.868970 26592 consensus_queue.cc:237] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.854142 26623 leader_election.cc:290] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.877938 26362 leader_election.cc:304] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:54.879619 26585 tablet_bootstrap.cc:492] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:21:54.880089 26623 raft_consensus.cc:2804] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.880365 26585 ts_tablet_manager.cc:1403] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.107s	user 0.028s	sys 0.044s
I20260709 13:21:54.880896 26623 raft_consensus.cc:697] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:21:54.882331 26623 consensus_queue.cc:237] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.884195 26585 raft_consensus.cc:359] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.830541 26616 leader_election.cc:290] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.885190 26585 raft_consensus.cc:385] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.885607 26585 raft_consensus.cc:740] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.886986 26469 raft_consensus.cc:2468] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:21:54.886745 26585 consensus_queue.cc:260] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.893934 26585 ts_tablet_manager.cc:1434] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:21:54.895473 26585 tablet_bootstrap.cc:492] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:21:54.903594 26585 tablet_bootstrap.cc:654] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.917086 26292 catalog_manager.cc:5697] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.922413 26290 catalog_manager.cc:5697] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66). New cstate: current_term: 1 leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.944412 26588 tablet_bootstrap.cc:492] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:21:54.945019 26588 ts_tablet_manager.cc:1403] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.134s	user 0.021s	sys 0.013s
I20260709 13:21:54.946385 26585 tablet_bootstrap.cc:492] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:21:54.946587 26586 tablet_bootstrap.cc:492] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:21:54.946923 26585 ts_tablet_manager.cc:1403] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.009s
I20260709 13:21:54.947202 26586 ts_tablet_manager.cc:1403] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.118s	user 0.034s	sys 0.043s
I20260709 13:21:54.948061 26588 raft_consensus.cc:359] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.948771 26588 raft_consensus.cc:385] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.949059 26588 raft_consensus.cc:740] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.949877 26588 consensus_queue.cc:260] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.950414 26616 raft_consensus.cc:493] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.949905 26585 raft_consensus.cc:359] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.951272 26585 raft_consensus.cc:385] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.951184 26616 raft_consensus.cc:515] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.951650 26586 raft_consensus.cc:359] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.952493 26586 raft_consensus.cc:385] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.952853 26586 raft_consensus.cc:740] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.953667 26588 ts_tablet_manager.cc:1434] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:21:54.953719 26586 consensus_queue.cc:260] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.954726 26616 leader_election.cc:290] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.954891 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea1805d9bc47c9b613ab623731e1f7" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:21:54.955415 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea1805d9bc47c9b613ab623731e1f7" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:21:54.955713 26395 raft_consensus.cc:2468] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 0.
I20260709 13:21:54.955971 26545 raft_consensus.cc:2468] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 0.
I20260709 13:21:54.951674 26585 raft_consensus.cc:740] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.957247 26437 leader_election.cc:304] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:54.957554 26585 consensus_queue.cc:260] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.956664 26586 ts_tablet_manager.cc:1434] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:21:54.958458 26616 raft_consensus.cc:2804] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.959153 26616 raft_consensus.cc:493] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.959635 26616 raft_consensus.cc:3060] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.959796 26614 raft_consensus.cc:493] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.960361 26585 ts_tablet_manager.cc:1434] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:21:54.960390 26614 raft_consensus.cc:515] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.963759 26614 leader_election.cc:290] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:21:54.964536 26586 tablet_bootstrap.cc:492] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:21:54.965085 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:21:54.966069 26469 raft_consensus.cc:2393] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc109b784081414e8f56d12601021038 in current term 1: Already voted for candidate 44056cb5a49d4c92b2e2e120f0f233fa in this term.
I20260709 13:21:54.968088 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:21:54.969192 26395 raft_consensus.cc:2393] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc109b784081414e8f56d12601021038 in current term 1: Already voted for candidate 3b34bd6ec671409d9e228156d3e81d08 in this term.
I20260709 13:21:54.970865 26508 leader_election.cc:304] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc109b784081414e8f56d12601021038; no voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa
I20260709 13:21:54.972376 26614 raft_consensus.cc:3060] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.977519 26586 tablet_bootstrap.cc:654] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.976714 26616 raft_consensus.cc:515] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:54.971299 26292 catalog_manager.cc:5697] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.980386 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea1805d9bc47c9b613ab623731e1f7" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:21:54.980991 26395 raft_consensus.cc:3060] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.983914 26616 leader_election.cc:290] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:54.985399 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea1805d9bc47c9b613ab623731e1f7" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:54.986135 26545 raft_consensus.cc:3060] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.991400 26395 raft_consensus.cc:2468] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 1.
I20260709 13:21:54.993253 26434 leader_election.cc:304] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:21:54.994602 26616 raft_consensus.cc:2804] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.994968 26545 raft_consensus.cc:2468] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 1.
I20260709 13:21:54.995369 26616 raft_consensus.cc:697] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Becoming Leader. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:21:54.996613 26616 consensus_queue.cc:237] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.009405 26614 raft_consensus.cc:2749] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.013223 26586 tablet_bootstrap.cc:492] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:21:55.013710 26586 ts_tablet_manager.cc:1403] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.031s
I20260709 13:21:55.014550 26290 catalog_manager.cc:5697] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66). New cstate: current_term: 1 leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.016002 26586 raft_consensus.cc:359] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.016538 26586 raft_consensus.cc:385] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.016749 26586 raft_consensus.cc:740] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.017390 26586 consensus_queue.cc:260] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.019449 26586 ts_tablet_manager.cc:1434] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:21:55.020310 26586 tablet_bootstrap.cc:492] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:21:55.026374 26586 tablet_bootstrap.cc:654] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.031143 26586 tablet_bootstrap.cc:492] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:21:55.031563 26586 ts_tablet_manager.cc:1403] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:21:55.033819 26586 raft_consensus.cc:359] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.034397 26586 raft_consensus.cc:385] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.034577 26586 raft_consensus.cc:740] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.035123 26586 consensus_queue.cc:260] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.036821 26586 ts_tablet_manager.cc:1434] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:55.048627 26623 raft_consensus.cc:493] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.049326 26623 raft_consensus.cc:515] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.051350 26623 leader_election.cc:290] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:55.052207 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d23b56b7c544b9a1ed8ea154954a29" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:21:55.052471 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d23b56b7c544b9a1ed8ea154954a29" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:21:55.052980 26469 raft_consensus.cc:2468] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:21:55.053104 26545 raft_consensus.cc:2468] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:21:55.054121 26360 leader_election.cc:304] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:21:55.054895 26623 raft_consensus.cc:2804] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.055313 26623 raft_consensus.cc:493] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.055634 26623 raft_consensus.cc:3060] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.061502 26623 raft_consensus.cc:515] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.063349 26623 leader_election.cc:290] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:55.064589 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d23b56b7c544b9a1ed8ea154954a29" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:21:55.064661 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d23b56b7c544b9a1ed8ea154954a29" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:55.065254 26469 raft_consensus.cc:3060] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.065781 26545 raft_consensus.cc:3060] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.070981 26469 raft_consensus.cc:2468] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:21:55.072109 26545 raft_consensus.cc:2468] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:21:55.072284 26360 leader_election.cc:304] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:21:55.073376 26623 raft_consensus.cc:2804] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.073858 26623 raft_consensus.cc:697] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:21:55.074676 26623 consensus_queue.cc:237] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.081609 26614 raft_consensus.cc:493] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.082293 26614 raft_consensus.cc:515] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.083343 26290 catalog_manager.cc:5697] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.084049 26614 leader_election.cc:290] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:21:55.084919 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a997e7b3074942dda1c719a2364af4da" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:21:55.085316 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a997e7b3074942dda1c719a2364af4da" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:21:55.085749 26395 raft_consensus.cc:2393] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc109b784081414e8f56d12601021038 in current term 1: Already voted for candidate 44056cb5a49d4c92b2e2e120f0f233fa in this term.
I20260709 13:21:55.086992 26508 leader_election.cc:304] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc109b784081414e8f56d12601021038; no voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa
I20260709 13:21:55.087843 26614 raft_consensus.cc:3060] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.094967 26614 raft_consensus.cc:2749] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.142449 26616 consensus_queue.cc:1048] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.155529 26395 raft_consensus.cc:3060] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.159479 26614 consensus_queue.cc:1048] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:55.164928 26623 raft_consensus.cc:493] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.165603 26623 raft_consensus.cc:515] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.166374 26592 consensus_queue.cc:1048] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.169821 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a08b742ec4334a594fd79f3659ada" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:21:55.173378 26623 leader_election.cc:290] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:55.174259 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a08b742ec4334a594fd79f3659ada" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:21:55.175716 26362 leader_election.cc:304] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08; no voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038
I20260709 13:21:55.176442 26612 consensus_queue.cc:1048] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:55.183241 26623 raft_consensus.cc:2749] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:55.197762 26623 raft_consensus.cc:493] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.198294 26623 raft_consensus.cc:515] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.199877 26623 leader_election.cc:290] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:55.200894 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6047b437ca3f41bf9665b38f2bf4add6" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:21:55.200894 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6047b437ca3f41bf9665b38f2bf4add6" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:21:55.201886 26471 raft_consensus.cc:2468] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:21:55.202100 26545 raft_consensus.cc:2468] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:21:55.203109 26360 leader_election.cc:304] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:21:55.203850 26623 raft_consensus.cc:2804] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.204169 26623 raft_consensus.cc:493] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.204447 26623 raft_consensus.cc:3060] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.209515 26623 raft_consensus.cc:515] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.211210 26623 leader_election.cc:290] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:55.212276 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6047b437ca3f41bf9665b38f2bf4add6" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:55.212193 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6047b437ca3f41bf9665b38f2bf4add6" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:21:55.213033 26545 raft_consensus.cc:3060] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.213061 26471 raft_consensus.cc:3060] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.221590 26471 raft_consensus.cc:2468] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:21:55.221590 26545 raft_consensus.cc:2468] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:21:55.223121 26362 leader_election.cc:304] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:55.223989 26623 raft_consensus.cc:2804] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.224574 26623 raft_consensus.cc:697] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:21:55.224857 26618 consensus_queue.cc:1048] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.225435 26623 consensus_queue.cc:237] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:55.235803 26292 catalog_manager.cc:5697] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.241735 26618 consensus_queue.cc:1048] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.295370 26618 consensus_queue.cc:1048] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:55.299753 26342 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:55.308091 26618 consensus_queue.cc:1048] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:55.497079 26619 consensus_queue.cc:1048] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.497824 26592 consensus_queue.cc:1048] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.602878 26618 consensus_queue.cc:1048] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.606263 26592 consensus_queue.cc:1048] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.614528 26618 consensus_queue.cc:1048] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.622854 26619 consensus_queue.cc:1048] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.629864 26618 consensus_queue.cc:1048] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.648707 26654 consensus_queue.cc:1048] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:56.302958 26342 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:56.418757 26592 raft_consensus.cc:493] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.419374 26592 raft_consensus.cc:515] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.421216 26592 leader_election.cc:290] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:56.422403 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:21:56.422411 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:21:56.423358 26395 raft_consensus.cc:2468] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 1.
I20260709 13:21:56.423341 26545 raft_consensus.cc:2468] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 1.
I20260709 13:21:56.424765 26437 leader_election.cc:304] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:56.425653 26592 raft_consensus.cc:2804] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:56.426108 26592 raft_consensus.cc:493] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:56.426445 26592 raft_consensus.cc:3060] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.432000 26592 raft_consensus.cc:515] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.433825 26592 leader_election.cc:290] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 2 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:56.434899 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:56.434899 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:21:56.435865 26545 raft_consensus.cc:3060] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.435880 26395 raft_consensus.cc:3060] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.445184 26395 raft_consensus.cc:2468] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 2.
I20260709 13:21:56.445184 26545 raft_consensus.cc:2468] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 2.
I20260709 13:21:56.447506 26437 leader_election.cc:304] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:56.448379 26592 raft_consensus.cc:2804] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:56.448874 26592 raft_consensus.cc:697] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Becoming Leader. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:21:56.449954 26592 consensus_queue.cc:237] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.458690 26290 catalog_manager.cc:5697] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa reported cstate change: term changed from 0 to 2, leader changed from <none> to 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66). New cstate: current_term: 2 leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.617897 26545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d777176544b4503aa820d1ea113c030"
dest_uuid: "cc109b784081414e8f56d12601021038"
mode: GRACEFUL
new_leader_uuid: "3b34bd6ec671409d9e228156d3e81d08"
 from {username='slave'} at 127.0.0.1:57814
I20260709 13:21:56.618664 26545 raft_consensus.cc:606] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Received request to transfer leadership to TS 3b34bd6ec671409d9e228156d3e81d08
I20260709 13:21:56.636948 26471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69"
dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
mode: GRACEFUL
new_leader_uuid: "3b34bd6ec671409d9e228156d3e81d08"
 from {username='slave'} at 127.0.0.1:34156
I20260709 13:21:56.637455 26471 raft_consensus.cc:606] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Received request to transfer leadership to TS 3b34bd6ec671409d9e228156d3e81d08
I20260709 13:21:56.643890 26471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "500a08b742ec4334a594fd79f3659ada"
dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
mode: GRACEFUL
new_leader_uuid: "3b34bd6ec671409d9e228156d3e81d08"
 from {username='slave'} at 127.0.0.1:34156
I20260709 13:21:56.644486 26471 raft_consensus.cc:606] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Received request to transfer leadership to TS 3b34bd6ec671409d9e228156d3e81d08
I20260709 13:21:56.666867 26395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09d23b56b7c544b9a1ed8ea154954a29"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
mode: GRACEFUL
new_leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
 from {username='slave'} at 127.0.0.1:43412
I20260709 13:21:56.667441 26395 raft_consensus.cc:606] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Received request to transfer leadership to TS 44056cb5a49d4c92b2e2e120f0f233fa
I20260709 13:21:56.673786 26395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6047b437ca3f41bf9665b38f2bf4add6"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
mode: GRACEFUL
new_leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
 from {username='slave'} at 127.0.0.1:43412
I20260709 13:21:56.674451 26395 raft_consensus.cc:606] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Received request to transfer leadership to TS 44056cb5a49d4c92b2e2e120f0f233fa
I20260709 13:21:56.680097 26395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7908957d3f848418cc01e408814977d"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
mode: GRACEFUL
new_leader_uuid: "cc109b784081414e8f56d12601021038"
 from {username='slave'} at 127.0.0.1:43412
I20260709 13:21:56.680809 26395 raft_consensus.cc:606] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Received request to transfer leadership to TS cc109b784081414e8f56d12601021038
I20260709 13:21:56.685365 26675 raft_consensus.cc:993] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08: : Instructing follower cc109b784081414e8f56d12601021038 to start an election
I20260709 13:21:56.685851 26594 raft_consensus.cc:1081] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Signalling peer cc109b784081414e8f56d12601021038 to start an election
I20260709 13:21:56.688391 26544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7908957d3f848418cc01e408814977d"
dest_uuid: "cc109b784081414e8f56d12601021038"
 from {username='slave'} at 127.0.0.1:57806
I20260709 13:21:56.688954 26544 raft_consensus.cc:493] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:56.689272 26544 raft_consensus.cc:3060] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.695374 26544 raft_consensus.cc:515] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.697067 26544 leader_election.cc:290] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 2 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:21:56.698078 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7908957d3f848418cc01e408814977d" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:21:56.698230 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7908957d3f848418cc01e408814977d" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:21:56.698766 26395 raft_consensus.cc:3055] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:56.698844 26469 raft_consensus.cc:3060] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.699101 26395 raft_consensus.cc:740] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:21:56.699954 26395 consensus_queue.cc:260] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.700944 26395 raft_consensus.cc:3060] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.704895 26469 raft_consensus.cc:2468] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 2.
I20260709 13:21:56.705950 26395 raft_consensus.cc:2468] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 2.
I20260709 13:21:56.706244 26509 leader_election.cc:304] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:56.707670 26665 raft_consensus.cc:2804] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:56.708632 26665 raft_consensus.cc:697] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 2 LEADER]: Becoming Leader. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:21:56.709334 26665 consensus_queue.cc:237] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.717053 26290 catalog_manager.cc:5697] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 reported cstate change: term changed from 1 to 2, leader changed from 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65) to cc109b784081414e8f56d12601021038 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "cc109b784081414e8f56d12601021038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:56.724225 26619 raft_consensus.cc:993] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa: : Instructing follower 3b34bd6ec671409d9e228156d3e81d08 to start an election
I20260709 13:21:56.724768 26619 raft_consensus.cc:1081] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Signalling peer 3b34bd6ec671409d9e228156d3e81d08 to start an election
I20260709 13:21:56.726698 26395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "500a08b742ec4334a594fd79f3659ada"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
 from {username='slave'} at 127.0.0.1:43384
I20260709 13:21:56.727203 26395 raft_consensus.cc:493] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:56.727584 26395 raft_consensus.cc:3060] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.733166 26395 raft_consensus.cc:515] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.734367 26675 raft_consensus.cc:993] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08: : Instructing follower 44056cb5a49d4c92b2e2e120f0f233fa to start an election
I20260709 13:21:56.734939 26594 raft_consensus.cc:1081] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Signalling peer 44056cb5a49d4c92b2e2e120f0f233fa to start an election
I20260709 13:21:56.735105 26395 leader_election.cc:290] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 2 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:56.735821 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a08b742ec4334a594fd79f3659ada" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:21:56.736294 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a08b742ec4334a594fd79f3659ada" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:56.736454 26469 raft_consensus.cc:3055] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:56.736819 26471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6047b437ca3f41bf9665b38f2bf4add6"
dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
 from {username='slave'} at 127.0.0.1:34152
I20260709 13:21:56.736963 26544 raft_consensus.cc:3060] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.736919 26469 raft_consensus.cc:740] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:21:56.737421 26471 raft_consensus.cc:493] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:56.737871 26471 raft_consensus.cc:3060] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.738231 26469 consensus_queue.cc:260] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.739902 26469 raft_consensus.cc:3060] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.743400 26544 raft_consensus.cc:2468] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 2.
I20260709 13:21:56.744597 26362 leader_election.cc:304] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:56.745329 26594 raft_consensus.cc:2804] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:56.745769 26594 raft_consensus.cc:697] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:21:56.746541 26594 consensus_queue.cc:237] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.747143 26471 raft_consensus.cc:515] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.747967 26469 raft_consensus.cc:2468] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 2.
I20260709 13:21:56.750823 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6047b437ca3f41bf9665b38f2bf4add6" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:21:56.751156 26471 leader_election.cc:290] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 2 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:56.751531 26395 raft_consensus.cc:3055] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:56.751684 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6047b437ca3f41bf9665b38f2bf4add6" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:56.751976 26395 raft_consensus.cc:740] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:21:56.752954 26544 raft_consensus.cc:3060] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.753644 26395 consensus_queue.cc:260] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.755362 26395 raft_consensus.cc:3060] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.759397 26544 raft_consensus.cc:2468] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 2.
I20260709 13:21:56.758602 26290 catalog_manager.cc:5697] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 1 to 2, leader changed from 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66) to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.762398 26437 leader_election.cc:304] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:56.763190 26619 raft_consensus.cc:2804] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:56.763657 26619 raft_consensus.cc:697] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Becoming Leader. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:21:56.763868 26395 raft_consensus.cc:2468] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 2.
I20260709 13:21:56.764487 26619 consensus_queue.cc:237] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.773600 26290 catalog_manager.cc:5697] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa reported cstate change: term changed from 1 to 2, leader changed from 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65) to 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66). New cstate: current_term: 2 leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.817777 26676 raft_consensus.cc:993] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038: : Instructing follower 3b34bd6ec671409d9e228156d3e81d08 to start an election
I20260709 13:21:56.818347 26665 raft_consensus.cc:1081] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Signalling peer 3b34bd6ec671409d9e228156d3e81d08 to start an election
I20260709 13:21:56.820219 26395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d777176544b4503aa820d1ea113c030"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
 from {username='slave'} at 127.0.0.1:43398
I20260709 13:21:56.821048 26395 raft_consensus.cc:493] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:56.821453 26395 raft_consensus.cc:3060] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.829079 26395 raft_consensus.cc:515] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:56.831295 26395 leader_election.cc:290] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 2 election: Requested vote from peers cc109b784081414e8f56d12601021038 (127.15.242.67:33635), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:21:56.832306 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d777176544b4503aa820d1ea113c030" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:56.832602 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d777176544b4503aa820d1ea113c030" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:21:56.833042 26544 raft_consensus.cc:3055] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:56.833417 26544 raft_consensus.cc:740] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:21:56.833477 26471 raft_consensus.cc:3060] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.834236 26544 consensus_queue.cc:260] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:56.835342 26544 raft_consensus.cc:3060] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.840353 26471 raft_consensus.cc:2468] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 2.
I20260709 13:21:56.841845 26360 leader_election.cc:304] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:21:56.842156 26544 raft_consensus.cc:2468] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 2.
I20260709 13:21:56.843043 26594 raft_consensus.cc:2804] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:56.843756 26594 raft_consensus.cc:697] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:21:56.844732 26594 consensus_queue.cc:237] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:21:56.853422 26290 catalog_manager.cc:5697] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 1 to 2, leader changed from cc109b784081414e8f56d12601021038 (127.15.242.67) to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.860234 26395 raft_consensus.cc:1275] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Refusing update from remote peer 44056cb5a49d4c92b2e2e120f0f233fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:56.862223 26619 consensus_queue.cc:1048] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.870167 26592 raft_consensus.cc:993] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa: : Instructing follower 3b34bd6ec671409d9e228156d3e81d08 to start an election
I20260709 13:21:56.871079 26619 raft_consensus.cc:1081] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Signalling peer 3b34bd6ec671409d9e228156d3e81d08 to start an election
I20260709 13:21:56.873046 26394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
 from {username='slave'} at 127.0.0.1:43384
I20260709 13:21:56.876976 26394 raft_consensus.cc:493] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:56.877473 26394 raft_consensus.cc:3060] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:56.878459 26544 raft_consensus.cc:1275] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Refusing update from remote peer 44056cb5a49d4c92b2e2e120f0f233fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:56.880142 26682 consensus_queue.cc:1048] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.888447 26394 raft_consensus.cc:515] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.893651 26394 leader_election.cc:290] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 3 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:56.894495 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:21:56.895241 26471 raft_consensus.cc:3055] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:56.895598 26471 raft_consensus.cc:740] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:21:56.896484 26471 consensus_queue.cc:260] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.897791 26471 raft_consensus.cc:3060] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:56.898932 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31d79fbf0f741c8a12aae40574ead69" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:56.899674 26544 raft_consensus.cc:3060] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:56.907027 26544 raft_consensus.cc:2468] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 3.
I20260709 13:21:56.907423 26471 raft_consensus.cc:2468] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 3.
I20260709 13:21:56.908177 26362 leader_election.cc:304] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:56.909345 26594 raft_consensus.cc:2804] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:56.909937 26594 raft_consensus.cc:697] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:21:56.910790 26594 consensus_queue.cc:237] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:56.918602 26292 catalog_manager.cc:5697] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 2 to 3, leader changed from 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66) to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 3 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.997995 26675 raft_consensus.cc:993] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08: : Instructing follower 44056cb5a49d4c92b2e2e120f0f233fa to start an election
I20260709 13:21:56.998536 26594 raft_consensus.cc:1081] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Signalling peer 44056cb5a49d4c92b2e2e120f0f233fa to start an election
I20260709 13:21:57.000367 26471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09d23b56b7c544b9a1ed8ea154954a29"
dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
 from {username='slave'} at 127.0.0.1:34152
I20260709 13:21:57.001161 26471 raft_consensus.cc:493] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:57.001652 26471 raft_consensus.cc:3060] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.011139 26471 raft_consensus.cc:515] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:57.013042 26471 leader_election.cc:290] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 2 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:21:57.014281 26394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d23b56b7c544b9a1ed8ea154954a29" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:21:57.014281 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09d23b56b7c544b9a1ed8ea154954a29" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:21:57.015203 26394 raft_consensus.cc:3055] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:57.015203 26544 raft_consensus.cc:3060] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.015822 26394 raft_consensus.cc:740] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:21:57.016700 26394 consensus_queue.cc:260] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:57.017972 26394 raft_consensus.cc:3060] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.023268 26544 raft_consensus.cc:2468] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 2.
I20260709 13:21:57.024857 26437 leader_election.cc:304] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:21:57.025228 26394 raft_consensus.cc:2468] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 2.
I20260709 13:21:57.025607 26682 raft_consensus.cc:2804] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:57.026176 26682 raft_consensus.cc:697] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Becoming Leader. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:21:57.026945 26682 consensus_queue.cc:237] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:57.035676 26292 catalog_manager.cc:5697] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa reported cstate change: term changed from 1 to 2, leader changed from 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65) to 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66). New cstate: current_term: 2 leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.171232 26394 raft_consensus.cc:1275] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Refusing update from remote peer 44056cb5a49d4c92b2e2e120f0f233fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.172650 26682 consensus_queue.cc:1048] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:57.181113 26544 raft_consensus.cc:1275] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Refusing update from remote peer 44056cb5a49d4c92b2e2e120f0f233fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.183358 26619 consensus_queue.cc:1048] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:57.190629 26471 raft_consensus.cc:1275] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Refusing update from remote peer 3b34bd6ec671409d9e228156d3e81d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.192221 26594 consensus_queue.cc:1048] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:57.204161 26544 raft_consensus.cc:1275] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Refusing update from remote peer 3b34bd6ec671409d9e228156d3e81d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.205818 26594 consensus_queue.cc:1048] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:57.217036 26394 raft_consensus.cc:1275] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Refusing update from remote peer cc109b784081414e8f56d12601021038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.219559 26665 consensus_queue.cc:1048] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:57.233273 26471 raft_consensus.cc:1275] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Refusing update from remote peer cc109b784081414e8f56d12601021038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.236239 26695 consensus_queue.cc:1048] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:57.254873 26544 raft_consensus.cc:1275] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Refusing update from remote peer 3b34bd6ec671409d9e228156d3e81d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.256177 26691 consensus_queue.cc:1048] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:57.266157 26471 raft_consensus.cc:1275] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Refusing update from remote peer 3b34bd6ec671409d9e228156d3e81d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.267732 26594 consensus_queue.cc:1048] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:57.369763 26471 raft_consensus.cc:1275] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Refusing update from remote peer 3b34bd6ec671409d9e228156d3e81d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:57.371752 26594 consensus_queue.cc:1048] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:57.379926 26544 raft_consensus.cc:1275] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Refusing update from remote peer 3b34bd6ec671409d9e228156d3e81d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:57.382246 26692 consensus_queue.cc:1048] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:57.434738 26544 raft_consensus.cc:1275] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Refusing update from remote peer 44056cb5a49d4c92b2e2e120f0f233fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.436182 26619 consensus_queue.cc:1048] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:57.446641 26394 raft_consensus.cc:1275] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Refusing update from remote peer 44056cb5a49d4c92b2e2e120f0f233fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.448654 26682 consensus_queue.cc:1048] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:59.715003 26290 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40450:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:59.717963 26290 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:59.769793 26385 tablet_service.cc:1511] Processing CreateTablet for tablet 97ef307a53034edcac0ac487f52ee392 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:59.771649 26385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ef307a53034edcac0ac487f52ee392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.771528 26454 tablet_service.cc:1511] Processing CreateTablet for tablet 97ef307a53034edcac0ac487f52ee392 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:59.773454 26454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ef307a53034edcac0ac487f52ee392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.774574 26531 tablet_service.cc:1511] Processing CreateTablet for tablet 97ef307a53034edcac0ac487f52ee392 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:59.775990 26531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ef307a53034edcac0ac487f52ee392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.775765 26380 tablet_service.cc:1511] Processing CreateTablet for tablet e7bab9a84e4b43a29b505efc3c38d0d3 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:59.777107 26380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7bab9a84e4b43a29b505efc3c38d0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.791334 26456 tablet_service.cc:1511] Processing CreateTablet for tablet e7bab9a84e4b43a29b505efc3c38d0d3 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:59.793466 26456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7bab9a84e4b43a29b505efc3c38d0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.795118 26383 tablet_service.cc:1511] Processing CreateTablet for tablet 8b18b64bd8d3442d8592aca91f89e8bc (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:59.795261 26533 tablet_service.cc:1511] Processing CreateTablet for tablet e7bab9a84e4b43a29b505efc3c38d0d3 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:59.797672 26533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7bab9a84e4b43a29b505efc3c38d0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.797246 26455 tablet_service.cc:1511] Processing CreateTablet for tablet 8b18b64bd8d3442d8592aca91f89e8bc (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:59.799178 26455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b18b64bd8d3442d8592aca91f89e8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.799817 26383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b18b64bd8d3442d8592aca91f89e8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.799201 26530 tablet_service.cc:1511] Processing CreateTablet for tablet 8b18b64bd8d3442d8592aca91f89e8bc (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:59.812026 26530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b18b64bd8d3442d8592aca91f89e8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.823786 26381 tablet_service.cc:1511] Processing CreateTablet for tablet ad0cf8a32a21450cb9a9dffa099c19a7 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:59.825256 26381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0cf8a32a21450cb9a9dffa099c19a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.829946 26461 tablet_service.cc:1511] Processing CreateTablet for tablet ad0cf8a32a21450cb9a9dffa099c19a7 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:59.831849 26461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0cf8a32a21450cb9a9dffa099c19a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.845830 26714 tablet_bootstrap.cc:492] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:21:59.847076 26527 tablet_service.cc:1511] Processing CreateTablet for tablet ad0cf8a32a21450cb9a9dffa099c19a7 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:59.847741 26380 tablet_service.cc:1511] Processing CreateTablet for tablet 4c3d0f174d27446abc3786cb8ae8bd82 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:59.848803 26527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0cf8a32a21450cb9a9dffa099c19a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.849360 26380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c3d0f174d27446abc3786cb8ae8bd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.853868 26457 tablet_service.cc:1511] Processing CreateTablet for tablet 4c3d0f174d27446abc3786cb8ae8bd82 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:59.855422 26457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c3d0f174d27446abc3786cb8ae8bd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.855990 26714 tablet_bootstrap.cc:654] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:59.858440 26528 tablet_service.cc:1511] Processing CreateTablet for tablet 4c3d0f174d27446abc3786cb8ae8bd82 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:59.861299 26528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c3d0f174d27446abc3786cb8ae8bd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.862335 26715 tablet_bootstrap.cc:492] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:21:59.884438 26715 tablet_bootstrap.cc:654] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:59.901901 26385 tablet_service.cc:1511] Processing CreateTablet for tablet ef7420c9dbfc42f3b5c811a9a7558dc6 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:59.903339 26385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7420c9dbfc42f3b5c811a9a7558dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.907660 26716 tablet_bootstrap.cc:492] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:21:59.913879 26456 tablet_service.cc:1511] Processing CreateTablet for tablet ef7420c9dbfc42f3b5c811a9a7558dc6 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:59.915418 26456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7420c9dbfc42f3b5c811a9a7558dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.919358 26379 tablet_service.cc:1511] Processing CreateTablet for tablet 339b1eaf962944b7bce912e92b8d737b (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:59.920236 26716 tablet_bootstrap.cc:654] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:59.922444 26528 tablet_service.cc:1511] Processing CreateTablet for tablet ef7420c9dbfc42f3b5c811a9a7558dc6 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:59.923012 26714 tablet_bootstrap.cc:492] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:21:59.927053 26528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7420c9dbfc42f3b5c811a9a7558dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.927922 26379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339b1eaf962944b7bce912e92b8d737b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.930370 26530 tablet_service.cc:1511] Processing CreateTablet for tablet 339b1eaf962944b7bce912e92b8d737b (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:59.933071 26378 tablet_service.cc:1511] Processing CreateTablet for tablet 2bee58fcdb6a4b74996fd1881a22b9e3 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:59.934517 26378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bee58fcdb6a4b74996fd1881a22b9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.938992 26715 tablet_bootstrap.cc:492] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:21:59.939605 26715 ts_tablet_manager.cc:1403] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.003s
I20260709 13:21:59.939823 26382 tablet_service.cc:1511] Processing CreateTablet for tablet d639d18e4da74e8c87499f56402de7f5 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:59.940169 26531 tablet_service.cc:1511] Processing CreateTablet for tablet 2bee58fcdb6a4b74996fd1881a22b9e3 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:59.941241 26382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d639d18e4da74e8c87499f56402de7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.944233 26453 tablet_service.cc:1511] Processing CreateTablet for tablet 2bee58fcdb6a4b74996fd1881a22b9e3 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:59.949280 26453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bee58fcdb6a4b74996fd1881a22b9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.949573 26715 raft_consensus.cc:359] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:59.950414 26715 raft_consensus.cc:385] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.950742 26715 raft_consensus.cc:740] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:21:59.952106 26533 tablet_service.cc:1511] Processing CreateTablet for tablet d639d18e4da74e8c87499f56402de7f5 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:59.955194 26454 tablet_service.cc:1511] Processing CreateTablet for tablet d639d18e4da74e8c87499f56402de7f5 (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:59.957088 26454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d639d18e4da74e8c87499f56402de7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.955287 26715 consensus_queue.cc:260] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:59.931734 26530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339b1eaf962944b7bce912e92b8d737b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.967070 26531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bee58fcdb6a4b74996fd1881a22b9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.967923 26455 tablet_service.cc:1511] Processing CreateTablet for tablet 339b1eaf962944b7bce912e92b8d737b (DEFAULT_TABLE table=soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:59.968881 26533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d639d18e4da74e8c87499f56402de7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.956208 26714 ts_tablet_manager.cc:1403] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.009s
I20260709 13:21:59.973281 26714 raft_consensus.cc:359] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:59.979436 26715 ts_tablet_manager.cc:1434] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:21:59.980654 26715 tablet_bootstrap.cc:492] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:21:59.969655 26455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339b1eaf962944b7bce912e92b8d737b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.986331 26695 raft_consensus.cc:493] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.986896 26695 raft_consensus.cc:515] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:59.990325 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ef307a53034edcac0ac487f52ee392" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:21:59.993124 26394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ef307a53034edcac0ac487f52ee392" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:21:59.994321 26714 raft_consensus.cc:385] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:59.994889 26509 leader_election.cc:343] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:59.994976 26714 raft_consensus.cc:740] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:21:59.995791 26695 leader_election.cc:290] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:21:59.996027 26714 consensus_queue.cc:260] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:21:59.997102 26394 raft_consensus.cc:2468] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 0.
I20260709 13:22:00.011031 26508 leader_election.cc:304] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038; no voters: 44056cb5a49d4c92b2e2e120f0f233fa
I20260709 13:22:00.012717 26695 raft_consensus.cc:2804] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.013144 26695 raft_consensus.cc:493] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.013496 26695 raft_consensus.cc:3060] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.015954 26715 tablet_bootstrap.cc:654] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.025298 26695 raft_consensus.cc:515] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.028945 26716 tablet_bootstrap.cc:492] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:22:00.042608 26716 ts_tablet_manager.cc:1403] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.135s	user 0.018s	sys 0.005s
I20260709 13:22:00.044936 26394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ef307a53034edcac0ac487f52ee392" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:22:00.045625 26394 raft_consensus.cc:3060] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.045770 26716 raft_consensus.cc:359] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.046572 26716 raft_consensus.cc:385] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.046857 26716 raft_consensus.cc:740] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.047632 26716 consensus_queue.cc:260] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.035198 26714 ts_tablet_manager.cc:1434] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 13:22:00.050495 26695 leader_election.cc:290] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:22:00.051023 26714 tablet_bootstrap.cc:492] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:22:00.051709 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ef307a53034edcac0ac487f52ee392" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:00.052389 26469 raft_consensus.cc:3060] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.059675 26394 raft_consensus.cc:2468] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 1.
I20260709 13:22:00.060319 26469 raft_consensus.cc:2468] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 1.
I20260709 13:22:00.061751 26509 leader_election.cc:304] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:00.064275 26695 raft_consensus.cc:2804] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.069891 26716 ts_tablet_manager.cc:1434] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:22:00.071588 26716 tablet_bootstrap.cc:492] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:22:00.070541 26715 tablet_bootstrap.cc:492] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:22:00.073339 26715 ts_tablet_manager.cc:1403] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.006s
I20260709 13:22:00.076566 26715 raft_consensus.cc:359] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.077734 26715 raft_consensus.cc:385] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.078111 26715 raft_consensus.cc:740] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.078341 26714 tablet_bootstrap.cc:654] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.079159 26715 consensus_queue.cc:260] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.082715 26695 raft_consensus.cc:697] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Becoming Leader. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:22:00.083757 26715 ts_tablet_manager.cc:1434] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:22:00.085152 26715 tablet_bootstrap.cc:492] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:22:00.084877 26695 consensus_queue.cc:237] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.092378 26716 tablet_bootstrap.cc:654] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.093077 26715 tablet_bootstrap.cc:654] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.097554 26714 tablet_bootstrap.cc:492] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:22:00.098114 26714 ts_tablet_manager.cc:1403] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.010s
I20260709 13:22:00.100653 26714 raft_consensus.cc:359] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.101383 26714 raft_consensus.cc:385] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.101678 26714 raft_consensus.cc:740] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.102970 26714 consensus_queue.cc:260] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.104485 26290 catalog_manager.cc:5697] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc109b784081414e8f56d12601021038 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "cc109b784081414e8f56d12601021038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:00.105715 26714 ts_tablet_manager.cc:1434] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:00.107471 26714 tablet_bootstrap.cc:492] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:22:00.108135 26716 tablet_bootstrap.cc:492] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:22:00.108750 26716 ts_tablet_manager.cc:1403] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.008s
I20260709 13:22:00.112748 26716 raft_consensus.cc:359] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.113828 26716 raft_consensus.cc:385] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.115075 26716 raft_consensus.cc:740] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.116001 26716 consensus_queue.cc:260] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.118427 26716 ts_tablet_manager.cc:1434] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.005s
I20260709 13:22:00.118609 26714 tablet_bootstrap.cc:654] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.119513 26716 tablet_bootstrap.cc:492] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:22:00.129642 26716 tablet_bootstrap.cc:654] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.121325 26715 tablet_bootstrap.cc:492] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:22:00.130591 26715 ts_tablet_manager.cc:1403] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.011s
I20260709 13:22:00.131278 26714 tablet_bootstrap.cc:492] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:22:00.131825 26714 ts_tablet_manager.cc:1403] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 13:22:00.133734 26715 raft_consensus.cc:359] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.134527 26715 raft_consensus.cc:385] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.134924 26715 raft_consensus.cc:740] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.134531 26714 raft_consensus.cc:359] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.135314 26714 raft_consensus.cc:385] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.135620 26714 raft_consensus.cc:740] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.135596 26715 consensus_queue.cc:260] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.136435 26714 consensus_queue.cc:260] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.137893 26715 ts_tablet_manager.cc:1434] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:00.138422 26714 ts_tablet_manager.cc:1434] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:22:00.139663 26714 tablet_bootstrap.cc:492] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:22:00.142951 26715 tablet_bootstrap.cc:492] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:22:00.148267 26714 tablet_bootstrap.cc:654] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.153795 26715 tablet_bootstrap.cc:654] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.165711 26691 raft_consensus.cc:493] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.165913 26715 tablet_bootstrap.cc:492] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:22:00.166595 26715 ts_tablet_manager.cc:1403] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.013s
I20260709 13:22:00.166373 26691 raft_consensus.cc:515] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.169651 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7bab9a84e4b43a29b505efc3c38d0d3" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:22:00.169724 26715 raft_consensus.cc:359] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.169895 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7bab9a84e4b43a29b505efc3c38d0d3" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:22:00.170588 26715 raft_consensus.cc:385] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.170770 26691 leader_election.cc:290] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:00.170984 26715 raft_consensus.cc:740] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.171058 26469 raft_consensus.cc:2468] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:22:00.171789 26715 consensus_queue.cc:260] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.172951 26360 leader_election.cc:304] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:22:00.170359 26545 raft_consensus.cc:2468] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:22:00.175581 26691 raft_consensus.cc:2804] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.179158 26691 raft_consensus.cc:493] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.179550 26691 raft_consensus.cc:3060] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.181077 26716 tablet_bootstrap.cc:492] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:22:00.181722 26716 ts_tablet_manager.cc:1403] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.032s
I20260709 13:22:00.183925 26715 ts_tablet_manager.cc:1434] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:22:00.185672 26716 raft_consensus.cc:359] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.186581 26716 raft_consensus.cc:385] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.187204 26716 raft_consensus.cc:740] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.188232 26716 consensus_queue.cc:260] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.191731 26714 tablet_bootstrap.cc:492] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:22:00.192673 26714 ts_tablet_manager.cc:1403] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.013s
I20260709 13:22:00.192866 26716 ts_tablet_manager.cc:1434] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:22:00.194151 26715 tablet_bootstrap.cc:492] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:22:00.194190 26716 tablet_bootstrap.cc:492] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:22:00.196019 26714 raft_consensus.cc:359] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.196830 26714 raft_consensus.cc:385] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.197132 26714 raft_consensus.cc:740] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.197933 26714 consensus_queue.cc:260] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.202540 26715 tablet_bootstrap.cc:654] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.202775 26714 ts_tablet_manager.cc:1434] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:22:00.206765 26714 tablet_bootstrap.cc:492] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:22:00.207412 26716 tablet_bootstrap.cc:654] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.211017 26691 raft_consensus.cc:515] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.216802 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7bab9a84e4b43a29b505efc3c38d0d3" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:00.217496 26469 raft_consensus.cc:3060] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.219395 26716 tablet_bootstrap.cc:492] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:22:00.219890 26714 tablet_bootstrap.cc:654] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.219980 26716 ts_tablet_manager.cc:1403] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 13:22:00.224121 26716 raft_consensus.cc:359] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.225116 26716 raft_consensus.cc:385] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.225553 26716 raft_consensus.cc:740] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.226977 26716 consensus_queue.cc:260] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.232288 26716 ts_tablet_manager.cc:1434] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.008s
I20260709 13:22:00.233421 26716 tablet_bootstrap.cc:492] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:22:00.235150 26714 tablet_bootstrap.cc:492] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:22:00.235710 26714 ts_tablet_manager.cc:1403] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.000s
I20260709 13:22:00.236994 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7bab9a84e4b43a29b505efc3c38d0d3" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:22:00.237656 26545 raft_consensus.cc:3060] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.237864 26691 leader_election.cc:290] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:00.234730 26469 raft_consensus.cc:2468] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:22:00.239749 26715 tablet_bootstrap.cc:492] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:22:00.240546 26715 ts_tablet_manager.cc:1403] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.015s
I20260709 13:22:00.244170 26716 tablet_bootstrap.cc:654] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.244374 26715 raft_consensus.cc:359] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.245484 26360 leader_election.cc:304] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:22:00.245748 26715 raft_consensus.cc:385] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.245633 26714 raft_consensus.cc:359] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.246594 26714 raft_consensus.cc:385] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.246670 26691 raft_consensus.cc:2804] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.246932 26714 raft_consensus.cc:740] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.247225 26691 raft_consensus.cc:697] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:22:00.247800 26714 consensus_queue.cc:260] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.248147 26691 consensus_queue.cc:237] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.246210 26715 raft_consensus.cc:740] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.251125 26545 raft_consensus.cc:2468] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:22:00.252503 26714 ts_tablet_manager.cc:1434] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:22:00.253054 26715 consensus_queue.cc:260] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.253643 26714 tablet_bootstrap.cc:492] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:22:00.255471 26716 tablet_bootstrap.cc:492] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:22:00.258424 26716 ts_tablet_manager.cc:1403] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 13:22:00.261706 26716 raft_consensus.cc:359] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.262825 26716 raft_consensus.cc:385] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.264484 26715 ts_tablet_manager.cc:1434] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 13:22:00.263461 26716 raft_consensus.cc:740] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.263286 26290 catalog_manager.cc:5697] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:00.265954 26715 tablet_bootstrap.cc:492] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:22:00.264737 26714 tablet_bootstrap.cc:654] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.268282 26716 consensus_queue.cc:260] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.271301 26716 ts_tablet_manager.cc:1434] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:22:00.273314 26715 tablet_bootstrap.cc:654] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.273957 26716 tablet_bootstrap.cc:492] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:22:00.285143 26716 tablet_bootstrap.cc:654] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.299021 26716 tablet_bootstrap.cc:492] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:22:00.299751 26716 ts_tablet_manager.cc:1403] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.010s
I20260709 13:22:00.303895 26716 raft_consensus.cc:359] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.304922 26716 raft_consensus.cc:385] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.305325 26716 raft_consensus.cc:740] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.306288 26716 consensus_queue.cc:260] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.309497 26716 ts_tablet_manager.cc:1434] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:00.312000 26716 tablet_bootstrap.cc:492] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:22:00.329303 26716 tablet_bootstrap.cc:654] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.339188 26695 raft_consensus.cc:493] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.340026 26695 raft_consensus.cc:515] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.341545 26716 tablet_bootstrap.cc:492] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:22:00.342132 26716 ts_tablet_manager.cc:1403] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.008s
I20260709 13:22:00.343025 26714 tablet_bootstrap.cc:492] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:22:00.344096 26714 ts_tablet_manager.cc:1403] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.052s
I20260709 13:22:00.344607 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b18b64bd8d3442d8592aca91f89e8bc" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:22:00.345306 26469 raft_consensus.cc:2468] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 0.
W20260709 13:22:00.346349 26342 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:00.346364 26716 raft_consensus.cc:359] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.346781 26509 leader_election.cc:304] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:00.347573 26714 raft_consensus.cc:359] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.347246 26394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b18b64bd8d3442d8592aca91f89e8bc" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:22:00.348414 26716 raft_consensus.cc:385] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.347409 26695 leader_election.cc:290] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:22:00.342319 26715 tablet_bootstrap.cc:492] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:22:00.348634 26714 raft_consensus.cc:385] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.348789 26716 raft_consensus.cc:740] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.348942 26721 raft_consensus.cc:2804] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.349419 26715 ts_tablet_manager.cc:1403] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.084s	user 0.032s	sys 0.041s
I20260709 13:22:00.349622 26721 raft_consensus.cc:493] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.349231 26714 raft_consensus.cc:740] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.349982 26721 raft_consensus.cc:3060] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.349877 26716 consensus_queue.cc:260] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.352510 26716 ts_tablet_manager.cc:1434] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:22:00.352826 26715 raft_consensus.cc:359] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.353569 26716 tablet_bootstrap.cc:492] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:22:00.353598 26715 raft_consensus.cc:385] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.354168 26715 raft_consensus.cc:740] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.355028 26715 consensus_queue.cc:260] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.357463 26715 ts_tablet_manager.cc:1434] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:22:00.358500 26715 tablet_bootstrap.cc:492] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:22:00.358351 26721 raft_consensus.cc:515] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.361203 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b18b64bd8d3442d8592aca91f89e8bc" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:22:00.362258 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b18b64bd8d3442d8592aca91f89e8bc" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:00.363314 26469 raft_consensus.cc:3060] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.365439 26715 tablet_bootstrap.cc:654] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.373365 26469 raft_consensus.cc:2468] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 1.
I20260709 13:22:00.374051 26721 leader_election.cc:290] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:22:00.375612 26509 leader_election.cc:304] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 3b34bd6ec671409d9e228156d3e81d08
I20260709 13:22:00.376909 26721 raft_consensus.cc:2804] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.377512 26721 raft_consensus.cc:697] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Becoming Leader. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:22:00.378420 26716 tablet_bootstrap.cc:654] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.379334 26721 consensus_queue.cc:237] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.384122 26714 consensus_queue.cc:260] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.385326 26394 raft_consensus.cc:2468] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 0.
I20260709 13:22:00.386716 26714 ts_tablet_manager.cc:1434] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.001s
I20260709 13:22:00.389564 26714 tablet_bootstrap.cc:492] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:22:00.391356 26715 tablet_bootstrap.cc:492] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:22:00.391780 26715 ts_tablet_manager.cc:1403] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.011s
I20260709 13:22:00.395720 26715 raft_consensus.cc:359] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.396451 26715 raft_consensus.cc:385] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.396747 26715 raft_consensus.cc:740] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.397406 26715 consensus_queue.cc:260] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.399185 26715 ts_tablet_manager.cc:1434] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:22:00.399294 26714 tablet_bootstrap.cc:654] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.399941 26715 tablet_bootstrap.cc:492] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:22:00.405735 26716 tablet_bootstrap.cc:492] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:22:00.406867 26716 ts_tablet_manager.cc:1403] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.010s
I20260709 13:22:00.408939 26715 tablet_bootstrap.cc:654] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.409890 26716 raft_consensus.cc:359] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.410727 26716 raft_consensus.cc:385] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.411028 26716 raft_consensus.cc:740] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.411880 26716 consensus_queue.cc:260] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.414846 26716 ts_tablet_manager.cc:1434] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:00.416218 26716 tablet_bootstrap.cc:492] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa: Bootstrap starting.
I20260709 13:22:00.421871 26691 raft_consensus.cc:493] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.422704 26691 raft_consensus.cc:515] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.427966 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d0f174d27446abc3786cb8ae8bd82" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:22:00.428174 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d0f174d27446abc3786cb8ae8bd82" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:22:00.428628 26545 raft_consensus.cc:2468] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:22:00.428833 26469 raft_consensus.cc:2468] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:22:00.429267 26716 tablet_bootstrap.cc:654] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.432446 26695 raft_consensus.cc:493] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.433154 26695 raft_consensus.cc:515] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.434506 26362 leader_election.cc:304] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:00.435493 26714 tablet_bootstrap.cc:492] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:22:00.435537 26731 raft_consensus.cc:2804] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.436084 26731 raft_consensus.cc:493] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.436143 26714 ts_tablet_manager.cc:1403] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.009s
I20260709 13:22:00.436468 26731 raft_consensus.cc:3060] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.438591 26691 leader_election.cc:290] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:00.439608 26714 raft_consensus.cc:359] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.440384 26714 raft_consensus.cc:385] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.440721 26714 raft_consensus.cc:740] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.441448 26714 consensus_queue.cc:260] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.443936 26716 tablet_bootstrap.cc:492] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa: No bootstrap required, opened a new log
I20260709 13:22:00.444725 26716 ts_tablet_manager.cc:1403] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.005s
I20260709 13:22:00.444799 26714 ts_tablet_manager.cc:1434] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:22:00.446055 26714 tablet_bootstrap.cc:492] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:22:00.448702 26716 raft_consensus.cc:359] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.449625 26716 raft_consensus.cc:385] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.450248 26716 raft_consensus.cc:740] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.451297 26716 consensus_queue.cc:260] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.455060 26716 ts_tablet_manager.cc:1434] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.002s
I20260709 13:22:00.458158 26714 tablet_bootstrap.cc:654] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.459810 26695 leader_election.cc:290] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:22:00.461841 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d639d18e4da74e8c87499f56402de7f5" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:22:00.463802 26469 raft_consensus.cc:2468] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 0.
I20260709 13:22:00.461948 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d639d18e4da74e8c87499f56402de7f5" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:22:00.465644 26509 leader_election.cc:304] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
W20260709 13:22:00.467130 26508 leader_election.cc:343] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:00.469777 26714 tablet_bootstrap.cc:492] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:22:00.470605 26714 ts_tablet_manager.cc:1403] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 13:22:00.474352 26714 raft_consensus.cc:359] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.474797 26722 raft_consensus.cc:2804] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.475327 26714 raft_consensus.cc:385] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.475521 26722 raft_consensus.cc:493] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.475800 26714 raft_consensus.cc:740] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.476157 26722 raft_consensus.cc:3060] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.476969 26714 consensus_queue.cc:260] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.479966 26714 ts_tablet_manager.cc:1434] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:00.481238 26714 tablet_bootstrap.cc:492] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08: Bootstrap starting.
I20260709 13:22:00.486297 26695 raft_consensus.cc:493] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.487690 26695 raft_consensus.cc:515] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.491855 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0cf8a32a21450cb9a9dffa099c19a7" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:22:00.492869 26395 raft_consensus.cc:2468] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 0.
I20260709 13:22:00.493041 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0cf8a32a21450cb9a9dffa099c19a7" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:22:00.494268 26469 raft_consensus.cc:2468] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 0.
I20260709 13:22:00.496731 26509 leader_election.cc:304] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:00.497740 26750 raft_consensus.cc:2804] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.498224 26750 raft_consensus.cc:493] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.498615 26750 raft_consensus.cc:3060] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.503319 26682 raft_consensus.cc:493] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.504554 26714 tablet_bootstrap.cc:654] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.504288 26682 raft_consensus.cc:515] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.508215 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b1eaf962944b7bce912e92b8d737b" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:22:00.508951 26395 raft_consensus.cc:2468] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 0.
I20260709 13:22:00.510951 26682 leader_election.cc:290] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:00.512233 26434 leader_election.cc:304] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:22:00.515566 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b1eaf962944b7bce912e92b8d737b" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
W20260709 13:22:00.517159 26437 leader_election.cc:343] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc109b784081414e8f56d12601021038 (127.15.242.67:33635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:00.515566 26682 raft_consensus.cc:2804] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.519450 26682 raft_consensus.cc:493] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.520160 26682 raft_consensus.cc:3060] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.528523 26682 raft_consensus.cc:515] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.530350 26750 raft_consensus.cc:515] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.535979 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b1eaf962944b7bce912e92b8d737b" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:22:00.537014 26395 raft_consensus.cc:3060] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.540905 26682 leader_election.cc:290] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:00.543371 26394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0cf8a32a21450cb9a9dffa099c19a7" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:22:00.544332 26394 raft_consensus.cc:3060] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.541218 26714 tablet_bootstrap.cc:492] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08: No bootstrap required, opened a new log
I20260709 13:22:00.542088 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b1eaf962944b7bce912e92b8d737b" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:22:00.554692 26714 ts_tablet_manager.cc:1403] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.029s
I20260709 13:22:00.537705 26750 leader_election.cc:290] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
W20260709 13:22:00.556488 26437 leader_election.cc:343] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc109b784081414e8f56d12601021038 (127.15.242.67:33635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:00.556893 26750 consensus_queue.cc:1048] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:00.559995 26682 raft_consensus.cc:493] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.562346 26682 raft_consensus.cc:515] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.562505 26394 raft_consensus.cc:2468] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 1.
I20260709 13:22:00.560179 26714 raft_consensus.cc:359] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.566335 26508 leader_election.cc:304] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:00.566709 26714 raft_consensus.cc:385] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.566792 26682 leader_election.cc:290] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:00.567255 26714 raft_consensus.cc:740] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.568507 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7420c9dbfc42f3b5c811a9a7558dc6" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:22:00.568233 26714 consensus_queue.cc:260] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.569213 26545 raft_consensus.cc:2468] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 0.
I20260709 13:22:00.571293 26714 ts_tablet_manager.cc:1434] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:22:00.573801 26437 leader_election.cc:304] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:00.575593 26394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7420c9dbfc42f3b5c811a9a7558dc6" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:22:00.583803 26755 raft_consensus.cc:2804] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.584260 26755 raft_consensus.cc:493] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.583904 26394 raft_consensus.cc:2468] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 0.
I20260709 13:22:00.584684 26755 raft_consensus.cc:3060] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.599323 26721 raft_consensus.cc:2804] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.599969 26721 raft_consensus.cc:697] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Becoming Leader. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:22:00.600857 26721 consensus_queue.cc:237] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.597507 26695 leader_election.cc:290] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:22:00.610248 26722 raft_consensus.cc:515] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.612366 26395 raft_consensus.cc:2468] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 1.
I20260709 13:22:00.614291 26434 leader_election.cc:304] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: cc109b784081414e8f56d12601021038
I20260709 13:22:00.616366 26691 raft_consensus.cc:493] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.617086 26691 raft_consensus.cc:515] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.619509 26722 leader_election.cc:290] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:22:00.565521 26731 raft_consensus.cc:515] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.623190 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bee58fcdb6a4b74996fd1881a22b9e3" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:22:00.623473 26753 raft_consensus.cc:2804] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.624246 26469 raft_consensus.cc:2468] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 0.
I20260709 13:22:00.624349 26753 raft_consensus.cc:697] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Becoming Leader. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:22:00.623214 26394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d639d18e4da74e8c87499f56402de7f5" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:22:00.626297 26394 raft_consensus.cc:3060] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.627517 26360 leader_election.cc:304] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:22:00.628950 26733 raft_consensus.cc:2804] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.629489 26733 raft_consensus.cc:493] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.629940 26733 raft_consensus.cc:3060] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.625690 26753 consensus_queue.cc:237] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.641144 26394 raft_consensus.cc:2468] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 1.
I20260709 13:22:00.642203 26691 leader_election.cc:290] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:00.645568 26508 leader_election.cc:304] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:00.646128 26715 tablet_bootstrap.cc:492] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:22:00.646636 26715 ts_tablet_manager.cc:1403] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.247s	user 0.085s	sys 0.150s
I20260709 13:22:00.646566 26721 raft_consensus.cc:2804] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.647253 26721 raft_consensus.cc:697] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Becoming Leader. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:22:00.648125 26721 consensus_queue.cc:237] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.650058 26715 raft_consensus.cc:359] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.650815 26715 raft_consensus.cc:385] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.651113 26715 raft_consensus.cc:740] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.651916 26715 consensus_queue.cc:260] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.654927 26715 ts_tablet_manager.cc:1434] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:00.656309 26715 tablet_bootstrap.cc:492] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038: Bootstrap starting.
I20260709 13:22:00.651964 26733 raft_consensus.cc:515] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.655086 26731 leader_election.cc:290] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:00.656262 26755 raft_consensus.cc:515] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.657480 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d0f174d27446abc3786cb8ae8bd82" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:00.658246 26469 raft_consensus.cc:3060] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.658910 26733 leader_election.cc:290] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
W20260709 13:22:00.652192 26509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:36511, user_credentials={real_user=slave}} blocked reactor thread for 133668us
I20260709 13:22:00.661309 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7420c9dbfc42f3b5c811a9a7558dc6" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:22:00.662103 26545 raft_consensus.cc:3060] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.662459 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bee58fcdb6a4b74996fd1881a22b9e3" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:00.663143 26471 raft_consensus.cc:3060] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.665012 26715 tablet_bootstrap.cc:654] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.664860 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0cf8a32a21450cb9a9dffa099c19a7" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:00.665831 26470 raft_consensus.cc:3060] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.666358 26750 raft_consensus.cc:493] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.666905 26750 raft_consensus.cc:515] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.669330 26750 leader_election.cc:290] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:22:00.671041 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7420c9dbfc42f3b5c811a9a7558dc6" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:22:00.671778 26395 raft_consensus.cc:3060] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.672379 26394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bee58fcdb6a4b74996fd1881a22b9e3" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:22:00.673280 26394 raft_consensus.cc:2393] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc109b784081414e8f56d12601021038 in current term 1: Already voted for candidate 3b34bd6ec671409d9e228156d3e81d08 in this term.
I20260709 13:22:00.660440 26755 leader_election.cc:290] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:00.684067 26750 consensus_queue.cc:1048] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:00.671104 26545 raft_consensus.cc:2468] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 1.
I20260709 13:22:00.694672 26470 raft_consensus.cc:2468] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 1.
I20260709 13:22:00.694613 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bee58fcdb6a4b74996fd1881a22b9e3" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:22:00.695829 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bee58fcdb6a4b74996fd1881a22b9e3" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038" is_pre_election: true
I20260709 13:22:00.696587 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d639d18e4da74e8c87499f56402de7f5" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:00.695851 26541 raft_consensus.cc:3060] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.697552 26468 raft_consensus.cc:3060] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.704327 26292 catalog_manager.cc:5697] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc109b784081414e8f56d12601021038 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "cc109b784081414e8f56d12601021038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:00.706665 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d0f174d27446abc3786cb8ae8bd82" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:22:00.707477 26543 raft_consensus.cc:3060] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.713406 26437 leader_election.cc:304] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:00.713549 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bee58fcdb6a4b74996fd1881a22b9e3" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:22:00.718451 26509 leader_election.cc:304] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc109b784081414e8f56d12601021038; no voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa
I20260709 13:22:00.719197 26753 raft_consensus.cc:2804] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.719771 26753 raft_consensus.cc:697] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Becoming Leader. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:22:00.724905 26732 consensus_queue.cc:1048] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:00.720968 26471 raft_consensus.cc:2468] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:22:00.710789 26469 raft_consensus.cc:2468] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:22:00.729940 26360 leader_election.cc:304] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:22:00.731003 26360 leader_election.cc:304] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:22:00.732152 26691 raft_consensus.cc:2804] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.732600 26395 raft_consensus.cc:2468] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 1.
I20260709 13:22:00.733686 26732 raft_consensus.cc:2804] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.720643 26753 consensus_queue.cc:237] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.736281 26732 raft_consensus.cc:697] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:22:00.744513 26732 consensus_queue.cc:237] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.748597 26733 consensus_queue.cc:1048] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:00.748615 26294 catalog_manager.cc:5697] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66). New cstate: current_term: 1 leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:00.751106 26468 raft_consensus.cc:2468] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 1.
I20260709 13:22:00.760691 26715 tablet_bootstrap.cc:492] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038: No bootstrap required, opened a new log
I20260709 13:22:00.761252 26715 ts_tablet_manager.cc:1403] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038: Time spent bootstrapping tablet: real 0.105s	user 0.039s	sys 0.037s
I20260709 13:22:00.764246 26715 raft_consensus.cc:359] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.764932 26715 raft_consensus.cc:385] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.765189 26715 raft_consensus.cc:740] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.765877 26715 consensus_queue.cc:260] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.768181 26715 ts_tablet_manager.cc:1434] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:22:00.755748 26543 raft_consensus.cc:2468] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:22:00.759181 26541 raft_consensus.cc:2468] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 1.
I20260709 13:22:00.771654 26721 raft_consensus.cc:2749] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:00.797619 26292 catalog_manager.cc:5697] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc109b784081414e8f56d12601021038 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "cc109b784081414e8f56d12601021038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:00.804308 26292 catalog_manager.cc:5697] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc109b784081414e8f56d12601021038 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "cc109b784081414e8f56d12601021038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:00.815299 26691 raft_consensus.cc:697] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:22:00.816501 26691 consensus_queue.cc:237] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.834856 26294 catalog_manager.cc:5697] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:00.836620 26294 catalog_manager.cc:5697] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:00.837076 26291 catalog_manager.cc:5697] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66). New cstate: current_term: 1 leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:00.876583 26722 raft_consensus.cc:493] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.877019 26722 raft_consensus.cc:515] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:00.878626 26722 leader_election.cc:290] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:22:00.879458 26394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b1eaf962944b7bce912e92b8d737b" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b34bd6ec671409d9e228156d3e81d08" is_pre_election: true
I20260709 13:22:00.879784 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339b1eaf962944b7bce912e92b8d737b" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" is_pre_election: true
I20260709 13:22:00.880188 26394 raft_consensus.cc:2393] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc109b784081414e8f56d12601021038 in current term 1: Already voted for candidate 44056cb5a49d4c92b2e2e120f0f233fa in this term.
I20260709 13:22:00.881321 26508 leader_election.cc:304] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc109b784081414e8f56d12601021038; no voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa
I20260709 13:22:00.882154 26722 raft_consensus.cc:3060] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.887539 26722 raft_consensus.cc:2749] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:00.914974 26722 consensus_queue.cc:1048] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:00.923593 26394 raft_consensus.cc:3060] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.931735 26721 consensus_queue.cc:1048] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.020740 26541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97ef307a53034edcac0ac487f52ee392"
dest_uuid: "cc109b784081414e8f56d12601021038"
mode: GRACEFUL
new_leader_uuid: "3b34bd6ec671409d9e228156d3e81d08"
 from {username='slave'} at 127.0.0.1:57814
I20260709 13:22:01.021301 26541 raft_consensus.cc:606] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Received request to transfer leadership to TS 3b34bd6ec671409d9e228156d3e81d08
I20260709 13:22:01.031386 26541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b18b64bd8d3442d8592aca91f89e8bc"
dest_uuid: "cc109b784081414e8f56d12601021038"
mode: GRACEFUL
new_leader_uuid: "3b34bd6ec671409d9e228156d3e81d08"
 from {username='slave'} at 127.0.0.1:57814
I20260709 13:22:01.032049 26541 raft_consensus.cc:606] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Received request to transfer leadership to TS 3b34bd6ec671409d9e228156d3e81d08
I20260709 13:22:01.037983 26541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad0cf8a32a21450cb9a9dffa099c19a7"
dest_uuid: "cc109b784081414e8f56d12601021038"
mode: GRACEFUL
new_leader_uuid: "3b34bd6ec671409d9e228156d3e81d08"
 from {username='slave'} at 127.0.0.1:57814
I20260709 13:22:01.038496 26541 raft_consensus.cc:606] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Received request to transfer leadership to TS 3b34bd6ec671409d9e228156d3e81d08
I20260709 13:22:01.042527 26753 consensus_queue.cc:1048] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.044821 26395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c3d0f174d27446abc3786cb8ae8bd82"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
mode: GRACEFUL
new_leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
 from {username='slave'} at 127.0.0.1:43412
I20260709 13:22:01.045542 26395 raft_consensus.cc:606] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Received request to transfer leadership to TS 44056cb5a49d4c92b2e2e120f0f233fa
I20260709 13:22:01.053717 26753 consensus_queue.cc:1048] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.064391 26394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bee58fcdb6a4b74996fd1881a22b9e3"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
mode: GRACEFUL
new_leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
 from {username='slave'} at 127.0.0.1:43412
I20260709 13:22:01.065083 26394 raft_consensus.cc:606] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Received request to transfer leadership to TS 44056cb5a49d4c92b2e2e120f0f233fa
I20260709 13:22:01.073853 26721 consensus_queue.cc:1048] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:01.085780 26721 consensus_queue.cc:1048] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.099311 26722 raft_consensus.cc:993] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038: : Instructing follower 3b34bd6ec671409d9e228156d3e81d08 to start an election
I20260709 13:22:01.099805 26722 raft_consensus.cc:1081] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Signalling peer 3b34bd6ec671409d9e228156d3e81d08 to start an election
I20260709 13:22:01.101663 26395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad0cf8a32a21450cb9a9dffa099c19a7"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
 from {username='slave'} at 127.0.0.1:43398
I20260709 13:22:01.102203 26395 raft_consensus.cc:493] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.102259 26722 consensus_queue.cc:1048] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.102592 26395 raft_consensus.cc:3060] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.109771 26395 raft_consensus.cc:515] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.112532 26395 leader_election.cc:290] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 2 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:01.112488 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0cf8a32a21450cb9a9dffa099c19a7" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:01.113155 26471 raft_consensus.cc:3060] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.113844 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0cf8a32a21450cb9a9dffa099c19a7" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:22:01.114550 26541 raft_consensus.cc:3055] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:01.114925 26541 raft_consensus.cc:740] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:22:01.115670 26541 consensus_queue.cc:260] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.116634 26541 raft_consensus.cc:3060] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.119886 26471 raft_consensus.cc:2468] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 2.
I20260709 13:22:01.121218 26360 leader_election.cc:304] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:22:01.122057 26731 raft_consensus.cc:2804] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:01.122545 26731 raft_consensus.cc:697] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:22:01.123464 26731 consensus_queue.cc:237] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.123821 26541 raft_consensus.cc:2468] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 2.
I20260709 13:22:01.124986 26752 consensus_queue.cc:1048] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.141536 26291 catalog_manager.cc:5697] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 1 to 2, leader changed from cc109b784081414e8f56d12601021038 (127.15.242.67) to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:01.193454 26721 raft_consensus.cc:993] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038: : Instructing follower 3b34bd6ec671409d9e228156d3e81d08 to start an election
I20260709 13:22:01.193949 26722 raft_consensus.cc:1081] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Signalling peer 3b34bd6ec671409d9e228156d3e81d08 to start an election
I20260709 13:22:01.195829 26395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97ef307a53034edcac0ac487f52ee392"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
 from {username='slave'} at 127.0.0.1:43398
I20260709 13:22:01.196440 26395 raft_consensus.cc:493] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.196767 26395 raft_consensus.cc:3060] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.202419 26395 raft_consensus.cc:515] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.204079 26395 leader_election.cc:290] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 2 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:01.205319 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ef307a53034edcac0ac487f52ee392" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:01.205319 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ef307a53034edcac0ac487f52ee392" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:22:01.206245 26467 raft_consensus.cc:3060] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.206310 26541 raft_consensus.cc:3055] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:01.206755 26541 raft_consensus.cc:740] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:22:01.207731 26541 consensus_queue.cc:260] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.209071 26541 raft_consensus.cc:3060] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.212702 26731 consensus_queue.cc:1048] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:01.214435 26467 raft_consensus.cc:2468] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 2.
I20260709 13:22:01.215893 26360 leader_election.cc:304] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:22:01.216487 26541 raft_consensus.cc:2468] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 2.
I20260709 13:22:01.216846 26731 raft_consensus.cc:2804] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:01.217192 26753 consensus_queue.cc:1048] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:01.217662 26731 raft_consensus.cc:697] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:22:01.222914 26731 consensus_queue.cc:237] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.228621 26732 consensus_queue.cc:1048] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:01.239866 26753 consensus_queue.cc:1048] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.243604 26732 consensus_queue.cc:1048] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:01.247558 26733 raft_consensus.cc:993] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08: : Instructing follower 44056cb5a49d4c92b2e2e120f0f233fa to start an election
I20260709 13:22:01.248967 26733 raft_consensus.cc:1081] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Signalling peer 44056cb5a49d4c92b2e2e120f0f233fa to start an election
I20260709 13:22:01.251361 26471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bee58fcdb6a4b74996fd1881a22b9e3"
dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
 from {username='slave'} at 127.0.0.1:34152
I20260709 13:22:01.251884 26471 raft_consensus.cc:493] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.252259 26471 raft_consensus.cc:3060] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.252804 26762 consensus_queue.cc:1048] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:01.260757 26471 raft_consensus.cc:515] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.269024 26471 leader_election.cc:290] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 2 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:01.270399 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bee58fcdb6a4b74996fd1881a22b9e3" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:22:01.271144 26541 raft_consensus.cc:3060] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.261863 26294 catalog_manager.cc:5697] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 1 to 2, leader changed from cc109b784081414e8f56d12601021038 (127.15.242.67) to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:01.281194 26732 raft_consensus.cc:993] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08: : Instructing follower 44056cb5a49d4c92b2e2e120f0f233fa to start an election
I20260709 13:22:01.281769 26733 raft_consensus.cc:1081] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Signalling peer 44056cb5a49d4c92b2e2e120f0f233fa to start an election
I20260709 13:22:01.284464 26471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c3d0f174d27446abc3786cb8ae8bd82"
dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
 from {username='slave'} at 127.0.0.1:34152
I20260709 13:22:01.285076 26471 raft_consensus.cc:493] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.285459 26471 raft_consensus.cc:3060] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.289199 26541 raft_consensus.cc:2468] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 2.
I20260709 13:22:01.271097 26395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bee58fcdb6a4b74996fd1881a22b9e3" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:22:01.290295 26395 raft_consensus.cc:3055] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:01.290616 26395 raft_consensus.cc:740] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:22:01.290633 26437 leader_election.cc:304] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:01.291720 26754 raft_consensus.cc:2804] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:01.292295 26754 raft_consensus.cc:697] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Becoming Leader. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:22:01.293176 26754 consensus_queue.cc:237] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.291443 26395 consensus_queue.cc:260] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.296912 26395 raft_consensus.cc:3060] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.297489 26471 raft_consensus.cc:515] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.299099 26467 raft_consensus.cc:1240] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Rejecting Update request from peer 3b34bd6ec671409d9e228156d3e81d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:01.300355 26471 leader_election.cc:290] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 2 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:01.300485 26394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d0f174d27446abc3786cb8ae8bd82" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:22:01.301321 26394 raft_consensus.cc:3055] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:01.301555 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d0f174d27446abc3786cb8ae8bd82" candidate_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:22:01.301671 26394 raft_consensus.cc:740] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:22:01.302456 26541 raft_consensus.cc:3060] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.303206 26394 consensus_queue.cc:260] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.304406 26394 raft_consensus.cc:3060] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.308776 26541 raft_consensus.cc:2468] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 2.
I20260709 13:22:01.309118 26294 catalog_manager.cc:5697] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa reported cstate change: term changed from 1 to 2, leader changed from 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65) to 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66). New cstate: current_term: 2 leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:01.310359 26437 leader_election.cc:304] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:01.311344 26754 raft_consensus.cc:2804] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:01.311887 26754 raft_consensus.cc:697] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Becoming Leader. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:22:01.312601 26395 raft_consensus.cc:2468] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 2.
I20260709 13:22:01.312775 26754 consensus_queue.cc:237] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.318835 26394 raft_consensus.cc:2468] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44056cb5a49d4c92b2e2e120f0f233fa in term 2.
I20260709 13:22:01.327112 26291 catalog_manager.cc:5697] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa reported cstate change: term changed from 1 to 2, leader changed from 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65) to 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66). New cstate: current_term: 2 leader_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:01.536089 26721 raft_consensus.cc:993] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038: : Instructing follower 3b34bd6ec671409d9e228156d3e81d08 to start an election
I20260709 13:22:01.536542 26722 raft_consensus.cc:1081] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Signalling peer 3b34bd6ec671409d9e228156d3e81d08 to start an election
I20260709 13:22:01.538195 26394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b18b64bd8d3442d8592aca91f89e8bc"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
 from {username='slave'} at 127.0.0.1:43398
I20260709 13:22:01.538650 26394 raft_consensus.cc:493] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.538935 26394 raft_consensus.cc:3060] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.543646 26394 raft_consensus.cc:515] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.546089 26394 leader_election.cc:290] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 2 election: Requested vote from peers 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511), cc109b784081414e8f56d12601021038 (127.15.242.67:33635)
I20260709 13:22:01.546255 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b18b64bd8d3442d8592aca91f89e8bc" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:01.546939 26471 raft_consensus.cc:3060] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.546346 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b18b64bd8d3442d8592aca91f89e8bc" candidate_uuid: "3b34bd6ec671409d9e228156d3e81d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc109b784081414e8f56d12601021038"
I20260709 13:22:01.549074 26541 raft_consensus.cc:3055] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:01.549600 26541 raft_consensus.cc:740] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:22:01.550220 26540 raft_consensus.cc:1275] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Refusing update from remote peer 3b34bd6ec671409d9e228156d3e81d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.550755 26541 consensus_queue.cc:260] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.551812 26733 consensus_queue.cc:1048] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:01.552196 26541 raft_consensus.cc:3060] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.556519 26471 raft_consensus.cc:2468] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 2.
I20260709 13:22:01.557950 26360 leader_election.cc:304] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, 44056cb5a49d4c92b2e2e120f0f233fa; no voters: 
I20260709 13:22:01.559096 26732 raft_consensus.cc:2804] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:01.559645 26732 raft_consensus.cc:697] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Becoming Leader. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:22:01.560391 26541 raft_consensus.cc:2468] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34bd6ec671409d9e228156d3e81d08 in term 2.
I20260709 13:22:01.560621 26732 consensus_queue.cc:237] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:01.562690 26471 raft_consensus.cc:1275] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Refusing update from remote peer 3b34bd6ec671409d9e228156d3e81d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.565685 26732 consensus_queue.cc:1048] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:01.570786 26294 catalog_manager.cc:5697] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 reported cstate change: term changed from 1 to 2, leader changed from cc109b784081414e8f56d12601021038 (127.15.242.67) to 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "3b34bd6ec671409d9e228156d3e81d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:01.672235 26394 raft_consensus.cc:1275] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Refusing update from remote peer 44056cb5a49d4c92b2e2e120f0f233fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.673539 26754 consensus_queue.cc:1048] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:01.681588 26540 raft_consensus.cc:1275] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Refusing update from remote peer 44056cb5a49d4c92b2e2e120f0f233fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.683566 26783 consensus_queue.cc:1048] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:01.774792 26540 raft_consensus.cc:1275] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Refusing update from remote peer 3b34bd6ec671409d9e228156d3e81d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.776201 26732 consensus_queue.cc:1048] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:01.785115 26471 raft_consensus.cc:1275] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Refusing update from remote peer 3b34bd6ec671409d9e228156d3e81d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.786743 26732 consensus_queue.cc:1048] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:01.837754 26394 raft_consensus.cc:1275] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Refusing update from remote peer 44056cb5a49d4c92b2e2e120f0f233fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.839130 26783 consensus_queue.cc:1048] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:01.848619 26540 raft_consensus.cc:1275] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Refusing update from remote peer 44056cb5a49d4c92b2e2e120f0f233fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.850371 26753 consensus_queue.cc:1048] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:02.159242 26471 raft_consensus.cc:1275] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Refusing update from remote peer 3b34bd6ec671409d9e228156d3e81d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.160552 26733 consensus_queue.cc:1048] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:02.170231 26541 raft_consensus.cc:1275] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Refusing update from remote peer 3b34bd6ec671409d9e228156d3e81d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.172259 26732 consensus_queue.cc:1048] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:04.072049 26290 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40450:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:04.093871 26290 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40450:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:04.127626 16329 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:22:04.366322 26469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c3d0f174d27446abc3786cb8ae8bd82"
dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
mode: GRACEFUL
new_leader_uuid: "cc109b784081414e8f56d12601021038"
 from {username='slave'} at 127.0.0.1:48842
I20260709 13:22:04.379328 26469 raft_consensus.cc:606] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Received request to transfer leadership to TS cc109b784081414e8f56d12601021038
I20260709 13:22:04.445056 26845 tablet.cc:1724] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.474248 26836 tablet.cc:1724] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.489122 26842 tablet.cc:1724] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:04.505342 26824 log.cc:927] Time spent T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08: Append to log took a long time: real 0.251s	user 0.004s	sys 0.003s
W20260709 13:22:04.516000 26823 log.cc:927] Time spent T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa: Append to log took a long time: real 0.263s	user 0.009s	sys 0.000s
W20260709 13:22:04.531570 26497 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:97ef307a53034edcac0ac487f52ee392)
W20260709 13:22:04.542474 26497 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:97ef307a53034edcac0ac487f52ee392)
I20260709 13:22:04.542932 26847 tablet.cc:1724] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.572431 26849 tablet.cc:1724] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:04.575176 26822 log.cc:927] Time spent T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa: Append to log took a long time: real 0.325s	user 0.002s	sys 0.001s
W20260709 13:22:04.598778 26831 log.cc:927] Time spent T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038: Append to log took a long time: real 0.176s	user 0.000s	sys 0.002s
W20260709 13:22:04.602137 26827 log.cc:927] Time spent T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08: Append to log took a long time: real 0.179s	user 0.003s	sys 0.000s
I20260709 13:22:04.633034 26837 raft_consensus.cc:993] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa: : Instructing follower cc109b784081414e8f56d12601021038 to start an election
I20260709 13:22:04.633951 26783 raft_consensus.cc:1081] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Signalling peer cc109b784081414e8f56d12601021038 to start an election
I20260709 13:22:04.660331 26542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c3d0f174d27446abc3786cb8ae8bd82"
dest_uuid: "cc109b784081414e8f56d12601021038"
 from {username='slave'} at 127.0.0.1:57800
I20260709 13:22:04.661055 26542 raft_consensus.cc:493] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.661526 26542 raft_consensus.cc:3060] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:22:04.672798 26360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:36511, user_credentials={real_user=slave}} blocked reactor thread for 78246.3us
I20260709 13:22:04.692313 26542 raft_consensus.cc:515] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:04.748579 26863 tablet.cc:1724] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.750450 26290 catalog_manager.cc:5789] TS 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511) does not have the latest schema for tablet 339b1eaf962944b7bce912e92b8d737b (table soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]). Expected version 1 got 0
I20260709 13:22:04.691183 26857 tablet.cc:1724] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.751561 26290 catalog_manager.cc:5789] TS 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511) does not have the latest schema for tablet 4c3d0f174d27446abc3786cb8ae8bd82 (table soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]). Expected version 1 got 0
I20260709 13:22:04.752460 26290 catalog_manager.cc:5789] TS 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511) does not have the latest schema for tablet 2bee58fcdb6a4b74996fd1881a22b9e3 (table soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]). Expected version 1 got 0
I20260709 13:22:04.753201 26290 catalog_manager.cc:5789] TS 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511) does not have the latest schema for tablet ef7420c9dbfc42f3b5c811a9a7558dc6 (table soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]). Expected version 1 got 0
I20260709 13:22:04.757066 26390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b18b64bd8d3442d8592aca91f89e8bc"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
mode: GRACEFUL
new_leader_uuid: "cc109b784081414e8f56d12601021038"
 from {username='slave'} at 127.0.0.1:53686
I20260709 13:22:04.781765 26849 tablet.cc:1724] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.691176 26862 tablet.cc:1724] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.785040 26845 tablet.cc:1724] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.789711 26836 tablet.cc:1724] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.779232 26390 raft_consensus.cc:606] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Received request to transfer leadership to TS cc109b784081414e8f56d12601021038
I20260709 13:22:04.800705 26863 tablet.cc:1724] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.715588 26842 tablet.cc:1724] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:04.808229 26571 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:339b1eaf962944b7bce912e92b8d737b)
I20260709 13:22:04.723724 26864 tablet.cc:1724] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.812134 16329 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:22:04.813458 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:04.812923 26847 tablet.cc:1724] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.817276 26860 tablet.cc:1724] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.818121 26542 leader_election.cc:290] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 3 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:22:04.714644 26855 tablet.cc:1724] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.823108 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d0f174d27446abc3786cb8ae8bd82" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:04.824057 26468 raft_consensus.cc:3055] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:04.824386 26468 raft_consensus.cc:740] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:22:04.825425 26850 raft_consensus.cc:993] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08: : Instructing follower cc109b784081414e8f56d12601021038 to start an election
I20260709 13:22:04.826150 26809 raft_consensus.cc:1081] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Signalling peer cc109b784081414e8f56d12601021038 to start an election
I20260709 13:22:04.828301 26544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b18b64bd8d3442d8592aca91f89e8bc"
dest_uuid: "cc109b784081414e8f56d12601021038"
 from {username='slave'} at 127.0.0.1:57806
I20260709 13:22:04.828963 26544 raft_consensus.cc:493] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.829435 26544 raft_consensus.cc:3060] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.825278 26468 consensus_queue.cc:260] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:04.837105 26394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d777176544b4503aa820d1ea113c030"
dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
mode: GRACEFUL
new_leader_uuid: "cc109b784081414e8f56d12601021038"
 from {username='slave'} at 127.0.0.1:53686
I20260709 13:22:04.837751 26394 raft_consensus.cc:606] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Received request to transfer leadership to TS cc109b784081414e8f56d12601021038
I20260709 13:22:04.839298 26390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d0f174d27446abc3786cb8ae8bd82" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:22:04.839993 26390 raft_consensus.cc:3060] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.836321 26868 tablet.cc:1724] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.851182 26467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ea1805d9bc47c9b613ab623731e1f7"
dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
mode: GRACEFUL
new_leader_uuid: "cc109b784081414e8f56d12601021038"
 from {username='slave'} at 127.0.0.1:48842
I20260709 13:22:04.855413 26467 raft_consensus.cc:606] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Received request to transfer leadership to TS cc109b784081414e8f56d12601021038
I20260709 13:22:04.851238 26468 raft_consensus.cc:3060] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.874233 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:04.875006 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:04.876118 26862 tablet.cc:1724] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.871330 26863 tablet.cc:1724] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.880954 26845 tablet.cc:1724] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.881696 26836 tablet.cc:1724] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.883458 26294 catalog_manager.cc:5789] TS 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201) does not have the latest schema for tablet e7bab9a84e4b43a29b505efc3c38d0d3 (table soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066]). Expected version 1 got 0
I20260709 13:22:04.883812 26390 raft_consensus.cc:2468] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 3.
I20260709 13:22:04.891901 26857 tablet.cc:1724] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.902248 26842 tablet.cc:1724] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.903932 26544 raft_consensus.cc:515] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:04.910884 26508 leader_election.cc:304] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:04.912982 26721 raft_consensus.cc:2804] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:04.913193 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b18b64bd8d3442d8592aca91f89e8bc" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:04.913251 26390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b18b64bd8d3442d8592aca91f89e8bc" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:22:04.913533 26721 raft_consensus.cc:697] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 3 LEADER]: Becoming Leader. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:22:04.913944 26467 raft_consensus.cc:3060] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.914249 26390 raft_consensus.cc:3055] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:04.914672 26390 raft_consensus.cc:740] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:22:04.914788 26721 consensus_queue.cc:237] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:04.916150 26390 consensus_queue.cc:260] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:04.919103 26390 raft_consensus.cc:3060] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.913334 26544 leader_election.cc:290] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 3 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:22:04.935815 26390 raft_consensus.cc:2468] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 3.
I20260709 13:22:04.927156 26868 tablet.cc:1724] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.937103 26508 leader_election.cc:304] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:04.929615 26291 catalog_manager.cc:5697] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 reported cstate change: term changed from 2 to 3, leader changed from 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66) to cc109b784081414e8f56d12601021038 (127.15.242.67). New cstate: current_term: 3 leader_uuid: "cc109b784081414e8f56d12601021038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:04.940090 26468 raft_consensus.cc:2468] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 3.
I20260709 13:22:04.930050 26864 tablet.cc:1724] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.923712 26860 tablet.cc:1724] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:04.939572 26721 raft_consensus.cc:2804] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:04.931782 26467 raft_consensus.cc:2468] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 3.
I20260709 13:22:04.946414 26721 raft_consensus.cc:697] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 3 LEADER]: Becoming Leader. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:22:04.947521 26721 consensus_queue.cc:237] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:04.963193 26866 raft_consensus.cc:993] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08: : Instructing follower cc109b784081414e8f56d12601021038 to start an election
I20260709 13:22:04.963685 26866 raft_consensus.cc:1081] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Signalling peer cc109b784081414e8f56d12601021038 to start an election
I20260709 13:22:04.966544 26544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d777176544b4503aa820d1ea113c030"
dest_uuid: "cc109b784081414e8f56d12601021038"
 from {username='slave'} at 127.0.0.1:57806
I20260709 13:22:04.967638 26544 raft_consensus.cc:493] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.968170 26544 raft_consensus.cc:3060] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.980640 26544 raft_consensus.cc:515] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:22:04.983295 26544 leader_election.cc:290] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 3 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:22:04.984306 26390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d777176544b4503aa820d1ea113c030" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:22:04.984330 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d777176544b4503aa820d1ea113c030" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:04.985253 26390 raft_consensus.cc:3055] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:04.985785 26390 raft_consensus.cc:740] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3b34bd6ec671409d9e228156d3e81d08, State: Running, Role: LEADER
I20260709 13:22:04.985270 26467 raft_consensus.cc:3060] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.986789 26390 consensus_queue.cc:260] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:22:04.988695 26390 raft_consensus.cc:3060] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.995129 26818 raft_consensus.cc:993] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa: : Instructing follower cc109b784081414e8f56d12601021038 to start an election
I20260709 13:22:04.995710 26818 raft_consensus.cc:1081] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Signalling peer cc109b784081414e8f56d12601021038 to start an election
I20260709 13:22:04.997130 26467 raft_consensus.cc:2468] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 3.
I20260709 13:22:04.998492 26544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ea1805d9bc47c9b613ab623731e1f7"
dest_uuid: "cc109b784081414e8f56d12601021038"
 from {username='slave'} at 127.0.0.1:57800
I20260709 13:22:04.998657 26509 leader_election.cc:304] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44056cb5a49d4c92b2e2e120f0f233fa, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:04.999122 26544 raft_consensus.cc:493] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.999524 26544 raft_consensus.cc:3060] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:05.000254 26390 raft_consensus.cc:2468] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 3.
I20260709 13:22:05.002383 26721 raft_consensus.cc:2804] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:05.004244 26721 raft_consensus.cc:697] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 3 LEADER]: Becoming Leader. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:22:05.005223 26721 consensus_queue.cc:237] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } }
I20260709 13:22:05.008806 26544 raft_consensus.cc:515] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:05.011183 26544 leader_election.cc:290] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 2 election: Requested vote from peers 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201), 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511)
I20260709 13:22:05.012639 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea1805d9bc47c9b613ab623731e1f7" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44056cb5a49d4c92b2e2e120f0f233fa"
I20260709 13:22:05.013383 26467 raft_consensus.cc:3055] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:05.013396 26390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea1805d9bc47c9b613ab623731e1f7" candidate_uuid: "cc109b784081414e8f56d12601021038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b34bd6ec671409d9e228156d3e81d08"
I20260709 13:22:05.013852 26467 raft_consensus.cc:740] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44056cb5a49d4c92b2e2e120f0f233fa, State: Running, Role: LEADER
I20260709 13:22:05.014148 26390 raft_consensus.cc:3060] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:05.014775 26467 consensus_queue.cc:260] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:05.016180 26467 raft_consensus.cc:3060] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:05.017421 26290 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a: soft_deleted_table [id=9d898a865fce47f0b2113c8044fa2066] alter complete (version 1)
I20260709 13:22:05.021659 26390 raft_consensus.cc:2468] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 2.
I20260709 13:22:05.023394 26508 leader_election.cc:304] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34bd6ec671409d9e228156d3e81d08, cc109b784081414e8f56d12601021038; no voters: 
I20260709 13:22:05.024667 26821 raft_consensus.cc:2804] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:05.025156 26821 raft_consensus.cc:697] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 2 LEADER]: Becoming Leader. State: Replica: cc109b784081414e8f56d12601021038, State: Running, Role: LEADER
I20260709 13:22:05.026131 26821 consensus_queue.cc:237] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } }
I20260709 13:22:05.028743 26294 catalog_manager.cc:5697] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 reported cstate change: term changed from 2 to 3, leader changed from 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65) to cc109b784081414e8f56d12601021038 (127.15.242.67). New cstate: current_term: 3 leader_uuid: "cc109b784081414e8f56d12601021038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:05.032582 26467 raft_consensus.cc:2468] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc109b784081414e8f56d12601021038 in term 2.
I20260709 13:22:05.034408 26294 catalog_manager.cc:5697] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 reported cstate change: term changed from 2 to 3, leader changed from 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65) to cc109b784081414e8f56d12601021038 (127.15.242.67). New cstate: current_term: 3 leader_uuid: "cc109b784081414e8f56d12601021038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:05.053675 26292 catalog_manager.cc:5697] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 reported cstate change: term changed from 1 to 2, leader changed from 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66) to cc109b784081414e8f56d12601021038 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "cc109b784081414e8f56d12601021038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc109b784081414e8f56d12601021038" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 33635 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:05.343783 26390 raft_consensus.cc:1275] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Refusing update from remote peer cc109b784081414e8f56d12601021038: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:05.345191 26821 consensus_queue.cc:1048] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:05.348205 26468 raft_consensus.cc:1275] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Refusing update from remote peer cc109b784081414e8f56d12601021038: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:05.349917 26821 consensus_queue.cc:1048] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:05.356367 26468 raft_consensus.cc:1275] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Refusing update from remote peer cc109b784081414e8f56d12601021038: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:05.357913 26721 consensus_queue.cc:1048] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:05.370183 26394 raft_consensus.cc:1275] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Refusing update from remote peer cc109b784081414e8f56d12601021038: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:05.371798 26793 consensus_queue.cc:1048] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:05.536808 26390 raft_consensus.cc:1275] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Refusing update from remote peer cc109b784081414e8f56d12601021038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:05.538193 26821 consensus_queue.cc:1048] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:05.549218 26468 raft_consensus.cc:1275] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Refusing update from remote peer cc109b784081414e8f56d12601021038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:05.550906 26821 consensus_queue.cc:1048] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:05.571748 26390 raft_consensus.cc:1275] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Refusing update from remote peer cc109b784081414e8f56d12601021038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:05.573531 26821 consensus_queue.cc:1048] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34bd6ec671409d9e228156d3e81d08" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:05.584311 26468 raft_consensus.cc:1275] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Refusing update from remote peer cc109b784081414e8f56d12601021038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:05.585920 26793 consensus_queue.cc:1048] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44056cb5a49d4c92b2e2e120f0f233fa" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 36511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:05.944054 16329 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:22:05.949555 16329 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:22:05.950115 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:05.956688 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:22:05.957249 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:06.992561 16329 tablet_server.cc:179] TabletServer@127.15.242.65:0 shutting down...
W20260709 13:22:07.012490 26508 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:22:07.018473 26508 consensus_peers.cc:597] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 -> Peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Couldn't send request to peer 3b34bd6ec671409d9e228156d3e81d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.030524 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:07.031629 16329 tablet_replica.cc:333] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.032585 16329 raft_consensus.cc:2243] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.033164 16329 raft_consensus.cc:2272] T d639d18e4da74e8c87499f56402de7f5 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.035569 16329 tablet_replica.cc:333] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.036191 16329 raft_consensus.cc:2243] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.036640 16329 raft_consensus.cc:2272] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.038893 16329 tablet_replica.cc:333] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.039448 16329 raft_consensus.cc:2243] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.039849 16329 raft_consensus.cc:2272] T 339b1eaf962944b7bce912e92b8d737b P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.041785 16329 tablet_replica.cc:333] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.042718 16329 raft_consensus.cc:2243] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.043147 16329 raft_consensus.cc:2272] T 8b18b64bd8d3442d8592aca91f89e8bc P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.045411 16329 tablet_replica.cc:333] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.046125 16329 raft_consensus.cc:2243] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.046674 16329 raft_consensus.cc:2272] T 4c3d0f174d27446abc3786cb8ae8bd82 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.049970 16329 tablet_replica.cc:333] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
W20260709 13:22:07.050256 26508 consensus_peers.cc:597] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 -> Peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Couldn't send request to peer 3b34bd6ec671409d9e228156d3e81d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.050762 16329 raft_consensus.cc:2243] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.051911 16329 raft_consensus.cc:2272] T 97ef307a53034edcac0ac487f52ee392 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.055553 16329 tablet_replica.cc:333] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.056133 16329 raft_consensus.cc:2243] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.056612 16329 raft_consensus.cc:2272] T a997e7b3074942dda1c719a2364af4da P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.058991 16329 tablet_replica.cc:333] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.059605 16329 raft_consensus.cc:2243] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.060029 16329 raft_consensus.cc:2272] T 95ea1805d9bc47c9b613ab623731e1f7 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.062836 16329 tablet_replica.cc:333] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.063553 16329 raft_consensus.cc:2243] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.064126 16329 raft_consensus.cc:2272] T 6047b437ca3f41bf9665b38f2bf4add6 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.067313 16329 tablet_replica.cc:333] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.067989 16329 raft_consensus.cc:2243] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.068553 16329 raft_consensus.cc:2272] T 09d23b56b7c544b9a1ed8ea154954a29 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.071003 16329 tablet_replica.cc:333] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.071662 16329 raft_consensus.cc:2243] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.072489 16329 raft_consensus.cc:2272] T e7bab9a84e4b43a29b505efc3c38d0d3 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.074599 16329 tablet_replica.cc:333] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.075160 16329 raft_consensus.cc:2243] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.076054 16329 raft_consensus.cc:2272] T 500a08b742ec4334a594fd79f3659ada P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.078589 16329 tablet_replica.cc:333] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.079274 16329 raft_consensus.cc:2243] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.079805 16329 raft_consensus.cc:2272] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.082201 16329 tablet_replica.cc:333] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.082902 16329 raft_consensus.cc:2243] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.083398 16329 raft_consensus.cc:2272] T 5d777176544b4503aa820d1ea113c030 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.085630 16329 tablet_replica.cc:333] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.086244 16329 raft_consensus.cc:2243] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.086777 16329 raft_consensus.cc:2272] T a7908957d3f848418cc01e408814977d P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.089373 16329 tablet_replica.cc:333] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.090107 16329 raft_consensus.cc:2243] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.091169 16329 raft_consensus.cc:2272] T b31d79fbf0f741c8a12aae40574ead69 P 3b34bd6ec671409d9e228156d3e81d08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.093736 16329 tablet_replica.cc:333] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.094430 16329 raft_consensus.cc:2243] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.095227 16329 raft_consensus.cc:2272] T ad0cf8a32a21450cb9a9dffa099c19a7 P 3b34bd6ec671409d9e228156d3e81d08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.097445 16329 tablet_replica.cc:333] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08: stopping tablet replica
I20260709 13:22:07.097954 16329 raft_consensus.cc:2243] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.098902 16329 raft_consensus.cc:2272] T 6fa4f09dd99e42179348398f40bc0b85 P 3b34bd6ec671409d9e228156d3e81d08 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:07.103924 26508 consensus_peers.cc:597] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 -> Peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Couldn't send request to peer 3b34bd6ec671409d9e228156d3e81d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.145840 16329 tablet_server.cc:196] TabletServer@127.15.242.65:0 shutdown complete.
W20260709 13:22:07.175719 26434 consensus_peers.cc:597] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa -> Peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Couldn't send request to peer 3b34bd6ec671409d9e228156d3e81d08. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:41201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.188086 16329 tablet_server.cc:179] TabletServer@127.15.242.66:0 shutting down...
W20260709 13:22:07.217494 26434 consensus_peers.cc:597] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa -> Peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Couldn't send request to peer 3b34bd6ec671409d9e228156d3e81d08. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:41201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.222595 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:07.223614 16329 tablet_replica.cc:333] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.224802 16329 raft_consensus.cc:2243] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.226079 16329 raft_consensus.cc:2272] T 339b1eaf962944b7bce912e92b8d737b P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.228870 16329 tablet_replica.cc:333] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.229871 16329 raft_consensus.cc:2243] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.230517 16329 raft_consensus.cc:2272] T 4c3d0f174d27446abc3786cb8ae8bd82 P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.233111 16329 tablet_replica.cc:333] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.233749 16329 raft_consensus.cc:2243] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.234637 16329 raft_consensus.cc:2272] T 2bee58fcdb6a4b74996fd1881a22b9e3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.236874 16329 tablet_replica.cc:333] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.237560 16329 raft_consensus.cc:2243] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.238137 16329 raft_consensus.cc:2272] T d639d18e4da74e8c87499f56402de7f5 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.240525 16329 tablet_replica.cc:333] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.241438 16329 raft_consensus.cc:2243] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.241940 16329 raft_consensus.cc:2272] T 8b18b64bd8d3442d8592aca91f89e8bc P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:07.244055 26509 consensus_peers.cc:597] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 -> Peer 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511): Couldn't send request to peer 44056cb5a49d4c92b2e2e120f0f233fa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.244594 16329 tablet_replica.cc:333] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.245262 16329 raft_consensus.cc:2243] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.246126 16329 raft_consensus.cc:2272] T 6047b437ca3f41bf9665b38f2bf4add6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.248767 16329 tablet_replica.cc:333] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.249387 16329 raft_consensus.cc:2243] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.249842 16329 raft_consensus.cc:2272] T 97ef307a53034edcac0ac487f52ee392 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.252445 16329 tablet_replica.cc:333] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.253360 16329 raft_consensus.cc:2243] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.254403 16329 raft_consensus.cc:2272] T a997e7b3074942dda1c719a2364af4da P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.257087 16329 tablet_replica.cc:333] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.257776 16329 raft_consensus.cc:2243] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.258257 16329 raft_consensus.cc:2272] T 95ea1805d9bc47c9b613ab623731e1f7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:07.258365 26508 consensus_peers.cc:597] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 -> Peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Couldn't send request to peer 3b34bd6ec671409d9e228156d3e81d08. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:41201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.260499 16329 tablet_replica.cc:333] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.261250 16329 raft_consensus.cc:2243] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.261741 16329 raft_consensus.cc:2272] T ad0cf8a32a21450cb9a9dffa099c19a7 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.263918 16329 tablet_replica.cc:333] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.264761 16329 raft_consensus.cc:2243] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.265228 16329 raft_consensus.cc:2272] T 6fa4f09dd99e42179348398f40bc0b85 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.267458 16329 tablet_replica.cc:333] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.268023 16329 raft_consensus.cc:2243] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.269014 16329 raft_consensus.cc:2272] T 09d23b56b7c544b9a1ed8ea154954a29 P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.272320 16329 tablet_replica.cc:333] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.273154 16329 raft_consensus.cc:2243] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.274078 16329 raft_consensus.cc:2272] T ef7420c9dbfc42f3b5c811a9a7558dc6 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.276197 16329 tablet_replica.cc:333] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.276779 16329 raft_consensus.cc:2243] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.277298 16329 raft_consensus.cc:2272] T 5d777176544b4503aa820d1ea113c030 P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.279568 16329 tablet_replica.cc:333] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.280193 16329 raft_consensus.cc:2243] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.280683 16329 raft_consensus.cc:2272] T 500a08b742ec4334a594fd79f3659ada P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.283108 16329 tablet_replica.cc:333] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.283667 16329 raft_consensus.cc:2243] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.284140 16329 raft_consensus.cc:2272] T e7bab9a84e4b43a29b505efc3c38d0d3 P 44056cb5a49d4c92b2e2e120f0f233fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.286353 16329 tablet_replica.cc:333] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.286943 16329 raft_consensus.cc:2243] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.287518 16329 raft_consensus.cc:2272] T b31d79fbf0f741c8a12aae40574ead69 P 44056cb5a49d4c92b2e2e120f0f233fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.290500 16329 tablet_replica.cc:333] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa: stopping tablet replica
I20260709 13:22:07.291239 16329 raft_consensus.cc:2243] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.291731 16329 raft_consensus.cc:2272] T a7908957d3f848418cc01e408814977d P 44056cb5a49d4c92b2e2e120f0f233fa [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:07.292119 26509 consensus_peers.cc:597] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 -> Peer 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511): Couldn't send request to peer 44056cb5a49d4c92b2e2e120f0f233fa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.339211 16329 tablet_server.cc:196] TabletServer@127.15.242.66:0 shutdown complete.
W20260709 13:22:07.357834 26508 consensus_peers.cc:597] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 -> Peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Couldn't send request to peer 3b34bd6ec671409d9e228156d3e81d08. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:41201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.378363 16329 tablet_server.cc:179] TabletServer@127.15.242.67:0 shutting down...
W20260709 13:22:07.395105 26508 consensus_peers.cc:597] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 -> Peer 3b34bd6ec671409d9e228156d3e81d08 (127.15.242.65:41201): Couldn't send request to peer 3b34bd6ec671409d9e228156d3e81d08. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:41201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.413041 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:07.414316 16329 tablet_replica.cc:333] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.415302 16329 raft_consensus.cc:2243] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.415839 16329 raft_consensus.cc:2272] T 339b1eaf962944b7bce912e92b8d737b P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.417821 16329 tablet_replica.cc:333] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.418462 16329 raft_consensus.cc:2243] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.418883 16329 raft_consensus.cc:2272] T 2bee58fcdb6a4b74996fd1881a22b9e3 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.420827 16329 tablet_replica.cc:333] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.421670 16329 raft_consensus.cc:2243] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.422839 16329 raft_consensus.cc:2272] T d639d18e4da74e8c87499f56402de7f5 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.426901 16329 tablet_replica.cc:333] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.427742 16329 raft_consensus.cc:2243] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:22:07.428131 26509 consensus_peers.cc:597] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 -> Peer 44056cb5a49d4c92b2e2e120f0f233fa (127.15.242.66:36511): Couldn't send request to peer 44056cb5a49d4c92b2e2e120f0f233fa. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:36511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.428606 16329 raft_consensus.cc:2272] T 4c3d0f174d27446abc3786cb8ae8bd82 P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.430688 16329 tablet_replica.cc:333] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.431301 16329 raft_consensus.cc:2243] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.432201 16329 raft_consensus.cc:2272] T 8b18b64bd8d3442d8592aca91f89e8bc P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.434214 16329 tablet_replica.cc:333] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.434779 16329 raft_consensus.cc:2243] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.435225 16329 raft_consensus.cc:2272] T 500a08b742ec4334a594fd79f3659ada P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.437170 16329 tablet_replica.cc:333] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.437717 16329 raft_consensus.cc:2243] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.438180 16329 raft_consensus.cc:2272] T e7bab9a84e4b43a29b505efc3c38d0d3 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.440006 16329 tablet_replica.cc:333] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.440580 16329 raft_consensus.cc:2243] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.441045 16329 raft_consensus.cc:2272] T b31d79fbf0f741c8a12aae40574ead69 P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.443082 16329 tablet_replica.cc:333] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.443585 16329 raft_consensus.cc:2243] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.444352 16329 raft_consensus.cc:2272] T 95ea1805d9bc47c9b613ab623731e1f7 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.446324 16329 tablet_replica.cc:333] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.446859 16329 raft_consensus.cc:2243] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.447279 16329 raft_consensus.cc:2272] T a997e7b3074942dda1c719a2364af4da P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.449304 16329 tablet_replica.cc:333] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.449924 16329 raft_consensus.cc:2243] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.450764 16329 raft_consensus.cc:2272] T a7908957d3f848418cc01e408814977d P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.452698 16329 tablet_replica.cc:333] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.453205 16329 raft_consensus.cc:2243] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.453660 16329 raft_consensus.cc:2272] T 97ef307a53034edcac0ac487f52ee392 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.455546 16329 tablet_replica.cc:333] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.456069 16329 raft_consensus.cc:2243] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.456508 16329 raft_consensus.cc:2272] T ad0cf8a32a21450cb9a9dffa099c19a7 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.458380 16329 tablet_replica.cc:333] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.458889 16329 raft_consensus.cc:2243] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.459300 16329 raft_consensus.cc:2272] T 6fa4f09dd99e42179348398f40bc0b85 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.461313 16329 tablet_replica.cc:333] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.461818 16329 raft_consensus.cc:2243] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.462268 16329 raft_consensus.cc:2272] T 6047b437ca3f41bf9665b38f2bf4add6 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.464214 16329 tablet_replica.cc:333] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.464709 16329 raft_consensus.cc:2243] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.465140 16329 raft_consensus.cc:2272] T 09d23b56b7c544b9a1ed8ea154954a29 P cc109b784081414e8f56d12601021038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.467041 16329 tablet_replica.cc:333] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.467521 16329 raft_consensus.cc:2243] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.467944 16329 raft_consensus.cc:2272] T ef7420c9dbfc42f3b5c811a9a7558dc6 P cc109b784081414e8f56d12601021038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.469696 16329 tablet_replica.cc:333] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038: stopping tablet replica
I20260709 13:22:07.470232 16329 raft_consensus.cc:2243] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.470992 16329 raft_consensus.cc:2272] T 5d777176544b4503aa820d1ea113c030 P cc109b784081414e8f56d12601021038 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.510768 16329 tablet_server.cc:196] TabletServer@127.15.242.67:0 shutdown complete.
I20260709 13:22:07.546840 16329 master.cc:562] Master@127.15.242.126:40707 shutting down...
I20260709 13:22:07.571483 16329 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.572052 16329 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.572489 16329 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0b9161d86b5d4c06bb873435df44a31a: stopping tablet replica
I20260709 13:22:07.594444 16329 master.cc:584] Master@127.15.242.126:40707 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (14495 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:22:07.653278 16329 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.242.126:45943
I20260709 13:22:07.654543 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:07.660475 26887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.660688 26886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.661469 26889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.661957 16329 server_base.cc:1061] running on GCE node
I20260709 13:22:07.662967 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:07.663146 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:07.663254 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603327663244 us; error 0 us; skew 500 ppm
I20260709 13:22:07.663693 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:07.666229 16329 webserver.cc:533] Webserver started at http://127.15.242.126:43129/ using document root <none> and password file <none>
I20260709 13:22:07.666822 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:07.667004 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:07.667367 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:07.668569 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/master-0-root/instance:
uuid: "a1ed9df55f6a4a6a9735c222cf39e15c"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-fh5z"
I20260709 13:22:07.673467 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.002s
I20260709 13:22:07.677402 26894 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.678319 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:22:07.678653 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/master-0-root
uuid: "a1ed9df55f6a4a6a9735c222cf39e15c"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-fh5z"
I20260709 13:22:07.678921 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:07.710204 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:07.711405 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:07.751286 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.126:45943
I20260709 13:22:07.751425 26945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.126:45943 every 8 connection(s)
I20260709 13:22:07.755540 26946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.766444 26946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c: Bootstrap starting.
I20260709 13:22:07.771431 26946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.776078 26946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c: No bootstrap required, opened a new log
I20260709 13:22:07.778492 26946 raft_consensus.cc:359] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1ed9df55f6a4a6a9735c222cf39e15c" member_type: VOTER }
I20260709 13:22:07.779026 26946 raft_consensus.cc:385] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.779244 26946 raft_consensus.cc:740] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ed9df55f6a4a6a9735c222cf39e15c, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.779860 26946 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1ed9df55f6a4a6a9735c222cf39e15c" member_type: VOTER }
I20260709 13:22:07.780284 26946 raft_consensus.cc:399] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:07.780541 26946 raft_consensus.cc:493] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:07.780819 26946 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:07.785912 26946 raft_consensus.cc:515] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1ed9df55f6a4a6a9735c222cf39e15c" member_type: VOTER }
I20260709 13:22:07.786530 26946 leader_election.cc:304] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1ed9df55f6a4a6a9735c222cf39e15c; no voters: 
I20260709 13:22:07.787855 26946 leader_election.cc:290] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:07.788386 26949 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:07.789777 26949 raft_consensus.cc:697] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [term 1 LEADER]: Becoming Leader. State: Replica: a1ed9df55f6a4a6a9735c222cf39e15c, State: Running, Role: LEADER
I20260709 13:22:07.790472 26949 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1ed9df55f6a4a6a9735c222cf39e15c" member_type: VOTER }
I20260709 13:22:07.790884 26946 sys_catalog.cc:565] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:07.794886 26950 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1ed9df55f6a4a6a9735c222cf39e15c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1ed9df55f6a4a6a9735c222cf39e15c" member_type: VOTER } }
I20260709 13:22:07.795607 26950 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:07.794910 26951 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1ed9df55f6a4a6a9735c222cf39e15c. Latest consensus state: current_term: 1 leader_uuid: "a1ed9df55f6a4a6a9735c222cf39e15c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1ed9df55f6a4a6a9735c222cf39e15c" member_type: VOTER } }
I20260709 13:22:07.796253 26951 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:07.803105 26956 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:07.808465 26956 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:07.809659 16329 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:07.817408 26956 catalog_manager.cc:1383] Generated new cluster ID: 8c2e59d8dfeb4e1bbbd7a58029f23076
I20260709 13:22:07.817720 26956 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:07.832140 26956 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:07.833499 26956 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:07.852706 26956 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c: Generated new TSK 0
I20260709 13:22:07.853353 26956 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:07.876765 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:07.883323 26967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.884924 26968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.888760 16329 server_base.cc:1061] running on GCE node
W20260709 13:22:07.888957 26970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.890187 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:07.890379 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:07.890494 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603327890483 us; error 0 us; skew 500 ppm
I20260709 13:22:07.890949 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:07.893283 16329 webserver.cc:533] Webserver started at http://127.15.242.65:34861/ using document root <none> and password file <none>
I20260709 13:22:07.893709 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:07.893862 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:07.894127 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:07.895175 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-0-root/instance:
uuid: "6fec71feeb50406b9395a638b88dc370"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-fh5z"
I20260709 13:22:07.899712 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:07.903158 26975 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.903918 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:07.904234 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-0-root
uuid: "6fec71feeb50406b9395a638b88dc370"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-fh5z"
I20260709 13:22:07.904534 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:07.917697 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:07.918996 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:07.920473 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:07.922770 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:07.922995 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.923243 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:07.923427 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.968258 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.65:33085
I20260709 13:22:07.968379 27037 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.65:33085 every 8 connection(s)
I20260709 13:22:07.974144 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:07.982918 27042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.983933 27043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.986575 16329 server_base.cc:1061] running on GCE node
W20260709 13:22:07.986984 27046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.988437 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:07.988665 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:07.988806 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603327988793 us; error 0 us; skew 500 ppm
I20260709 13:22:07.989432 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:07.993186 27038 heartbeater.cc:344] Connected to a master server at 127.15.242.126:45943
I20260709 13:22:07.993561 27038 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:07.994338 27038 heartbeater.cc:507] Master 127.15.242.126:45943 requested a full tablet report, sending...
I20260709 13:22:07.994668 16329 webserver.cc:533] Webserver started at http://127.15.242.66:35653/ using document root <none> and password file <none>
I20260709 13:22:07.995648 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:07.995922 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:07.996284 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:07.996775 26911 ts_manager.cc:194] Registered new tserver with Master: 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085)
I20260709 13:22:07.997664 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-1-root/instance:
uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-fh5z"
I20260709 13:22:07.998901 26911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54532
I20260709 13:22:08.003436 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:08.007082 27050 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:08.007910 16329 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:08.008272 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-1-root
uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-fh5z"
I20260709 13:22:08.008555 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:08.026264 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:08.027570 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:08.028995 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:08.031325 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:08.031533 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:08.031844 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:08.032007 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:08.076856 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.66:44241
I20260709 13:22:08.077100 27112 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.66:44241 every 8 connection(s)
I20260709 13:22:08.081779 16329 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:08.089440 27116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:08.091624 27117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:08.095145 16329 server_base.cc:1061] running on GCE node
W20260709 13:22:08.095378 27120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:08.096103 27113 heartbeater.cc:344] Connected to a master server at 127.15.242.126:45943
I20260709 13:22:08.096572 27113 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:08.097370 27113 heartbeater.cc:507] Master 127.15.242.126:45943 requested a full tablet report, sending...
I20260709 13:22:08.098624 16329 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:08.098927 16329 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:08.099167 16329 hybrid_clock.cc:648] HybridClock initialized: now 1783603328099147 us; error 0 us; skew 500 ppm
I20260709 13:22:08.099706 26911 ts_manager.cc:194] Registered new tserver with Master: 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:08.099838 16329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:08.101751 26911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54546
I20260709 13:22:08.103066 16329 webserver.cc:533] Webserver started at http://127.15.242.67:33203/ using document root <none> and password file <none>
I20260709 13:22:08.103868 16329 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:08.104136 16329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:08.104486 16329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:08.106011 16329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-2-root/instance:
uuid: "ed01b2067d964cfda687492d191b6c71"
format_stamp: "Formatted at 2026-07-09 13:22:08 on dist-test-slave-fh5z"
I20260709 13:22:08.110746 16329 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:08.114352 27124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:08.115253 16329 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:22:08.115695 16329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-2-root
uuid: "ed01b2067d964cfda687492d191b6c71"
format_stamp: "Formatted at 2026-07-09 13:22:08 on dist-test-slave-fh5z"
I20260709 13:22:08.116170 16329 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbTuIp6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603035614178-16329-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:08.147457 16329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:08.148696 16329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:08.150254 16329 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:08.152662 16329 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:08.152906 16329 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:08.153168 16329 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:08.153352 16329 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:08.202826 16329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.67:38045
I20260709 13:22:08.202970 27186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.242.67:38045 every 8 connection(s)
I20260709 13:22:08.218597 27187 heartbeater.cc:344] Connected to a master server at 127.15.242.126:45943
I20260709 13:22:08.219100 27187 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:08.219910 27187 heartbeater.cc:507] Master 127.15.242.126:45943 requested a full tablet report, sending...
I20260709 13:22:08.221901 26911 ts_manager.cc:194] Registered new tserver with Master: ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:08.222184 16329 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015399948s
I20260709 13:22:08.223513 26911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54550
I20260709 13:22:08.251767 26911 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54556:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:08.254963 26911 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:08.343021 27003 tablet_service.cc:1511] Processing CreateTablet for tablet 43ad9535642349629902c3ff840fedbd (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:08.343924 27000 tablet_service.cc:1511] Processing CreateTablet for tablet cbb2d42d01e7460c8d8a44c0bdfd2d5f (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:08.344698 27003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ad9535642349629902c3ff840fedbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.345582 27000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb2d42d01e7460c8d8a44c0bdfd2d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.347247 27002 tablet_service.cc:1511] Processing CreateTablet for tablet 47485825deb14081a6adcfb26a03c1f5 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:08.348966 27002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47485825deb14081a6adcfb26a03c1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.350404 26999 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff26d53286646eb9892a573cdb2ecfe (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:08.351382 27001 tablet_service.cc:1511] Processing CreateTablet for tablet 7cefede0f65c4903a92f1d6e143c4cfb (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:08.351984 26999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff26d53286646eb9892a573cdb2ecfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.352890 27001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cefede0f65c4903a92f1d6e143c4cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.355423 27150 tablet_service.cc:1511] Processing CreateTablet for tablet 7cefede0f65c4903a92f1d6e143c4cfb (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:08.358608 27149 tablet_service.cc:1511] Processing CreateTablet for tablet cbb2d42d01e7460c8d8a44c0bdfd2d5f (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:08.361254 27148 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff26d53286646eb9892a573cdb2ecfe (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:08.363327 26997 tablet_service.cc:1511] Processing CreateTablet for tablet f562c6f04c364ca286276a291410d192 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:08.363970 27147 tablet_service.cc:1511] Processing CreateTablet for tablet 49637e146f304243aeffc8c6e25e4c85 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:08.357082 27150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cefede0f65c4903a92f1d6e143c4cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.361308 26998 tablet_service.cc:1511] Processing CreateTablet for tablet 49637e146f304243aeffc8c6e25e4c85 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:08.367172 27152 tablet_service.cc:1511] Processing CreateTablet for tablet 43ad9535642349629902c3ff840fedbd (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:08.367467 26996 tablet_service.cc:1511] Processing CreateTablet for tablet 0d721351ee0e4501836ff08539f40750 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:08.369678 27152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ad9535642349629902c3ff840fedbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.369341 27151 tablet_service.cc:1511] Processing CreateTablet for tablet 47485825deb14081a6adcfb26a03c1f5 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:08.370374 27149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb2d42d01e7460c8d8a44c0bdfd2d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.371861 27145 tablet_service.cc:1511] Processing CreateTablet for tablet 0d721351ee0e4501836ff08539f40750 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:08.373431 27145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d721351ee0e4501836ff08539f40750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.375787 27146 tablet_service.cc:1511] Processing CreateTablet for tablet f562c6f04c364ca286276a291410d192 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:08.376881 26995 tablet_service.cc:1511] Processing CreateTablet for tablet 400ac67bcf014728bfa8c133e03bc6f9 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:08.377463 27146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f562c6f04c364ca286276a291410d192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.379295 27144 tablet_service.cc:1511] Processing CreateTablet for tablet 400ac67bcf014728bfa8c133e03bc6f9 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:08.380786 27144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400ac67bcf014728bfa8c133e03bc6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.382439 27147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49637e146f304243aeffc8c6e25e4c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.387440 27151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47485825deb14081a6adcfb26a03c1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.367859 26998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49637e146f304243aeffc8c6e25e4c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.392897 26997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f562c6f04c364ca286276a291410d192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.397394 27202 tablet_bootstrap.cc:492] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:08.402546 26996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d721351ee0e4501836ff08539f40750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.408245 26995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400ac67bcf014728bfa8c133e03bc6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.414848 27148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff26d53286646eb9892a573cdb2ecfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.430167 27202 tablet_bootstrap.cc:654] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.440964 27078 tablet_service.cc:1511] Processing CreateTablet for tablet 43ad9535642349629902c3ff840fedbd (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:08.444207 27078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ad9535642349629902c3ff840fedbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.448750 27077 tablet_service.cc:1511] Processing CreateTablet for tablet 47485825deb14081a6adcfb26a03c1f5 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:08.450982 27077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47485825deb14081a6adcfb26a03c1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.463900 27076 tablet_service.cc:1511] Processing CreateTablet for tablet 7cefede0f65c4903a92f1d6e143c4cfb (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:08.464926 27202 tablet_bootstrap.cc:492] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:08.464668 27074 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff26d53286646eb9892a573cdb2ecfe (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:08.465478 27076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cefede0f65c4903a92f1d6e143c4cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.465636 27202 ts_tablet_manager.cc:1403] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.000s
I20260709 13:22:08.466390 27074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff26d53286646eb9892a573cdb2ecfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.467370 27075 tablet_service.cc:1511] Processing CreateTablet for tablet cbb2d42d01e7460c8d8a44c0bdfd2d5f (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:08.468693 27075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb2d42d01e7460c8d8a44c0bdfd2d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.469472 27202 raft_consensus.cc:359] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.470362 27202 raft_consensus.cc:385] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.470624 27202 raft_consensus.cc:740] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.471360 27073 tablet_service.cc:1511] Processing CreateTablet for tablet 49637e146f304243aeffc8c6e25e4c85 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:08.472944 27073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49637e146f304243aeffc8c6e25e4c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.474409 27202 consensus_queue.cc:260] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.479313 27071 tablet_service.cc:1511] Processing CreateTablet for tablet 0d721351ee0e4501836ff08539f40750 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:08.480495 27070 tablet_service.cc:1511] Processing CreateTablet for tablet 400ac67bcf014728bfa8c133e03bc6f9 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:08.481021 27071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d721351ee0e4501836ff08539f40750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.480762 27072 tablet_service.cc:1511] Processing CreateTablet for tablet f562c6f04c364ca286276a291410d192 (DEFAULT_TABLE table=test-workload [id=493cd78dde7f45138405b4926a138747]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:08.481969 27070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400ac67bcf014728bfa8c133e03bc6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.483609 27072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f562c6f04c364ca286276a291410d192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.522224 27203 tablet_bootstrap.cc:492] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:08.544512 27038 heartbeater.cc:499] Master 127.15.242.126:45943 was elected leader, sending a full tablet report...
I20260709 13:22:08.547328 27205 tablet_bootstrap.cc:492] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:08.552434 27202 ts_tablet_manager.cc:1434] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.086s	user 0.012s	sys 0.017s
I20260709 13:22:08.553627 27202 tablet_bootstrap.cc:492] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:08.563951 27203 tablet_bootstrap.cc:654] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.566833 27202 tablet_bootstrap.cc:654] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.574873 27203 tablet_bootstrap.cc:492] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:08.575516 27203 ts_tablet_manager.cc:1403] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.005s
I20260709 13:22:08.578562 27203 raft_consensus.cc:359] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:08.579409 27203 raft_consensus.cc:385] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.579674 27205 tablet_bootstrap.cc:654] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.579782 27203 raft_consensus.cc:740] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.581038 27203 consensus_queue.cc:260] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:08.585757 27202 tablet_bootstrap.cc:492] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:08.586596 27202 ts_tablet_manager.cc:1403] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.004s
I20260709 13:22:08.590759 27202 raft_consensus.cc:359] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.591845 27202 raft_consensus.cc:385] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.592365 27202 raft_consensus.cc:740] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.593590 27202 consensus_queue.cc:260] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.596136 27187 heartbeater.cc:499] Master 127.15.242.126:45943 was elected leader, sending a full tablet report...
I20260709 13:22:08.596972 27203 ts_tablet_manager.cc:1434] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:22:08.598004 27205 tablet_bootstrap.cc:492] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:08.598243 27203 tablet_bootstrap.cc:492] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:08.598667 27205 ts_tablet_manager.cc:1403] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.016s
I20260709 13:22:08.604573 27202 ts_tablet_manager.cc:1434] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:22:08.605952 27203 tablet_bootstrap.cc:654] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.607605 27202 tablet_bootstrap.cc:492] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:08.605954 27205 raft_consensus.cc:359] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.609530 27205 raft_consensus.cc:385] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.609987 27205 raft_consensus.cc:740] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.611152 27205 consensus_queue.cc:260] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.615427 27202 tablet_bootstrap.cc:654] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.618816 27203 tablet_bootstrap.cc:492] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:08.619324 27205 ts_tablet_manager.cc:1434] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.010s
I20260709 13:22:08.619455 27203 ts_tablet_manager.cc:1403] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 13:22:08.620258 27113 heartbeater.cc:499] Master 127.15.242.126:45943 was elected leader, sending a full tablet report...
I20260709 13:22:08.622604 27203 raft_consensus.cc:359] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.623418 27203 raft_consensus.cc:385] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.623708 27203 raft_consensus.cc:740] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.624647 27205 tablet_bootstrap.cc:492] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:08.624612 27203 consensus_queue.cc:260] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.627298 27203 ts_tablet_manager.cc:1434] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:08.628530 27203 tablet_bootstrap.cc:492] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:08.632602 27205 tablet_bootstrap.cc:654] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.646229 27203 tablet_bootstrap.cc:654] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.654438 27205 tablet_bootstrap.cc:492] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:08.654628 27203 tablet_bootstrap.cc:492] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:08.655073 27205 ts_tablet_manager.cc:1403] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.014s
I20260709 13:22:08.655406 27203 ts_tablet_manager.cc:1403] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.000s
I20260709 13:22:08.658756 27205 raft_consensus.cc:359] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.659701 27205 raft_consensus.cc:385] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.660065 27205 raft_consensus.cc:740] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.660492 27203 raft_consensus.cc:359] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.661139 27202 tablet_bootstrap.cc:492] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:08.661700 27203 raft_consensus.cc:385] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.661265 27205 consensus_queue.cc:260] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.661947 27202 ts_tablet_manager.cc:1403] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.055s	user 0.028s	sys 0.025s
I20260709 13:22:08.662240 27203 raft_consensus.cc:740] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.663269 27203 consensus_queue.cc:260] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.665767 27203 ts_tablet_manager.cc:1434] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:22:08.665381 27202 raft_consensus.cc:359] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.666373 27202 raft_consensus.cc:385] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.666725 27202 raft_consensus.cc:740] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.666944 27205 ts_tablet_manager.cc:1434] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:22:08.667371 27203 tablet_bootstrap.cc:492] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:08.668227 27205 tablet_bootstrap.cc:492] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:08.667737 27202 consensus_queue.cc:260] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.670744 27202 ts_tablet_manager.cc:1434] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:08.671866 27202 tablet_bootstrap.cc:492] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:08.675828 27203 tablet_bootstrap.cc:654] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.675675 27209 raft_consensus.cc:493] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.679296 27202 tablet_bootstrap.cc:654] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.678938 27209 raft_consensus.cc:515] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.691920 27202 tablet_bootstrap.cc:492] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:08.692615 27202 ts_tablet_manager.cc:1403] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.012s
I20260709 13:22:08.696194 27202 raft_consensus.cc:359] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.697337 27202 raft_consensus.cc:385] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.697718 27202 raft_consensus.cc:740] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.699290 27218 raft_consensus.cc:493] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.699916 27218 raft_consensus.cc:515] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:08.701920 27203 tablet_bootstrap.cc:492] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:08.702701 27203 ts_tablet_manager.cc:1403] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.016s
I20260709 13:22:08.703008 27202 consensus_queue.cc:260] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.701251 27209 leader_election.cc:290] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:08.706378 27203 raft_consensus.cc:359] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.707388 27203 raft_consensus.cc:385] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:08.707785 27188 tablet.cc:2406] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:22:08.707751 27203 raft_consensus.cc:740] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.708834 27203 consensus_queue.cc:260] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.709184 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47485825deb14081a6adcfb26a03c1f5" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:08.710106 27013 raft_consensus.cc:2468] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:08.711378 27203 ts_tablet_manager.cc:1434] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:08.712026 27218 leader_election.cc:290] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:08.711520 27012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ad9535642349629902c3ff840fedbd" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:08.712551 27203 tablet_bootstrap.cc:492] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:08.711381 27202 ts_tablet_manager.cc:1434] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:22:08.714064 27127 leader_election.cc:304] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:08.714569 27202 tablet_bootstrap.cc:492] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
W20260709 13:22:08.715126 27127 leader_election.cc:343] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.715852 27209 raft_consensus.cc:2804] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.716250 27209 raft_consensus.cc:493] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.716570 27209 raft_consensus.cc:3060] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.721364 27205 tablet_bootstrap.cc:654] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.721519 27203 tablet_bootstrap.cc:654] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.722823 27202 tablet_bootstrap.cc:654] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.733191 27205 tablet_bootstrap.cc:492] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:08.733856 27205 ts_tablet_manager.cc:1403] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.003s
I20260709 13:22:08.737332 27205 raft_consensus.cc:359] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:08.738332 27205 raft_consensus.cc:385] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.738068 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47485825deb14081a6adcfb26a03c1f5" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:08.741577 27088 raft_consensus.cc:2468] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:08.741734 27202 tablet_bootstrap.cc:492] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:08.742466 27202 ts_tablet_manager.cc:1403] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.010s
I20260709 13:22:08.744102 27203 tablet_bootstrap.cc:492] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:08.743929 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ad9535642349629902c3ff840fedbd" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:08.744761 27203 ts_tablet_manager.cc:1403] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.011s
I20260709 13:22:08.744951 27205 raft_consensus.cc:740] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.745951 27202 raft_consensus.cc:359] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.746228 27205 consensus_queue.cc:260] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:08.746949 27202 raft_consensus.cc:385] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.747483 27202 raft_consensus.cc:740] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.747640 27088 raft_consensus.cc:2468] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:08.748530 27202 consensus_queue.cc:260] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.751065 27126 leader_election.cc:304] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:08.750979 27203 raft_consensus.cc:359] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.752089 27203 raft_consensus.cc:385] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.752447 27203 raft_consensus.cc:740] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.752611 27218 raft_consensus.cc:2804] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.753087 27218 raft_consensus.cc:493] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.753489 27218 raft_consensus.cc:3060] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.753314 27203 consensus_queue.cc:260] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.755116 27205 ts_tablet_manager.cc:1434] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 13:22:08.756429 27205 tablet_bootstrap.cc:492] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:08.763622 27202 ts_tablet_manager.cc:1434] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:22:08.764886 27205 tablet_bootstrap.cc:654] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.765406 27202 tablet_bootstrap.cc:492] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:08.779037 27218 raft_consensus.cc:515] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:08.799957 27209 raft_consensus.cc:515] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.801759 27202 tablet_bootstrap.cc:654] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.802013 27203 ts_tablet_manager.cc:1434] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.057s	user 0.032s	sys 0.022s
I20260709 13:22:08.808048 27203 tablet_bootstrap.cc:492] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:08.809798 27209 leader_election.cc:290] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:08.809599 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47485825deb14081a6adcfb26a03c1f5" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:08.802534 27218 leader_election.cc:290] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:08.811873 27013 raft_consensus.cc:3060] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.811750 27087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47485825deb14081a6adcfb26a03c1f5" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:08.812661 27087 raft_consensus.cc:3060] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.815454 27203 tablet_bootstrap.cc:654] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:08.803123 26959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:08.803260 27012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ad9535642349629902c3ff840fedbd" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:08.803882 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ad9535642349629902c3ff840fedbd" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:08.805279 27223 raft_consensus.cc:493] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.819172 27088 raft_consensus.cc:3060] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.819293 27223 raft_consensus.cc:515] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
W20260709 13:22:08.823621 27127 leader_election.cc:343] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.825536 27012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefede0f65c4903a92f1d6e143c4cfb" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:08.826459 27012 raft_consensus.cc:2468] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:08.827450 27086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefede0f65c4903a92f1d6e143c4cfb" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:08.827991 27127 leader_election.cc:304] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:08.829116 27218 raft_consensus.cc:2804] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.829530 27218 raft_consensus.cc:493] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.829909 27218 raft_consensus.cc:3060] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.830582 27223 leader_election.cc:290] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:08.832854 27205 tablet_bootstrap.cc:492] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:08.835743 27205 ts_tablet_manager.cc:1403] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.016s
W20260709 13:22:08.829783 27126 leader_election.cc:343] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.836301 27202 tablet_bootstrap.cc:492] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:08.834934 27087 raft_consensus.cc:2468] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:08.837023 27202 ts_tablet_manager.cc:1403] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.009s
I20260709 13:22:08.837963 27126 leader_election.cc:304] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:08.833432 27088 raft_consensus.cc:2468] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:08.838862 27218 raft_consensus.cc:515] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.840482 27126 leader_election.cc:304] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:08.841536 27209 raft_consensus.cc:2804] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.842417 27223 raft_consensus.cc:2804] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.842552 27012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefede0f65c4903a92f1d6e143c4cfb" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:08.842857 27225 raft_consensus.cc:493] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.843322 27209 raft_consensus.cc:697] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Leader. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:08.846837 27203 tablet_bootstrap.cc:492] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:08.846906 27225 raft_consensus.cc:515] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.847642 27203 ts_tablet_manager.cc:1403] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.040s	user 0.025s	sys 0.012s
I20260709 13:22:08.847466 27209 consensus_queue.cc:237] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.849622 27225 leader_election.cc:290] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:08.850433 27012 raft_consensus.cc:3060] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.850651 27011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb2d42d01e7460c8d8a44c0bdfd2d5f" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:08.845305 27202 raft_consensus.cc:359] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.851467 27011 raft_consensus.cc:2468] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:08.853080 27127 leader_election.cc:304] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:08.852859 27203 raft_consensus.cc:359] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.853653 27218 leader_election.cc:290] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:08.853916 27203 raft_consensus.cc:385] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.854234 27225 raft_consensus.cc:2804] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.854341 27203 raft_consensus.cc:740] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.854825 27225 raft_consensus.cc:493] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.855436 27225 raft_consensus.cc:3060] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.855870 27203 consensus_queue.cc:260] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.858739 27223 raft_consensus.cc:697] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Leader. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:08.851537 27202 raft_consensus.cc:385] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.860493 27202 raft_consensus.cc:740] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.859689 27087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb2d42d01e7460c8d8a44c0bdfd2d5f" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:08.861717 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefede0f65c4903a92f1d6e143c4cfb" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:08.861490 27202 consensus_queue.cc:260] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
W20260709 13:22:08.862986 27126 leader_election.cc:343] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.863018 27223 consensus_queue.cc:237] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
W20260709 13:22:08.866950 27126 leader_election.cc:343] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.846057 27205 raft_consensus.cc:359] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.867745 27205 raft_consensus.cc:385] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.868245 27202 ts_tablet_manager.cc:1434] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 13:22:08.868680 27012 raft_consensus.cc:2468] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:08.870443 27127 leader_election.cc:304] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 4a40ce8ef1e646f7a376842a2287b6e6
I20260709 13:22:08.868273 27205 raft_consensus.cc:740] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.861734 27203 ts_tablet_manager.cc:1434] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 13:22:08.874383 27225 raft_consensus.cc:515] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.875782 27205 consensus_queue.cc:260] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.877025 27203 tablet_bootstrap.cc:492] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:08.878218 27225 leader_election.cc:290] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:08.878574 27205 ts_tablet_manager.cc:1434] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 13:22:08.878881 27225 raft_consensus.cc:2804] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.879025 27012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb2d42d01e7460c8d8a44c0bdfd2d5f" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:08.879660 27225 raft_consensus.cc:697] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Leader. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:08.879732 27012 raft_consensus.cc:3060] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.880800 27225 consensus_queue.cc:237] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.869534 27202 tablet_bootstrap.cc:492] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:08.888738 27012 raft_consensus.cc:2468] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:08.890085 27127 leader_election.cc:304] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:08.891219 27223 raft_consensus.cc:2804] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.892053 27223 raft_consensus.cc:697] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Leader. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:08.893126 27223 consensus_queue.cc:237] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.895834 27205 tablet_bootstrap.cc:492] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:08.899734 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb2d42d01e7460c8d8a44c0bdfd2d5f" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
W20260709 13:22:08.902326 27126 leader_election.cc:343] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.893755 26908 catalog_manager.cc:5697] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed01b2067d964cfda687492d191b6c71 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "ed01b2067d964cfda687492d191b6c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:08.905229 27203 tablet_bootstrap.cc:654] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.871265 27013 raft_consensus.cc:2468] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:08.911581 27202 tablet_bootstrap.cc:654] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.911854 27205 tablet_bootstrap.cc:654] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.919664 27203 tablet_bootstrap.cc:492] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:08.920281 27203 ts_tablet_manager.cc:1403] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.000s
I20260709 13:22:08.923849 27203 raft_consensus.cc:359] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.923872 27205 tablet_bootstrap.cc:492] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:08.924746 27203 raft_consensus.cc:385] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.926580 27203 raft_consensus.cc:740] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.926677 27205 ts_tablet_manager.cc:1403] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.001s
I20260709 13:22:08.926869 27202 tablet_bootstrap.cc:492] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:08.928243 27202 ts_tablet_manager.cc:1403] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.004s
I20260709 13:22:08.927713 27203 consensus_queue.cc:260] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.930655 27205 raft_consensus.cc:359] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.931668 27205 raft_consensus.cc:385] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.931823 27203 ts_tablet_manager.cc:1434] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:22:08.932067 27205 raft_consensus.cc:740] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.931869 27202 raft_consensus.cc:359] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.933333 27202 raft_consensus.cc:385] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.933804 27202 raft_consensus.cc:740] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.934345 27203 tablet_bootstrap.cc:492] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:08.933357 27205 consensus_queue.cc:260] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.934890 27202 consensus_queue.cc:260] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.936671 27205 ts_tablet_manager.cc:1434] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:22:08.937827 27205 tablet_bootstrap.cc:492] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:08.945251 27205 tablet_bootstrap.cc:654] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.945887 27212 raft_consensus.cc:493] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.946578 27212 raft_consensus.cc:515] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.950803 27206 raft_consensus.cc:493] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.951508 27206 raft_consensus.cc:515] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.952584 27202 ts_tablet_manager.cc:1434] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:22:08.953851 27202 tablet_bootstrap.cc:492] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:08.959867 26910 catalog_manager.cc:5697] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed01b2067d964cfda687492d191b6c71 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "ed01b2067d964cfda687492d191b6c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:08.961740 27203 tablet_bootstrap.cc:654] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.962260 27202 tablet_bootstrap.cc:654] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.968777 26910 catalog_manager.cc:5697] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed01b2067d964cfda687492d191b6c71 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "ed01b2067d964cfda687492d191b6c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:08.972147 26910 catalog_manager.cc:5697] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed01b2067d964cfda687492d191b6c71 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "ed01b2067d964cfda687492d191b6c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.960805 27212 leader_election.cc:290] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:08.964254 27206 leader_election.cc:290] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:08.964150 27205 tablet_bootstrap.cc:492] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:08.980562 27205 ts_tablet_manager.cc:1403] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.004s
I20260709 13:22:08.984356 27205 raft_consensus.cc:359] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.985188 27205 raft_consensus.cc:385] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.985512 27205 raft_consensus.cc:740] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.986331 27205 consensus_queue.cc:260] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:08.990360 27205 ts_tablet_manager.cc:1434] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:08.996237 27205 tablet_bootstrap.cc:492] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:08.997287 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ac67bcf014728bfa8c133e03bc6f9" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:09.005039 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49637e146f304243aeffc8c6e25e4c85" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
W20260709 13:22:09.007117 26977 leader_election.cc:343] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:09.008704 27212 raft_consensus.cc:493] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:09.008937 27205 tablet_bootstrap.cc:654] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:09.011680 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ac67bcf014728bfa8c133e03bc6f9" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:09.012553 27206 raft_consensus.cc:493] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:09.013146 27206 raft_consensus.cc:515] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.013880 27203 tablet_bootstrap.cc:492] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:09.014479 27203 ts_tablet_manager.cc:1403] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.002s
I20260709 13:22:09.012609 27162 raft_consensus.cc:2468] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 0.
I20260709 13:22:09.017304 27052 leader_election.cc:304] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
W20260709 13:22:09.019294 27053 leader_election.cc:343] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:09.009382 27212 raft_consensus.cc:515] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.021884 27206 leader_election.cc:290] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.023116 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff26d53286646eb9892a573cdb2ecfe" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:09.023540 27212 leader_election.cc:290] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.023931 27088 raft_consensus.cc:2468] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 0.
I20260709 13:22:09.024329 27212 raft_consensus.cc:2804] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:09.024832 27212 raft_consensus.cc:493] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:09.025282 27212 raft_consensus.cc:3060] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.026048 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d721351ee0e4501836ff08539f40750" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:09.026861 27013 raft_consensus.cc:2468] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 0.
I20260709 13:22:09.029439 27053 leader_election.cc:304] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:09.017578 27203 raft_consensus.cc:359] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.030241 27225 raft_consensus.cc:493] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:09.030242 26977 leader_election.cc:304] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:09.030942 27203 raft_consensus.cc:385] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:09.031363 27203 raft_consensus.cc:740] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:09.031190 27225 raft_consensus.cc:515] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.032265 27203 consensus_queue.cc:260] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.034933 27203 ts_tablet_manager.cc:1434] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:22:09.036015 27203 tablet_bootstrap.cc:492] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:09.036540 27225 leader_election.cc:290] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:09.039865 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f562c6f04c364ca286276a291410d192" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:09.040736 27013 raft_consensus.cc:2468] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:09.041987 27127 leader_election.cc:304] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:09.042658 27203 tablet_bootstrap.cc:654] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:09.042990 27225 raft_consensus.cc:2804] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:09.043450 27225 raft_consensus.cc:493] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:09.043860 27225 raft_consensus.cc:3060] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.012006 27202 tablet_bootstrap.cc:492] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:09.046042 27202 ts_tablet_manager.cc:1403] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.004s
I20260709 13:22:09.047528 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49637e146f304243aeffc8c6e25e4c85" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:09.048647 27162 raft_consensus.cc:2468] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 0.
I20260709 13:22:09.058358 27202 raft_consensus.cc:359] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:09.060112 27202 raft_consensus.cc:385] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:09.060568 27202 raft_consensus.cc:740] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:09.058316 27206 raft_consensus.cc:2804] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:09.063218 27202 consensus_queue.cc:260] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:09.067008 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f562c6f04c364ca286276a291410d192" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:09.068847 27205 tablet_bootstrap.cc:492] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:09.076180 27205 ts_tablet_manager.cc:1403] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.080s	user 0.032s	sys 0.033s
I20260709 13:22:09.064393 27249 raft_consensus.cc:2804] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:09.076709 27249 raft_consensus.cc:493] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:09.077095 27249 raft_consensus.cc:3060] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.079285 27205 raft_consensus.cc:359] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.080080 27205 raft_consensus.cc:385] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:09.080353 27205 raft_consensus.cc:740] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:09.063659 26977 leader_election.cc:304] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 4a40ce8ef1e646f7a376842a2287b6e6
I20260709 13:22:09.065791 27206 raft_consensus.cc:493] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:09.064505 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff26d53286646eb9892a573cdb2ecfe" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:09.064662 27212 raft_consensus.cc:515] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
W20260709 13:22:09.065454 27052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:38045, user_credentials={real_user=slave}} blocked reactor thread for 48385.2us
W20260709 13:22:09.075183 27126 leader_election.cc:343] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:09.084455 27212 leader_election.cc:290] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.082324 27162 raft_consensus.cc:2468] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 0.
I20260709 13:22:09.082401 27206 raft_consensus.cc:3060] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.087816 27205 consensus_queue.cc:260] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.090591 27205 ts_tablet_manager.cc:1434] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:22:09.091480 27249 raft_consensus.cc:515] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.093477 27249 leader_election.cc:290] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.094730 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d721351ee0e4501836ff08539f40750" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:09.103394 27205 tablet_bootstrap.cc:492] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
W20260709 13:22:09.103626 27052 leader_election.cc:343] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:09.106503 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ac67bcf014728bfa8c133e03bc6f9" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:09.107476 27162 raft_consensus.cc:3060] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.112030 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ac67bcf014728bfa8c133e03bc6f9" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:09.113305 27205 tablet_bootstrap.cc:654] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:09.113602 27012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d721351ee0e4501836ff08539f40750" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:09.114298 27012 raft_consensus.cc:3060] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.087831 27202 ts_tablet_manager.cc:1434] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.041s	user 0.018s	sys 0.001s
I20260709 13:22:09.117527 27202 tablet_bootstrap.cc:492] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:09.118634 27252 raft_consensus.cc:2804] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:22:09.118521 26977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.67:38045, user_credentials={real_user=slave}} blocked reactor thread for 55913.2us
I20260709 13:22:09.118932 27251 raft_consensus.cc:493] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:09.119323 27252 raft_consensus.cc:493] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:09.119771 27252 raft_consensus.cc:3060] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.119656 27251 raft_consensus.cc:515] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
W20260709 13:22:09.126921 27053 leader_election.cc:343] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:09.112015 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d721351ee0e4501836ff08539f40750" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:09.128750 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ad9535642349629902c3ff840fedbd" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:09.129670 27088 raft_consensus.cc:2393] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fec71feeb50406b9395a638b88dc370 in current term 1: Already voted for candidate ed01b2067d964cfda687492d191b6c71 in this term.
I20260709 13:22:09.123014 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ad9535642349629902c3ff840fedbd" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:09.130497 27225 raft_consensus.cc:515] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.132838 27225 leader_election.cc:290] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:09.125859 27252 raft_consensus.cc:515] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
W20260709 13:22:09.134317 27052 leader_election.cc:343] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:09.132854 26977 leader_election.cc:304] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370; no voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71
I20260709 13:22:09.138312 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f562c6f04c364ca286276a291410d192" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:09.139539 27088 raft_consensus.cc:3060] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.141134 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49637e146f304243aeffc8c6e25e4c85" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:09.142411 27087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49637e146f304243aeffc8c6e25e4c85" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:09.141817 27160 raft_consensus.cc:3060] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.139947 27206 raft_consensus.cc:515] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.145172 27202 tablet_bootstrap.cc:654] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:09.146055 27206 leader_election.cc:290] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 election: Requested vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.146724 27206 raft_consensus.cc:3060] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.148180 27162 raft_consensus.cc:2468] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 1.
I20260709 13:22:09.122012 27251 leader_election.cc:290] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:09.150799 27203 tablet_bootstrap.cc:492] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:09.140156 27012 raft_consensus.cc:2468] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 1.
I20260709 13:22:09.152940 27203 ts_tablet_manager.cc:1403] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.117s	user 0.030s	sys 0.027s
I20260709 13:22:09.151880 27160 raft_consensus.cc:2468] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 1.
I20260709 13:22:09.135300 27252 leader_election.cc:290] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 election: Requested vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.153481 27088 raft_consensus.cc:2468] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:09.153622 27052 leader_election.cc:304] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:09.154857 27053 leader_election.cc:304] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: ed01b2067d964cfda687492d191b6c71
I20260709 13:22:09.155853 27249 raft_consensus.cc:2804] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:09.156193 27212 raft_consensus.cc:2804] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:09.158777 27087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff26d53286646eb9892a573cdb2ecfe" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:09.167511 27203 raft_consensus.cc:359] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.166002 27087 raft_consensus.cc:3060] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.169593 27126 leader_election.cc:304] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:09.169809 27257 raft_consensus.cc:493] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:09.169646 27012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f562c6f04c364ca286276a291410d192" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:09.170819 27212 raft_consensus.cc:697] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:09.170849 27225 raft_consensus.cc:2804] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:09.171612 27206 raft_consensus.cc:2749] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:09.171775 27225 raft_consensus.cc:697] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Leader. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:09.168700 27203 raft_consensus.cc:385] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:09.172482 27203 raft_consensus.cc:740] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:09.172140 27212 consensus_queue.cc:237] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.172820 27225 consensus_queue.cc:237] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
W20260709 13:22:09.174588 26977 leader_election.cc:343] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:09.175093 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff26d53286646eb9892a573cdb2ecfe" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:09.175693 27012 raft_consensus.cc:3060] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.170818 27257 raft_consensus.cc:515] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.175736 27162 raft_consensus.cc:3060] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.181217 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefede0f65c4903a92f1d6e143c4cfb" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:09.181535 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefede0f65c4903a92f1d6e143c4cfb" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:09.182338 27013 raft_consensus.cc:2393] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a40ce8ef1e646f7a376842a2287b6e6 in current term 1: Already voted for candidate ed01b2067d964cfda687492d191b6c71 in this term.
I20260709 13:22:09.183921 27053 leader_election.cc:304] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6; no voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71
I20260709 13:22:09.184334 27257 leader_election.cc:290] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.179939 27087 raft_consensus.cc:2468] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 1.
I20260709 13:22:09.185608 27212 raft_consensus.cc:3060] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.189236 27202 tablet_bootstrap.cc:492] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:09.189878 27202 ts_tablet_manager.cc:1403] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.002s
I20260709 13:22:09.191299 26977 leader_election.cc:304] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:09.192445 26977 leader_election.cc:304] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 4a40ce8ef1e646f7a376842a2287b6e6
I20260709 13:22:09.194473 27202 raft_consensus.cc:359] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.194867 27249 raft_consensus.cc:697] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:09.194550 27253 raft_consensus.cc:2804] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:09.195467 27202 raft_consensus.cc:385] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:09.195904 27253 raft_consensus.cc:697] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 1 LEADER]: Becoming Leader. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:09.196264 27202 raft_consensus.cc:740] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:09.197435 27202 consensus_queue.cc:260] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.197304 27253 consensus_queue.cc:237] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.195988 27205 tablet_bootstrap.cc:492] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:09.198874 27205 ts_tablet_manager.cc:1403] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.014s
I20260709 13:22:09.199823 27202 ts_tablet_manager.cc:1434] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:22:09.194707 27206 raft_consensus.cc:2804] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:09.200801 27206 raft_consensus.cc:697] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 1 LEADER]: Becoming Leader. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:09.197453 27249 consensus_queue.cc:237] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.201786 27206 consensus_queue.cc:237] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.173570 27203 consensus_queue.cc:260] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.202508 27205 raft_consensus.cc:359] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.204089 27205 raft_consensus.cc:385] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:09.206591 27205 raft_consensus.cc:740] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:09.207685 27205 consensus_queue.cc:260] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.190009 27162 raft_consensus.cc:2468] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 1.
I20260709 13:22:09.205269 27203 ts_tablet_manager.cc:1434] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:22:09.205737 27212 raft_consensus.cc:2749] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:09.211603 27205 ts_tablet_manager.cc:1434] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:22:09.213150 27205 tablet_bootstrap.cc:492] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:09.212283 26908 catalog_manager.cc:5697] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed01b2067d964cfda687492d191b6c71 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "ed01b2067d964cfda687492d191b6c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:09.228307 27205 tablet_bootstrap.cc:654] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:09.235191 27225 consensus_queue.cc:1048] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.242240 27205 tablet_bootstrap.cc:492] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:09.243129 27205 ts_tablet_manager.cc:1403] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.007s
I20260709 13:22:09.247022 27205 raft_consensus.cc:359] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.248230 27205 raft_consensus.cc:385] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:09.248663 27205 raft_consensus.cc:740] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:09.249845 27205 consensus_queue.cc:260] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.253054 27205 ts_tablet_manager.cc:1434] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:09.257038 27012 raft_consensus.cc:2468] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:09.263332 27225 consensus_queue.cc:1048] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:09.279189 27259 log.cc:927] Time spent T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:22:09.279529 27223 consensus_queue.cc:1048] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.286892 27212 raft_consensus.cc:493] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:09.287575 27212 raft_consensus.cc:515] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.287869 26910 catalog_manager.cc:5697] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fec71feeb50406b9395a638b88dc370 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "6fec71feeb50406b9395a638b88dc370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:09.290915 27212 leader_election.cc:290] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.292426 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49637e146f304243aeffc8c6e25e4c85" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:09.293283 27162 raft_consensus.cc:2393] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a40ce8ef1e646f7a376842a2287b6e6 in current term 1: Already voted for candidate 6fec71feeb50406b9395a638b88dc370 in this term.
I20260709 13:22:09.301062 27012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49637e146f304243aeffc8c6e25e4c85" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:09.302829 27053 leader_election.cc:304] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6; no voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71
I20260709 13:22:09.304659 27209 raft_consensus.cc:493] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:09.305408 27209 raft_consensus.cc:515] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.309232 27209 leader_election.cc:290] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:09.309464 27011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d721351ee0e4501836ff08539f40750" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:09.310371 27011 raft_consensus.cc:2393] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed01b2067d964cfda687492d191b6c71 in current term 1: Already voted for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in this term.
I20260709 13:22:09.310820 27212 raft_consensus.cc:3060] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.311106 27087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d721351ee0e4501836ff08539f40750" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:09.314740 27126 leader_election.cc:304] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed01b2067d964cfda687492d191b6c71; no voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:09.316886 27223 raft_consensus.cc:3060] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.333190 27223 raft_consensus.cc:2749] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:09.340080 27212 raft_consensus.cc:2749] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:09.354156 27088 raft_consensus.cc:3060] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.349972 26908 catalog_manager.cc:5697] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:09.355610 26908 catalog_manager.cc:5697] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:09.360313 27218 consensus_queue.cc:1048] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.364989 27218 consensus_queue.cc:1048] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.368821 26909 catalog_manager.cc:5697] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fec71feeb50406b9395a638b88dc370 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "6fec71feeb50406b9395a638b88dc370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:09.377022 27223 consensus_queue.cc:1048] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.403362 27223 consensus_queue.cc:1048] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.416210 27206 raft_consensus.cc:493] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:09.416788 27206 raft_consensus.cc:515] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.419338 27206 leader_election.cc:290] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.421974 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ac67bcf014728bfa8c133e03bc6f9" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:09.422245 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ac67bcf014728bfa8c133e03bc6f9" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:09.422955 27162 raft_consensus.cc:2393] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fec71feeb50406b9395a638b88dc370 in current term 1: Already voted for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in this term.
I20260709 13:22:09.421295 27223 consensus_queue.cc:1048] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:22:09.424388 26977 leader_election.cc:304] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370; no voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71
I20260709 13:22:09.425736 27206 raft_consensus.cc:3060] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.434562 27206 raft_consensus.cc:2749] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:09.434442 27162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43ad9535642349629902c3ff840fedbd"
dest_uuid: "ed01b2067d964cfda687492d191b6c71"
mode: GRACEFUL
new_leader_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:34498
I20260709 13:22:09.435480 27162 raft_consensus.cc:606] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Received request to transfer leadership to TS 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:09.441593 27162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47485825deb14081a6adcfb26a03c1f5"
dest_uuid: "ed01b2067d964cfda687492d191b6c71"
mode: GRACEFUL
new_leader_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:34498
I20260709 13:22:09.442312 27162 raft_consensus.cc:606] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Received request to transfer leadership to TS 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:09.448065 27162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cefede0f65c4903a92f1d6e143c4cfb"
dest_uuid: "ed01b2067d964cfda687492d191b6c71"
mode: GRACEFUL
new_leader_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:34498
I20260709 13:22:09.448767 27162 raft_consensus.cc:606] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Received request to transfer leadership to TS 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:09.454303 27162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbb2d42d01e7460c8d8a44c0bdfd2d5f"
dest_uuid: "ed01b2067d964cfda687492d191b6c71"
mode: GRACEFUL
new_leader_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:34498
I20260709 13:22:09.454916 27162 raft_consensus.cc:606] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Received request to transfer leadership to TS 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:09.468659 27013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff26d53286646eb9892a573cdb2ecfe"
dest_uuid: "6fec71feeb50406b9395a638b88dc370"
mode: GRACEFUL
new_leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
 from {username='slave'} at 127.0.0.1:36424
I20260709 13:22:09.469208 27013 raft_consensus.cc:606] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 1 LEADER]: Received request to transfer leadership to TS 4a40ce8ef1e646f7a376842a2287b6e6
I20260709 13:22:09.475385 27013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49637e146f304243aeffc8c6e25e4c85"
dest_uuid: "6fec71feeb50406b9395a638b88dc370"
mode: GRACEFUL
new_leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
 from {username='slave'} at 127.0.0.1:36424
I20260709 13:22:09.475997 27013 raft_consensus.cc:606] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 1 LEADER]: Received request to transfer leadership to TS 4a40ce8ef1e646f7a376842a2287b6e6
I20260709 13:22:09.481993 27162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f562c6f04c364ca286276a291410d192"
dest_uuid: "ed01b2067d964cfda687492d191b6c71"
mode: GRACEFUL
new_leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
 from {username='slave'} at 127.0.0.1:34498
I20260709 13:22:09.482645 27162 raft_consensus.cc:606] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Received request to transfer leadership to TS 4a40ce8ef1e646f7a376842a2287b6e6
I20260709 13:22:09.500707 27088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "400ac67bcf014728bfa8c133e03bc6f9"
dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
mode: GRACEFUL
new_leader_uuid: "ed01b2067d964cfda687492d191b6c71"
 from {username='slave'} at 127.0.0.1:45744
I20260709 13:22:09.501379 27088 raft_consensus.cc:606] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Received request to transfer leadership to TS ed01b2067d964cfda687492d191b6c71
I20260709 13:22:09.592336 27206 consensus_queue.cc:1048] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.600804 27253 raft_consensus.cc:993] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370: : Instructing follower 4a40ce8ef1e646f7a376842a2287b6e6 to start an election
I20260709 13:22:09.601394 27253 raft_consensus.cc:1081] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 1 LEADER]: Signalling peer 4a40ce8ef1e646f7a376842a2287b6e6 to start an election
I20260709 13:22:09.602243 27223 consensus_queue.cc:1048] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.603318 27088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49637e146f304243aeffc8c6e25e4c85"
dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
 from {username='slave'} at 127.0.0.1:45734
I20260709 13:22:09.604127 27088 raft_consensus.cc:493] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:09.604576 27088 raft_consensus.cc:3060] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.610145 27251 consensus_queue.cc:1048] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.614792 27249 consensus_queue.cc:1048] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.615980 27225 raft_consensus.cc:993] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71: : Instructing follower 4a40ce8ef1e646f7a376842a2287b6e6 to start an election
I20260709 13:22:09.616503 27225 raft_consensus.cc:1081] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Signalling peer 4a40ce8ef1e646f7a376842a2287b6e6 to start an election
I20260709 13:22:09.618961 27088 raft_consensus.cc:515] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.621155 27085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f562c6f04c364ca286276a291410d192"
dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
 from {username='slave'} at 127.0.0.1:45724
I20260709 13:22:09.622141 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49637e146f304243aeffc8c6e25e4c85" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:09.622942 27013 raft_consensus.cc:3055] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:09.623193 27086 raft_consensus.cc:1240] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Rejecting Update request from peer 6fec71feeb50406b9395a638b88dc370 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:09.623342 27013 raft_consensus.cc:740] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:09.624377 27013 consensus_queue.cc:260] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.625470 27013 raft_consensus.cc:3060] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.626251 27085 raft_consensus.cc:493] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:09.626868 27085 raft_consensus.cc:3060] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.631852 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49637e146f304243aeffc8c6e25e4c85" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:09.632625 27162 raft_consensus.cc:3060] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.633071 27228 consensus_queue.cc:1048] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.640305 27162 raft_consensus.cc:2468] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 2.
I20260709 13:22:09.640950 27088 leader_election.cc:290] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 2 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.640307 27013 raft_consensus.cc:2468] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 2.
I20260709 13:22:09.641794 27253 consensus_queue.cc:1048] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.644568 27085 raft_consensus.cc:515] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.645869 27052 leader_election.cc:304] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:09.647200 27249 raft_consensus.cc:2804] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:09.647986 27249 raft_consensus.cc:697] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:09.649667 27249 consensus_queue.cc:237] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.650461 27212 consensus_queue.cc:1048] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.652364 27085 leader_election.cc:290] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 2 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.657123 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f562c6f04c364ca286276a291410d192" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:09.658008 27161 raft_consensus.cc:3055] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:09.658403 27161 raft_consensus.cc:740] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:09.663414 27161 consensus_queue.cc:260] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.665465 27161 raft_consensus.cc:3060] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.669195 26909 catalog_manager.cc:5697] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 reported cstate change: term changed from 1 to 2, leader changed from 6fec71feeb50406b9395a638b88dc370 (127.15.242.65) to 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:09.657141 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f562c6f04c364ca286276a291410d192" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:09.671212 27013 raft_consensus.cc:3060] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.682808 27013 raft_consensus.cc:2468] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 2.
I20260709 13:22:09.683985 27161 raft_consensus.cc:2468] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 2.
I20260709 13:22:09.684214 27053 leader_election.cc:304] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:09.685213 27249 raft_consensus.cc:2804] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:09.685745 27249 raft_consensus.cc:697] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:09.686743 27249 consensus_queue.cc:237] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.692247 27252 consensus_queue.cc:1048] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.701568 27252 raft_consensus.cc:993] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370: : Instructing follower 4a40ce8ef1e646f7a376842a2287b6e6 to start an election
I20260709 13:22:09.702339 27252 raft_consensus.cc:1081] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 1 LEADER]: Signalling peer 4a40ce8ef1e646f7a376842a2287b6e6 to start an election
I20260709 13:22:09.702478 26909 catalog_manager.cc:5697] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 reported cstate change: term changed from 1 to 2, leader changed from ed01b2067d964cfda687492d191b6c71 (127.15.242.67) to 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:09.704873 27085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ff26d53286646eb9892a573cdb2ecfe"
dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
 from {username='slave'} at 127.0.0.1:45734
I20260709 13:22:09.705520 27085 raft_consensus.cc:493] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:09.705895 27085 raft_consensus.cc:3060] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.712503 27085 raft_consensus.cc:515] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.714577 27085 leader_election.cc:290] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 2 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.715252 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff26d53286646eb9892a573cdb2ecfe" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:09.715888 27013 raft_consensus.cc:3055] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:09.716195 27013 raft_consensus.cc:740] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:09.715981 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff26d53286646eb9892a573cdb2ecfe" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:09.716938 27161 raft_consensus.cc:3060] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.717247 27013 consensus_queue.cc:260] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.718731 27013 raft_consensus.cc:3060] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.721030 27212 consensus_queue.cc:1048] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.725008 27161 raft_consensus.cc:2468] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 2.
I20260709 13:22:09.725553 27013 raft_consensus.cc:2468] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 2.
I20260709 13:22:09.726537 27052 leader_election.cc:304] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:09.727854 27212 raft_consensus.cc:2804] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:09.728385 27212 raft_consensus.cc:697] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:09.729410 27212 consensus_queue.cc:237] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.731468 27257 raft_consensus.cc:993] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6: : Instructing follower ed01b2067d964cfda687492d191b6c71 to start an election
I20260709 13:22:09.731976 27257 raft_consensus.cc:1081] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Signalling peer ed01b2067d964cfda687492d191b6c71 to start an election
I20260709 13:22:09.735369 27161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "400ac67bcf014728bfa8c133e03bc6f9"
dest_uuid: "ed01b2067d964cfda687492d191b6c71"
 from {username='slave'} at 127.0.0.1:34474
I20260709 13:22:09.736212 27161 raft_consensus.cc:493] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:09.736861 27161 raft_consensus.cc:3060] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.736822 27256 consensus_queue.cc:1048] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.739473 26910 catalog_manager.cc:5697] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 reported cstate change: term changed from 1 to 2, leader changed from 6fec71feeb50406b9395a638b88dc370 (127.15.242.65) to 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:09.744781 27161 raft_consensus.cc:515] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.748027 27011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ac67bcf014728bfa8c133e03bc6f9" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:09.753381 27161 leader_election.cc:290] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 2 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:09.754819 27085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ac67bcf014728bfa8c133e03bc6f9" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:09.755493 27085 raft_consensus.cc:3055] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:09.755800 27085 raft_consensus.cc:740] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:09.756656 27085 consensus_queue.cc:260] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.757922 27085 raft_consensus.cc:3060] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.763827 27228 raft_consensus.cc:993] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71: : Instructing follower 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:09.764474 27209 raft_consensus.cc:1081] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Signalling peer 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:09.766637 27085 raft_consensus.cc:2468] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 2.
I20260709 13:22:09.768222 27126 leader_election.cc:304] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:09.769099 27228 raft_consensus.cc:2804] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:09.769407 27011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbb2d42d01e7460c8d8a44c0bdfd2d5f"
dest_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:36402
I20260709 13:22:09.769656 27228 raft_consensus.cc:697] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 2 LEADER]: Becoming Leader. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:09.770323 27011 raft_consensus.cc:493] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:09.770756 27011 raft_consensus.cc:3060] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.770825 27228 consensus_queue.cc:237] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.773205 27225 raft_consensus.cc:993] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71: : Instructing follower 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:09.773715 27225 raft_consensus.cc:1081] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Signalling peer 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:09.775830 27013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cefede0f65c4903a92f1d6e143c4cfb"
dest_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:36402
I20260709 13:22:09.776682 27013 raft_consensus.cc:493] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:09.777105 27013 raft_consensus.cc:3060] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.778579 27011 raft_consensus.cc:515] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.781136 27011 leader_election.cc:290] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Requested vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.782459 27085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb2d42d01e7460c8d8a44c0bdfd2d5f" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:09.782733 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb2d42d01e7460c8d8a44c0bdfd2d5f" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:09.783169 27085 raft_consensus.cc:3060] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.783294 27161 raft_consensus.cc:3055] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:09.783700 27161 raft_consensus.cc:740] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:09.784644 27013 raft_consensus.cc:515] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.784540 27161 consensus_queue.cc:260] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.785940 27161 raft_consensus.cc:3060] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.786618 27013 leader_election.cc:290] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Requested vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.789203 26909 catalog_manager.cc:5697] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 reported cstate change: term changed from 1 to 2, leader changed from 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66) to ed01b2067d964cfda687492d191b6c71 (127.15.242.67). New cstate: current_term: 2 leader_uuid: "ed01b2067d964cfda687492d191b6c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:09.790761 27085 raft_consensus.cc:2468] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:09.791576 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefede0f65c4903a92f1d6e143c4cfb" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:09.792313 27088 raft_consensus.cc:3060] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.794335 26977 leader_election.cc:304] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:09.795852 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefede0f65c4903a92f1d6e143c4cfb" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:09.796440 27251 raft_consensus.cc:2804] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:09.796572 27162 raft_consensus.cc:3055] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:09.797199 27251 raft_consensus.cc:697] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Becoming Leader. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:09.797142 27162 raft_consensus.cc:740] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:09.798290 27251 consensus_queue.cc:237] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.799124 27162 consensus_queue.cc:260] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.800679 27162 raft_consensus.cc:3060] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.801028 27088 raft_consensus.cc:2468] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:09.794687 27161 raft_consensus.cc:2468] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:09.803800 26977 leader_election.cc:304] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:09.804586 27251 raft_consensus.cc:2804] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:09.805079 27251 raft_consensus.cc:697] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Becoming Leader. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:09.805877 27251 consensus_queue.cc:237] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.807152 26909 catalog_manager.cc:5697] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 reported cstate change: term changed from 1 to 2, leader changed from ed01b2067d964cfda687492d191b6c71 (127.15.242.67) to 6fec71feeb50406b9395a638b88dc370 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "6fec71feeb50406b9395a638b88dc370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:09.809553 27162 raft_consensus.cc:2468] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:09.821156 26909 catalog_manager.cc:5697] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 reported cstate change: term changed from 1 to 2, leader changed from ed01b2067d964cfda687492d191b6c71 (127.15.242.67) to 6fec71feeb50406b9395a638b88dc370 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "6fec71feeb50406b9395a638b88dc370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:09.859105 27209 raft_consensus.cc:993] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71: : Instructing follower 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:09.859617 27228 raft_consensus.cc:1081] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Signalling peer 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:09.861294 27013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47485825deb14081a6adcfb26a03c1f5"
dest_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:36402
I20260709 13:22:09.861841 27013 raft_consensus.cc:493] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:09.862265 27013 raft_consensus.cc:3060] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.869309 27013 raft_consensus.cc:515] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.871600 27013 leader_election.cc:290] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Requested vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:09.872291 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47485825deb14081a6adcfb26a03c1f5" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:09.872836 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47485825deb14081a6adcfb26a03c1f5" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:09.872960 27088 raft_consensus.cc:3060] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.873759 27162 raft_consensus.cc:3055] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:09.874213 27162 raft_consensus.cc:740] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:09.875277 27162 consensus_queue.cc:260] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.876730 27162 raft_consensus.cc:3060] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.881928 27088 raft_consensus.cc:2468] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:09.883505 26977 leader_election.cc:304] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:09.884452 27251 raft_consensus.cc:2804] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:09.884889 27251 raft_consensus.cc:697] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Becoming Leader. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:09.884871 27162 raft_consensus.cc:2468] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:09.885888 27251 consensus_queue.cc:237] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:09.892923 26909 catalog_manager.cc:5697] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 reported cstate change: term changed from 1 to 2, leader changed from ed01b2067d964cfda687492d191b6c71 (127.15.242.67) to 6fec71feeb50406b9395a638b88dc370 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "6fec71feeb50406b9395a638b88dc370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:09.935545 27209 raft_consensus.cc:993] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71: : Instructing follower 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:09.936050 27228 raft_consensus.cc:1081] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Signalling peer 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:09.938125 27013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43ad9535642349629902c3ff840fedbd"
dest_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:36402
I20260709 13:22:09.938643 27013 raft_consensus.cc:493] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:09.938966 27013 raft_consensus.cc:3060] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.944618 27013 raft_consensus.cc:515] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:09.946455 27013 leader_election.cc:290] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Requested vote from peers ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:09.947512 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ad9535642349629902c3ff840fedbd" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:09.947798 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ad9535642349629902c3ff840fedbd" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:09.948230 27162 raft_consensus.cc:3055] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:09.948333 27088 raft_consensus.cc:3060] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.948632 27162 raft_consensus.cc:740] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:09.949510 27162 consensus_queue.cc:260] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:09.950816 27162 raft_consensus.cc:3060] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.955924 27088 raft_consensus.cc:2468] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:09.957410 26977 leader_election.cc:304] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:09.958160 27162 raft_consensus.cc:2468] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:09.958462 27251 raft_consensus.cc:2804] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:09.959117 27251 raft_consensus.cc:697] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Becoming Leader. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:09.959956 27251 consensus_queue.cc:237] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:09.967428 26909 catalog_manager.cc:5697] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 reported cstate change: term changed from 1 to 2, leader changed from ed01b2067d964cfda687492d191b6c71 (127.15.242.67) to 6fec71feeb50406b9395a638b88dc370 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "6fec71feeb50406b9395a638b88dc370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:10.120591 27162 raft_consensus.cc:1275] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 4a40ce8ef1e646f7a376842a2287b6e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.121973 27256 consensus_queue.cc:1048] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.131959 27013 raft_consensus.cc:1275] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Refusing update from remote peer 4a40ce8ef1e646f7a376842a2287b6e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.135401 27256 consensus_queue.cc:1048] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.169427 27162 raft_consensus.cc:1275] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 4a40ce8ef1e646f7a376842a2287b6e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.170980 27256 consensus_queue.cc:1048] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.179193 27013 raft_consensus.cc:1275] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Refusing update from remote peer 4a40ce8ef1e646f7a376842a2287b6e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.181324 27212 consensus_queue.cc:1048] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.185827 27162 raft_consensus.cc:1275] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 4a40ce8ef1e646f7a376842a2287b6e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.187258 27212 consensus_queue.cc:1048] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.197053 27013 raft_consensus.cc:1275] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Refusing update from remote peer 4a40ce8ef1e646f7a376842a2287b6e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.199177 27256 consensus_queue.cc:1048] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.241852 27162 raft_consensus.cc:1275] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.243422 27251 consensus_queue.cc:1048] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.253001 27088 raft_consensus.cc:1275] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.254491 27251 consensus_queue.cc:1048] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.302304 27162 raft_consensus.cc:1275] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.303869 27251 consensus_queue.cc:1048] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.312350 27088 raft_consensus.cc:1275] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.316041 27286 consensus_queue.cc:1048] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.317489 27013 raft_consensus.cc:3060] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.326249 27013 raft_consensus.cc:1275] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Refusing update from remote peer ed01b2067d964cfda687492d191b6c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.328058 27228 consensus_queue.cc:1048] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.337138 27088 raft_consensus.cc:1275] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Refusing update from remote peer ed01b2067d964cfda687492d191b6c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.339089 27228 consensus_queue.cc:1048] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.405562 27088 raft_consensus.cc:1275] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.407234 27251 consensus_queue.cc:1048] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.408609 27088 raft_consensus.cc:1275] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.410123 27251 consensus_queue.cc:1048] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.418826 27162 raft_consensus.cc:1275] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.420433 27251 consensus_queue.cc:1048] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.430655 27162 raft_consensus.cc:1275] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.433995 27206 consensus_queue.cc:1048] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:12.533828 26910 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35486:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:12.536058 26910 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:12.589015 26995 tablet_service.cc:1511] Processing CreateTablet for tablet 8dacf9d04568491d9a4749a7b35558b1 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:12.590411 26995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dacf9d04568491d9a4749a7b35558b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.590536 27075 tablet_service.cc:1511] Processing CreateTablet for tablet 8dacf9d04568491d9a4749a7b35558b1 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:12.591775 27075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dacf9d04568491d9a4749a7b35558b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.593879 27145 tablet_service.cc:1511] Processing CreateTablet for tablet 8dacf9d04568491d9a4749a7b35558b1 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:12.595238 27145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dacf9d04568491d9a4749a7b35558b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.597321 27148 tablet_service.cc:1511] Processing CreateTablet for tablet 73cfe7c8c31b48e2aea8f527da7a0856 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:12.598747 27148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73cfe7c8c31b48e2aea8f527da7a0856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.599053 27003 tablet_service.cc:1511] Processing CreateTablet for tablet 73cfe7c8c31b48e2aea8f527da7a0856 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:12.600342 27003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73cfe7c8c31b48e2aea8f527da7a0856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.603092 27073 tablet_service.cc:1511] Processing CreateTablet for tablet 73cfe7c8c31b48e2aea8f527da7a0856 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:12.604496 27073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73cfe7c8c31b48e2aea8f527da7a0856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.612529 26999 tablet_service.cc:1511] Processing CreateTablet for tablet 733a4719f64849ea9312c28c470fd396 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:12.613924 26999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733a4719f64849ea9312c28c470fd396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.614506 27072 tablet_service.cc:1511] Processing CreateTablet for tablet 733a4719f64849ea9312c28c470fd396 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:12.615810 27072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733a4719f64849ea9312c28c470fd396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.621961 27144 tablet_service.cc:1511] Processing CreateTablet for tablet 733a4719f64849ea9312c28c470fd396 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:12.623418 27144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733a4719f64849ea9312c28c470fd396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.625036 26996 tablet_service.cc:1511] Processing CreateTablet for tablet ece4cd7e70e34b1b8160736a9054eb47 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:12.626425 26996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ece4cd7e70e34b1b8160736a9054eb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.636655 27076 tablet_service.cc:1511] Processing CreateTablet for tablet ece4cd7e70e34b1b8160736a9054eb47 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:12.639053 27076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ece4cd7e70e34b1b8160736a9054eb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.660755 27070 tablet_service.cc:1511] Processing CreateTablet for tablet 66af67d5583c4a7b80c0982db79344fd (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:12.661183 27074 tablet_service.cc:1511] Processing CreateTablet for tablet f7474efa812d493f99e0d67edea2a7e5 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:12.662259 27070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66af67d5583c4a7b80c0982db79344fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.663120 27152 tablet_service.cc:1511] Processing CreateTablet for tablet f7474efa812d493f99e0d67edea2a7e5 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:12.663255 26997 tablet_service.cc:1511] Processing CreateTablet for tablet f7474efa812d493f99e0d67edea2a7e5 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:12.664485 27152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7474efa812d493f99e0d67edea2a7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.664666 26997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7474efa812d493f99e0d67edea2a7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.664149 26998 tablet_service.cc:1511] Processing CreateTablet for tablet 66af67d5583c4a7b80c0982db79344fd (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:12.666889 26998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66af67d5583c4a7b80c0982db79344fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.667419 27001 tablet_service.cc:1511] Processing CreateTablet for tablet 988b8755d9ea4becafa0b5941a73badc (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:12.668658 27001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988b8755d9ea4becafa0b5941a73badc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.661912 27146 tablet_service.cc:1511] Processing CreateTablet for tablet ece4cd7e70e34b1b8160736a9054eb47 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:12.670758 27146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ece4cd7e70e34b1b8160736a9054eb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.671008 27078 tablet_service.cc:1511] Processing CreateTablet for tablet 988b8755d9ea4becafa0b5941a73badc (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:12.673159 27149 tablet_service.cc:1511] Processing CreateTablet for tablet 988b8755d9ea4becafa0b5941a73badc (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:12.676877 27074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7474efa812d493f99e0d67edea2a7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.678356 27078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988b8755d9ea4becafa0b5941a73badc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.678246 27147 tablet_service.cc:1511] Processing CreateTablet for tablet 66af67d5583c4a7b80c0982db79344fd (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:12.679603 27147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66af67d5583c4a7b80c0982db79344fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.684420 27149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988b8755d9ea4becafa0b5941a73badc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.687306 27305 tablet_bootstrap.cc:492] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:12.687907 26996 tablet_service.cc:1511] Processing CreateTablet for tablet 3396d3e3977c4cee8ff5acdc7a873501 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:12.689949 26996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3396d3e3977c4cee8ff5acdc7a873501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.701995 27075 tablet_service.cc:1511] Processing CreateTablet for tablet 3396d3e3977c4cee8ff5acdc7a873501 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:12.714768 27151 tablet_service.cc:1511] Processing CreateTablet for tablet 3396d3e3977c4cee8ff5acdc7a873501 (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:12.723703 27151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3396d3e3977c4cee8ff5acdc7a873501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.730754 27304 tablet_bootstrap.cc:492] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:12.743083 27070 tablet_service.cc:1511] Processing CreateTablet for tablet ed0de837d4fb416b8612d7bfee17fc2e (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:12.748526 27145 tablet_service.cc:1511] Processing CreateTablet for tablet ed0de837d4fb416b8612d7bfee17fc2e (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:12.749924 27145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed0de837d4fb416b8612d7bfee17fc2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.750840 27306 tablet_bootstrap.cc:492] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:12.758001 27306 tablet_bootstrap.cc:654] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.759984 27304 tablet_bootstrap.cc:654] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.761795 27075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3396d3e3977c4cee8ff5acdc7a873501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.766371 27070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed0de837d4fb416b8612d7bfee17fc2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.766970 26998 tablet_service.cc:1511] Processing CreateTablet for tablet ed0de837d4fb416b8612d7bfee17fc2e (DEFAULT_TABLE table=soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:12.768318 26998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed0de837d4fb416b8612d7bfee17fc2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:12.776654 27305 tablet_bootstrap.cc:654] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.787843 27306 tablet_bootstrap.cc:492] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:12.788367 27306 ts_tablet_manager.cc:1403] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.000s
I20260709 13:22:12.791479 27306 raft_consensus.cc:359] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.792371 27306 raft_consensus.cc:385] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:12.798138 27306 raft_consensus.cc:740] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:12.799167 27306 consensus_queue.cc:260] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.810781 27306 ts_tablet_manager.cc:1434] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:22:12.811821 27306 tablet_bootstrap.cc:492] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:12.815299 27304 tablet_bootstrap.cc:492] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:12.815891 27304 ts_tablet_manager.cc:1403] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.020s
I20260709 13:22:12.816031 27305 tablet_bootstrap.cc:492] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:12.816587 27305 ts_tablet_manager.cc:1403] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.130s	user 0.020s	sys 0.021s
I20260709 13:22:12.819211 27304 raft_consensus.cc:359] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.819628 27305 raft_consensus.cc:359] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.820101 27304 raft_consensus.cc:385] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:12.820349 27305 raft_consensus.cc:385] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:12.820407 27304 raft_consensus.cc:740] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:12.820730 27305 raft_consensus.cc:740] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:12.821235 27306 tablet_bootstrap.cc:654] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.821290 27304 consensus_queue.cc:260] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.821621 27305 consensus_queue.cc:260] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.823948 27305 ts_tablet_manager.cc:1434] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:22:12.825419 27305 tablet_bootstrap.cc:492] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:12.832113 27305 tablet_bootstrap.cc:654] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.837076 27304 ts_tablet_manager.cc:1434] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 13:22:12.841723 27292 raft_consensus.cc:493] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:12.842562 27292 raft_consensus.cc:515] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.846428 27292 leader_election.cc:290] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:12.847224 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73cfe7c8c31b48e2aea8f527da7a0856" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:12.849735 27085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73cfe7c8c31b48e2aea8f527da7a0856" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
W20260709 13:22:12.852136 27127 leader_election.cc:343] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:12.853029 27126 leader_election.cc:343] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:12.853636 27126 leader_election.cc:304] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed01b2067d964cfda687492d191b6c71; no voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:12.855137 27304 tablet_bootstrap.cc:492] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:12.855240 27292 raft_consensus.cc:2749] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:12.862368 26959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:12.867811 27306 tablet_bootstrap.cc:492] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:12.869904 27306 ts_tablet_manager.cc:1403] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.037s
I20260709 13:22:12.871187 27305 tablet_bootstrap.cc:492] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:12.871764 27305 ts_tablet_manager.cc:1403] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.025s
I20260709 13:22:12.867724 27304 tablet_bootstrap.cc:654] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.873494 27306 raft_consensus.cc:359] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.874490 27306 raft_consensus.cc:385] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:12.874855 27306 raft_consensus.cc:740] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:12.875746 27306 consensus_queue.cc:260] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.875739 27305 raft_consensus.cc:359] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.876971 27305 raft_consensus.cc:385] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:12.877351 27305 raft_consensus.cc:740] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:12.878377 27305 consensus_queue.cc:260] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.878829 27306 ts_tablet_manager.cc:1434] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:12.879081 27304 tablet_bootstrap.cc:492] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:12.880162 27304 ts_tablet_manager.cc:1403] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.001s
I20260709 13:22:12.881129 27305 ts_tablet_manager.cc:1434] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:22:12.883210 27306 tablet_bootstrap.cc:492] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:12.883458 27305 tablet_bootstrap.cc:492] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:12.883814 27304 raft_consensus.cc:359] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.884644 27304 raft_consensus.cc:385] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:12.884989 27304 raft_consensus.cc:740] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:12.885820 27304 consensus_queue.cc:260] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.891049 27306 tablet_bootstrap.cc:654] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.891225 27305 tablet_bootstrap.cc:654] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.891799 27304 ts_tablet_manager.cc:1434] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:22:12.893014 27304 tablet_bootstrap.cc:492] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:12.902347 27304 tablet_bootstrap.cc:654] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.904558 27306 tablet_bootstrap.cc:492] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:12.905200 27306 ts_tablet_manager.cc:1403] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 13:22:12.907581 27305 tablet_bootstrap.cc:492] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:12.911936 27306 raft_consensus.cc:359] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.915336 27305 ts_tablet_manager.cc:1403] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.000s
I20260709 13:22:12.915445 27306 raft_consensus.cc:385] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:12.915901 27306 raft_consensus.cc:740] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:12.916687 27306 consensus_queue.cc:260] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.919085 27306 ts_tablet_manager.cc:1434] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.005s
I20260709 13:22:12.919277 27305 raft_consensus.cc:359] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.920136 27306 tablet_bootstrap.cc:492] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:12.920167 27305 raft_consensus.cc:385] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:12.920782 27305 raft_consensus.cc:740] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:12.920929 27304 tablet_bootstrap.cc:492] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:12.921638 27304 ts_tablet_manager.cc:1403] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.006s
I20260709 13:22:12.921785 27305 consensus_queue.cc:260] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.925164 27304 raft_consensus.cc:359] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.925992 27304 raft_consensus.cc:385] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:12.926364 27304 raft_consensus.cc:740] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:12.927187 27304 consensus_queue.cc:260] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.927831 27305 ts_tablet_manager.cc:1434] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:22:12.928573 27306 tablet_bootstrap.cc:654] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.928992 27305 tablet_bootstrap.cc:492] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:12.933133 27304 ts_tablet_manager.cc:1434] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:22:12.934510 27304 tablet_bootstrap.cc:492] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:12.936254 27305 tablet_bootstrap.cc:654] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.940586 27256 raft_consensus.cc:493] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:12.941352 27256 raft_consensus.cc:515] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.942466 27304 tablet_bootstrap.cc:654] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.945293 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73cfe7c8c31b48e2aea8f527da7a0856" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:12.945591 27306 tablet_bootstrap.cc:492] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:12.945999 27013 raft_consensus.cc:2468] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 0.
I20260709 13:22:12.946193 27306 ts_tablet_manager.cc:1403] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.011s
I20260709 13:22:12.951439 27053 leader_election.cc:304] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:12.953006 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73cfe7c8c31b48e2aea8f527da7a0856" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:12.953965 27306 raft_consensus.cc:359] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.954006 27162 raft_consensus.cc:2468] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 0.
I20260709 13:22:12.954929 27306 raft_consensus.cc:385] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:12.955320 27306 raft_consensus.cc:740] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:12.956825 27304 tablet_bootstrap.cc:492] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:12.957451 27304 ts_tablet_manager.cc:1403] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.002s
I20260709 13:22:12.957978 27305 tablet_bootstrap.cc:492] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:12.958598 27305 ts_tablet_manager.cc:1403] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.005s
I20260709 13:22:12.943948 27256 leader_election.cc:290] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:12.960882 27256 raft_consensus.cc:2804] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:12.962636 27306 consensus_queue.cc:260] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.964656 27256 raft_consensus.cc:493] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:12.965195 27256 raft_consensus.cc:3060] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:12.960909 27304 raft_consensus.cc:359] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.966311 27304 raft_consensus.cc:385] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:12.966670 27304 raft_consensus.cc:740] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:12.966794 27306 ts_tablet_manager.cc:1434] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:22:12.967597 27304 consensus_queue.cc:260] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.961853 27305 raft_consensus.cc:359] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.969107 27305 raft_consensus.cc:385] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:12.969601 27305 raft_consensus.cc:740] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:12.970649 27305 consensus_queue.cc:260] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.973883 27305 ts_tablet_manager.cc:1434] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:22:12.975333 27305 tablet_bootstrap.cc:492] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:12.967993 27306 tablet_bootstrap.cc:492] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:12.989687 27256 raft_consensus.cc:515] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:12.994328 27305 tablet_bootstrap.cc:654] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:12.999967 27306 tablet_bootstrap.cc:654] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.000658 27319 raft_consensus.cc:493] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:13.001627 27319 raft_consensus.cc:515] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.003019 27321 raft_consensus.cc:493] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:13.004822 27322 raft_consensus.cc:493] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:13.005106 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dacf9d04568491d9a4749a7b35558b1" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:13.006943 27322 raft_consensus.cc:515] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.010211 27011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733a4719f64849ea9312c28c470fd396" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:13.010951 27011 raft_consensus.cc:2468] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 0.
I20260709 13:22:13.012540 27053 leader_election.cc:304] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:13.003538 27321 raft_consensus.cc:515] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.014650 27013 raft_consensus.cc:2468] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 0.
I20260709 13:22:13.016584 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dacf9d04568491d9a4749a7b35558b1" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:13.017340 27162 raft_consensus.cc:2468] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 0.
I20260709 13:22:13.018976 27052 leader_election.cc:304] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.019291 27306 tablet_bootstrap.cc:492] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:13.020284 27319 leader_election.cc:290] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.020432 27306 ts_tablet_manager.cc:1403] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.014s
I20260709 13:22:13.020987 27319 raft_consensus.cc:2804] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:13.021405 27319 raft_consensus.cc:493] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:13.021796 27319 raft_consensus.cc:3060] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.025574 27322 leader_election.cc:290] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.025419 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dacf9d04568491d9a4749a7b35558b1" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:13.026587 27322 raft_consensus.cc:2804] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:13.026615 27162 raft_consensus.cc:2468] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 0.
I20260709 13:22:13.027179 27322 raft_consensus.cc:493] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:13.027606 27322 raft_consensus.cc:3060] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.028247 26977 leader_election.cc:304] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.028918 27305 tablet_bootstrap.cc:492] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:13.029247 27293 raft_consensus.cc:2804] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:13.029707 27305 ts_tablet_manager.cc:1403] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.010s
I20260709 13:22:13.029768 27293 raft_consensus.cc:493] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:13.030140 27321 leader_election.cc:290] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.030475 27293 raft_consensus.cc:3060] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.034430 27305 raft_consensus.cc:359] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.035368 27305 raft_consensus.cc:385] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.036509 27306 raft_consensus.cc:359] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.037416 27306 raft_consensus.cc:385] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.037750 27306 raft_consensus.cc:740] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.038863 27256 leader_election.cc:290] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.038803 27306 consensus_queue.cc:260] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.041277 27306 ts_tablet_manager.cc:1434] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 13:22:13.042356 27306 tablet_bootstrap.cc:492] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:13.035720 27305 raft_consensus.cc:740] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.044232 27305 consensus_queue.cc:260] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.046738 27305 ts_tablet_manager.cc:1434] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:22:13.047791 27305 tablet_bootstrap.cc:492] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:13.051993 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733a4719f64849ea9312c28c470fd396" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:13.052798 27162 raft_consensus.cc:2468] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 0.
I20260709 13:22:13.054906 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73cfe7c8c31b48e2aea8f527da7a0856" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:13.055454 27162 raft_consensus.cc:3060] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.057267 27304 ts_tablet_manager.cc:1434] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.099s	user 0.024s	sys 0.031s
I20260709 13:22:13.058633 27304 tablet_bootstrap.cc:492] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:13.060036 27306 tablet_bootstrap.cc:654] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.063148 27305 tablet_bootstrap.cc:654] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.066876 27304 tablet_bootstrap.cc:654] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.062012 27322 raft_consensus.cc:515] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.071799 27322 leader_election.cc:290] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.075325 27306 tablet_bootstrap.cc:492] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:13.075515 27305 tablet_bootstrap.cc:492] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:13.075981 27306 ts_tablet_manager.cc:1403] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.002s
I20260709 13:22:13.076164 27305 ts_tablet_manager.cc:1403] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.003s
I20260709 13:22:13.079584 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dacf9d04568491d9a4749a7b35558b1" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:13.080614 27161 raft_consensus.cc:3060] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.082082 27305 raft_consensus.cc:359] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.082930 27305 raft_consensus.cc:385] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.083173 27304 tablet_bootstrap.cc:492] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:13.079576 27306 raft_consensus.cc:359] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.083840 27306 raft_consensus.cc:385] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.083935 27304 ts_tablet_manager.cc:1403] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.006s
I20260709 13:22:13.084182 27306 raft_consensus.cc:740] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.085350 27306 consensus_queue.cc:260] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.087577 27162 raft_consensus.cc:2468] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 1.
I20260709 13:22:13.087872 27306 ts_tablet_manager.cc:1434] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:22:13.085676 27293 raft_consensus.cc:515] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.089063 27052 leader_election.cc:304] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.089042 27304 raft_consensus.cc:359] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.083237 27305 raft_consensus.cc:740] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.090265 27304 raft_consensus.cc:385] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.090740 27304 raft_consensus.cc:740] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.091081 27305 consensus_queue.cc:260] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.091646 27304 consensus_queue.cc:260] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.093849 27305 ts_tablet_manager.cc:1434] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.006s
I20260709 13:22:13.094269 27304 ts_tablet_manager.cc:1434] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:22:13.094970 27305 tablet_bootstrap.cc:492] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:13.095795 27304 tablet_bootstrap.cc:492] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:13.089066 27306 tablet_bootstrap.cc:492] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:13.103024 27304 tablet_bootstrap.cc:654] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.104012 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dacf9d04568491d9a4749a7b35558b1" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:13.091411 27325 raft_consensus.cc:2804] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:13.106566 27325 raft_consensus.cc:697] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:13.106837 27306 tablet_bootstrap.cc:654] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.107605 27325 consensus_queue.cc:237] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.111838 27293 leader_election.cc:290] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 election: Requested vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.113747 27305 tablet_bootstrap.cc:654] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.114842 27319 raft_consensus.cc:515] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.115598 27161 raft_consensus.cc:2468] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 1.
I20260709 13:22:13.116937 27052 leader_election.cc:304] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.117810 27322 raft_consensus.cc:2804] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:13.118325 27322 raft_consensus.cc:697] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:13.119166 27322 consensus_queue.cc:237] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
W20260709 13:22:13.119925 27053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.242.65:33085, user_credentials={real_user=slave}} blocked reactor thread for 107470us
I20260709 13:22:13.121582 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73cfe7c8c31b48e2aea8f527da7a0856" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:13.122164 27013 raft_consensus.cc:3060] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.122411 27011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dacf9d04568491d9a4749a7b35558b1" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:13.123453 27011 raft_consensus.cc:2393] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a40ce8ef1e646f7a376842a2287b6e6 in current term 1: Already voted for candidate 6fec71feeb50406b9395a638b88dc370 in this term.
I20260709 13:22:13.125427 27305 tablet_bootstrap.cc:492] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:13.125468 27085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dacf9d04568491d9a4749a7b35558b1" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:13.125829 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dacf9d04568491d9a4749a7b35558b1" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:13.126232 27305 ts_tablet_manager.cc:1403] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.002s
I20260709 13:22:13.129606 26977 leader_election.cc:304] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370; no voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71
I20260709 13:22:13.130359 27305 raft_consensus.cc:359] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.131465 27305 raft_consensus.cc:385] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.131841 27305 raft_consensus.cc:740] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.131999 27320 raft_consensus.cc:2749] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:13.135402 27306 tablet_bootstrap.cc:492] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:13.136184 27306 ts_tablet_manager.cc:1403] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.007s
I20260709 13:22:13.140394 27306 raft_consensus.cc:359] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.141165 27306 raft_consensus.cc:385] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.141471 27306 raft_consensus.cc:740] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.142217 27306 consensus_queue.cc:260] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.144454 27013 raft_consensus.cc:2468] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 1.
I20260709 13:22:13.133103 27305 consensus_queue.cc:260] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.147146 27305 ts_tablet_manager.cc:1434] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:22:13.148289 27305 tablet_bootstrap.cc:492] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:13.151872 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733a4719f64849ea9312c28c470fd396" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:13.152307 27304 tablet_bootstrap.cc:492] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:13.152650 27013 raft_consensus.cc:3060] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.153117 27304 ts_tablet_manager.cc:1403] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.058s	user 0.024s	sys 0.017s
I20260709 13:22:13.144549 27306 ts_tablet_manager.cc:1434] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:22:13.155212 27306 tablet_bootstrap.cc:492] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:13.159801 27013 raft_consensus.cc:2468] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 1.
I20260709 13:22:13.161224 27053 leader_election.cc:304] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:13.162359 27322 raft_consensus.cc:2804] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:13.162472 27305 tablet_bootstrap.cc:654] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.162950 27322 raft_consensus.cc:697] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:13.163808 27304 raft_consensus.cc:359] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.163928 27322 consensus_queue.cc:237] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.161509 27306 tablet_bootstrap.cc:654] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.167973 26908 catalog_manager.cc:5697] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:13.169059 27304 raft_consensus.cc:385] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.169546 27304 raft_consensus.cc:740] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.170428 27304 consensus_queue.cc:260] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.166934 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733a4719f64849ea9312c28c470fd396" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:13.170014 26908 catalog_manager.cc:5697] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:13.171792 27161 raft_consensus.cc:3060] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.172802 27305 tablet_bootstrap.cc:492] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:13.173341 27305 ts_tablet_manager.cc:1403] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.003s
I20260709 13:22:13.176229 27305 raft_consensus.cc:359] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.176879 27305 raft_consensus.cc:385] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.177146 27305 raft_consensus.cc:740] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.165722 27319 leader_election.cc:290] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.177819 27305 consensus_queue.cc:260] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.179744 27161 raft_consensus.cc:2468] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 1.
I20260709 13:22:13.181682 27306 tablet_bootstrap.cc:492] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:13.182111 27304 ts_tablet_manager.cc:1434] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:22:13.182279 27306 ts_tablet_manager.cc:1403] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.007s
I20260709 13:22:13.185058 27306 raft_consensus.cc:359] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.185839 27306 raft_consensus.cc:385] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.186177 27306 raft_consensus.cc:740] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.186512 27304 tablet_bootstrap.cc:492] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:13.187743 27292 raft_consensus.cc:493] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:13.188280 27292 raft_consensus.cc:515] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.190274 27305 ts_tablet_manager.cc:1434] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:22:13.190634 27292 leader_election.cc:290] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:13.191740 27305 tablet_bootstrap.cc:492] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6: Bootstrap starting.
I20260709 13:22:13.192646 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af67d5583c4a7b80c0982db79344fd" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:13.193553 27088 raft_consensus.cc:2468] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:13.194868 27126 leader_election.cc:304] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.196210 27292 raft_consensus.cc:2804] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:13.196751 27292 raft_consensus.cc:493] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:13.197101 27292 raft_consensus.cc:3060] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.198880 27304 tablet_bootstrap.cc:654] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.199231 27305 tablet_bootstrap.cc:654] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.192673 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af67d5583c4a7b80c0982db79344fd" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:13.201792 27306 consensus_queue.cc:260] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.202618 27013 raft_consensus.cc:2468] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:13.207149 27306 ts_tablet_manager.cc:1434] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:22:13.208662 27306 tablet_bootstrap.cc:492] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71: Bootstrap starting.
I20260709 13:22:13.208460 27292 raft_consensus.cc:515] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.215610 27293 raft_consensus.cc:493] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:13.216285 27293 raft_consensus.cc:515] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.216858 27306 tablet_bootstrap.cc:654] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.214501 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af67d5583c4a7b80c0982db79344fd" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:13.218562 27013 raft_consensus.cc:3060] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.226495 27013 raft_consensus.cc:2468] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:13.227574 27293 leader_election.cc:290] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.227487 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece4cd7e70e34b1b8160736a9054eb47" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:13.225288 27341 raft_consensus.cc:493] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:13.228415 27088 raft_consensus.cc:2468] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 0.
I20260709 13:22:13.228451 27341 raft_consensus.cc:515] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.230666 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece4cd7e70e34b1b8160736a9054eb47" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:13.231423 27341 leader_election.cc:290] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:13.231508 27162 raft_consensus.cc:2468] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 0.
I20260709 13:22:13.232810 26977 leader_election.cc:304] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.233047 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988b8755d9ea4becafa0b5941a73badc" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:13.232837 27127 leader_election.cc:304] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.233875 27088 raft_consensus.cc:2468] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:13.234385 27011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988b8755d9ea4becafa0b5941a73badc" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:13.228417 27304 tablet_bootstrap.cc:492] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:13.236194 27293 raft_consensus.cc:2804] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:13.236637 27293 raft_consensus.cc:493] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:13.235185 27126 leader_election.cc:304] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.237032 27293 raft_consensus.cc:3060] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.236724 27304 ts_tablet_manager.cc:1403] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.004s
I20260709 13:22:13.237344 27292 leader_election.cc:290] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
W20260709 13:22:13.237875 27127 leader_election.cc:343] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:13.234459 27341 raft_consensus.cc:2804] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:13.238632 27341 raft_consensus.cc:697] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Leader. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:13.239564 27341 consensus_queue.cc:237] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.235538 27305 tablet_bootstrap.cc:492] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6: No bootstrap required, opened a new log
I20260709 13:22:13.245048 27305 ts_tablet_manager.cc:1403] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.005s
I20260709 13:22:13.241914 27304 raft_consensus.cc:359] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.245885 27304 raft_consensus.cc:385] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.246452 27304 raft_consensus.cc:740] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.247606 27304 consensus_queue.cc:260] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.238102 27292 raft_consensus.cc:2804] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:13.250254 27292 raft_consensus.cc:493] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:13.250671 27292 raft_consensus.cc:3060] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.251415 27304 ts_tablet_manager.cc:1434] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.007s
I20260709 13:22:13.252719 27304 tablet_bootstrap.cc:492] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:13.247988 27305 raft_consensus.cc:359] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.254571 27305 raft_consensus.cc:385] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.254873 27305 raft_consensus.cc:740] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.260772 27305 consensus_queue.cc:260] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.261996 27088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af67d5583c4a7b80c0982db79344fd" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:13.262933 27088 raft_consensus.cc:3060] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.264796 27305 ts_tablet_manager.cc:1434] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:22:13.265156 27304 tablet_bootstrap.cc:654] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.265357 27292 raft_consensus.cc:515] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.273806 27293 raft_consensus.cc:515] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.274485 27306 tablet_bootstrap.cc:492] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71: No bootstrap required, opened a new log
I20260709 13:22:13.275050 27306 ts_tablet_manager.cc:1403] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.004s
I20260709 13:22:13.276639 27293 leader_election.cc:290] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 election: Requested vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.276984 27085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece4cd7e70e34b1b8160736a9054eb47" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:13.277670 27085 raft_consensus.cc:3060] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.278529 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988b8755d9ea4becafa0b5941a73badc" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:13.279453 27013 raft_consensus.cc:3060] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.285177 27088 raft_consensus.cc:2468] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:13.285255 27086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988b8755d9ea4becafa0b5941a73badc" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:13.286119 27086 raft_consensus.cc:3060] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.289659 27306 raft_consensus.cc:359] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.290699 27306 raft_consensus.cc:385] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.291061 27306 raft_consensus.cc:740] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.291990 27306 consensus_queue.cc:260] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.292615 27292 leader_election.cc:290] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:13.292447 27013 raft_consensus.cc:2468] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:13.294799 27127 leader_election.cc:304] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.295950 27292 raft_consensus.cc:2804] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:13.296752 27292 raft_consensus.cc:697] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Leader. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:13.297845 27085 raft_consensus.cc:2468] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 1.
I20260709 13:22:13.297881 27292 consensus_queue.cc:237] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.296406 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ece4cd7e70e34b1b8160736a9054eb47" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:13.299547 27162 raft_consensus.cc:3060] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.294991 27306 ts_tablet_manager.cc:1434] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:22:13.301265 26977 leader_election.cc:304] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:13.300882 26911 catalog_manager.cc:5697] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed01b2067d964cfda687492d191b6c71 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "ed01b2067d964cfda687492d191b6c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:13.302394 27293 raft_consensus.cc:2804] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:13.302434 27086 raft_consensus.cc:2468] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:13.303462 27293 raft_consensus.cc:697] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 1 LEADER]: Becoming Leader. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:13.305989 27293 consensus_queue.cc:237] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.310422 27304 tablet_bootstrap.cc:492] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:13.311156 27304 ts_tablet_manager.cc:1403] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.014s
I20260709 13:22:13.315889 27304 raft_consensus.cc:359] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.316773 27304 raft_consensus.cc:385] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.317049 27162 raft_consensus.cc:2468] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 1.
I20260709 13:22:13.317134 27304 raft_consensus.cc:740] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.320662 27304 consensus_queue.cc:260] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.323401 27304 ts_tablet_manager.cc:1434] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:22:13.324249 27304 tablet_bootstrap.cc:492] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370: Bootstrap starting.
I20260709 13:22:13.329560 27304 tablet_bootstrap.cc:654] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:13.335002 27304 tablet_bootstrap.cc:492] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370: No bootstrap required, opened a new log
I20260709 13:22:13.335541 27304 ts_tablet_manager.cc:1403] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:22:13.334741 26909 catalog_manager.cc:5697] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed01b2067d964cfda687492d191b6c71 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "ed01b2067d964cfda687492d191b6c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:13.339305 27304 raft_consensus.cc:359] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.340044 27304 raft_consensus.cc:385] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:13.340325 27304 raft_consensus.cc:740] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Initialized, Role: FOLLOWER
I20260709 13:22:13.340969 27304 consensus_queue.cc:260] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.342865 27304 ts_tablet_manager.cc:1434] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:13.346735 26911 catalog_manager.cc:5697] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fec71feeb50406b9395a638b88dc370 (127.15.242.65). New cstate: current_term: 1 leader_uuid: "6fec71feeb50406b9395a638b88dc370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:13.357424 26908 catalog_manager.cc:5697] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:13.378629 27292 raft_consensus.cc:493] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:13.379244 27292 raft_consensus.cc:515] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.381101 27292 leader_election.cc:290] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:13.382014 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3396d3e3977c4cee8ff5acdc7a873501" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:13.382695 27086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3396d3e3977c4cee8ff5acdc7a873501" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:13.382730 27013 raft_consensus.cc:2468] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:13.383625 27086 raft_consensus.cc:2468] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:13.384174 27127 leader_election.cc:304] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.385005 27292 raft_consensus.cc:2804] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:13.385408 27292 raft_consensus.cc:493] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:13.385708 27292 raft_consensus.cc:3060] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.391533 27292 raft_consensus.cc:515] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.393615 27292 leader_election.cc:290] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:13.394434 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3396d3e3977c4cee8ff5acdc7a873501" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:13.394737 27086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3396d3e3977c4cee8ff5acdc7a873501" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:13.395105 27013 raft_consensus.cc:3060] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.395531 27086 raft_consensus.cc:3060] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.401206 27013 raft_consensus.cc:2468] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:13.401404 27086 raft_consensus.cc:2468] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:13.402962 27126 leader_election.cc:304] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.404078 27292 raft_consensus.cc:2804] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:13.404636 27292 raft_consensus.cc:697] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Leader. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:13.405501 27292 consensus_queue.cc:237] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.413968 26911 catalog_manager.cc:5697] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed01b2067d964cfda687492d191b6c71 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "ed01b2067d964cfda687492d191b6c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:13.428447 27322 raft_consensus.cc:493] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:13.429081 27322 raft_consensus.cc:515] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.430936 27322 leader_election.cc:290] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.431700 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7474efa812d493f99e0d67edea2a7e5" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:13.432013 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7474efa812d493f99e0d67edea2a7e5" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71" is_pre_election: true
I20260709 13:22:13.432405 27013 raft_consensus.cc:2468] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 0.
I20260709 13:22:13.432582 27162 raft_consensus.cc:2468] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 0.
I20260709 13:22:13.433691 27052 leader_election.cc:304] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.434504 27322 raft_consensus.cc:2804] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:13.434918 27322 raft_consensus.cc:493] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:13.435281 27322 raft_consensus.cc:3060] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.440948 27322 raft_consensus.cc:515] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.442929 27322 leader_election.cc:290] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.443722 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7474efa812d493f99e0d67edea2a7e5" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:13.444041 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7474efa812d493f99e0d67edea2a7e5" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:13.444412 27013 raft_consensus.cc:3060] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.444558 27162 raft_consensus.cc:3060] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.450836 27162 raft_consensus.cc:2468] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 1.
I20260709 13:22:13.450836 27013 raft_consensus.cc:2468] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 1.
I20260709 13:22:13.452214 27052 leader_election.cc:304] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.452997 27322 raft_consensus.cc:2804] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:13.453480 27322 raft_consensus.cc:697] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:13.454344 27322 consensus_queue.cc:237] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.462797 26911 catalog_manager.cc:5697] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66). New cstate: current_term: 1 leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:13.502704 27292 raft_consensus.cc:493] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:13.503489 27292 raft_consensus.cc:515] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.505517 27292 leader_election.cc:290] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:13.506660 27086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed0de837d4fb416b8612d7bfee17fc2e" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" is_pre_election: true
I20260709 13:22:13.506548 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed0de837d4fb416b8612d7bfee17fc2e" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370" is_pre_election: true
I20260709 13:22:13.507539 27086 raft_consensus.cc:2468] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:13.507535 27013 raft_consensus.cc:2468] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 0.
I20260709 13:22:13.508955 27126 leader_election.cc:304] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.510370 27292 raft_consensus.cc:2804] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:13.510711 27292 raft_consensus.cc:493] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:13.511009 27292 raft_consensus.cc:3060] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.516155 27292 raft_consensus.cc:515] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.517802 27292 leader_election.cc:290] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:13.518824 27013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed0de837d4fb416b8612d7bfee17fc2e" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:13.519441 27086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed0de837d4fb416b8612d7bfee17fc2e" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:13.519559 27013 raft_consensus.cc:3060] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.520087 27086 raft_consensus.cc:3060] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:13.521962 27322 consensus_queue.cc:1048] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:13.528137 27013 raft_consensus.cc:2468] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:13.529528 27127 leader_election.cc:304] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.530387 27086 raft_consensus.cc:2468] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 1.
I20260709 13:22:13.530588 27292 raft_consensus.cc:2804] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:13.531260 27292 raft_consensus.cc:697] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Leader. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:13.532238 27292 consensus_queue.cc:237] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.539505 27322 consensus_queue.cc:1048] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:13.545249 26911 catalog_manager.cc:5697] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed01b2067d964cfda687492d191b6c71 (127.15.242.67). New cstate: current_term: 1 leader_uuid: "ed01b2067d964cfda687492d191b6c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:13.555262 27322 consensus_queue.cc:1048] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:13.567641 27319 consensus_queue.cc:1048] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:13.580789 27086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dacf9d04568491d9a4749a7b35558b1"
dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
mode: GRACEFUL
new_leader_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:45744
I20260709 13:22:13.581437 27086 raft_consensus.cc:606] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Received request to transfer leadership to TS 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:13.589582 27086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73cfe7c8c31b48e2aea8f527da7a0856"
dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
mode: GRACEFUL
new_leader_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:45744
I20260709 13:22:13.590318 27086 raft_consensus.cc:606] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Received request to transfer leadership to TS 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:13.596532 27086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "733a4719f64849ea9312c28c470fd396"
dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
mode: GRACEFUL
new_leader_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:45744
I20260709 13:22:13.597034 27086 raft_consensus.cc:606] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Received request to transfer leadership to TS 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:13.608458 27162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66af67d5583c4a7b80c0982db79344fd"
dest_uuid: "ed01b2067d964cfda687492d191b6c71"
mode: GRACEFUL
new_leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
 from {username='slave'} at 127.0.0.1:34498
I20260709 13:22:13.608981 27162 raft_consensus.cc:606] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Received request to transfer leadership to TS 4a40ce8ef1e646f7a376842a2287b6e6
I20260709 13:22:13.614261 27162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "988b8755d9ea4becafa0b5941a73badc"
dest_uuid: "ed01b2067d964cfda687492d191b6c71"
mode: GRACEFUL
new_leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
 from {username='slave'} at 127.0.0.1:34498
I20260709 13:22:13.614746 27162 raft_consensus.cc:606] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Received request to transfer leadership to TS 4a40ce8ef1e646f7a376842a2287b6e6
I20260709 13:22:13.620095 27162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3396d3e3977c4cee8ff5acdc7a873501"
dest_uuid: "ed01b2067d964cfda687492d191b6c71"
mode: GRACEFUL
new_leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
 from {username='slave'} at 127.0.0.1:34498
I20260709 13:22:13.620569 27162 raft_consensus.cc:606] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Received request to transfer leadership to TS 4a40ce8ef1e646f7a376842a2287b6e6
I20260709 13:22:13.725452 27292 consensus_queue.cc:1048] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:13.730587 27319 consensus_queue.cc:1048] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:13.733144 27341 raft_consensus.cc:993] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71: : Instructing follower 4a40ce8ef1e646f7a376842a2287b6e6 to start an election
I20260709 13:22:13.733587 27341 raft_consensus.cc:1081] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Signalling peer 4a40ce8ef1e646f7a376842a2287b6e6 to start an election
I20260709 13:22:13.738365 27085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "988b8755d9ea4becafa0b5941a73badc"
dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
 from {username='slave'} at 127.0.0.1:45724
I20260709 13:22:13.739738 27292 consensus_queue.cc:1048] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:13.740399 27085 raft_consensus.cc:493] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:13.740962 27085 raft_consensus.cc:3060] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:13.747802 27319 raft_consensus.cc:993] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6: : Instructing follower 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:13.748343 27319 raft_consensus.cc:1081] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Signalling peer 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:13.752728 27326 consensus_queue.cc:1048] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:13.756620 27011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "733a4719f64849ea9312c28c470fd396"
dest_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:36412
I20260709 13:22:13.757162 27011 raft_consensus.cc:493] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:13.757522 27011 raft_consensus.cc:3060] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:13.758395 27085 raft_consensus.cc:515] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.771498 27085 leader_election.cc:290] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 2 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.772528 27012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988b8755d9ea4becafa0b5941a73badc" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:13.774978 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988b8755d9ea4becafa0b5941a73badc" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:13.775892 27161 raft_consensus.cc:3055] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:13.776276 27161 raft_consensus.cc:740] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:13.777293 27161 consensus_queue.cc:260] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.778458 27161 raft_consensus.cc:3060] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:13.782163 27011 raft_consensus.cc:515] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.786316 27161 raft_consensus.cc:2468] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 2.
I20260709 13:22:13.786136 27292 consensus_queue.cc:1048] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:13.787760 27052 leader_election.cc:304] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 6fec71feeb50406b9395a638b88dc370
I20260709 13:22:13.789137 27326 raft_consensus.cc:2804] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:13.789723 27326 raft_consensus.cc:697] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:13.790307 27011 leader_election.cc:290] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Requested vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.791138 27326 consensus_queue.cc:237] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.791616 27086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733a4719f64849ea9312c28c470fd396" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:13.792299 27086 raft_consensus.cc:3055] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:13.792713 27086 raft_consensus.cc:740] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:13.793661 27086 consensus_queue.cc:260] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.795102 27086 raft_consensus.cc:3060] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:13.797832 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733a4719f64849ea9312c28c470fd396" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:13.799603 27161 raft_consensus.cc:3060] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:13.803589 26911 catalog_manager.cc:5697] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 reported cstate change: term changed from 1 to 2, leader changed from ed01b2067d964cfda687492d191b6c71 (127.15.242.67) to 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:13.809513 27161 raft_consensus.cc:2468] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:13.810914 27086 raft_consensus.cc:2468] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:13.811954 27343 raft_consensus.cc:993] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71: : Instructing follower 4a40ce8ef1e646f7a376842a2287b6e6 to start an election
I20260709 13:22:13.812420 27343 raft_consensus.cc:1081] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Signalling peer 4a40ce8ef1e646f7a376842a2287b6e6 to start an election
I20260709 13:22:13.813545 26977 leader_election.cc:304] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:13.814922 27293 raft_consensus.cc:2804] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:13.815421 27293 raft_consensus.cc:697] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Becoming Leader. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:13.816272 27293 consensus_queue.cc:237] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.821656 27088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66af67d5583c4a7b80c0982db79344fd"
dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
 from {username='slave'} at 127.0.0.1:45724
I20260709 13:22:13.822350 27088 raft_consensus.cc:493] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:13.822732 27088 raft_consensus.cc:3060] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:13.829380 27343 consensus_queue.cc:1048] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:13.830603 27088 raft_consensus.cc:515] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.834663 27011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af67d5583c4a7b80c0982db79344fd" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:13.835250 27011 raft_consensus.cc:3060] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:13.846645 27088 leader_election.cc:290] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 2 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.847465 27326 consensus_queue.cc:1048] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:13.847608 26910 catalog_manager.cc:5697] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 reported cstate change: term changed from 1 to 2, leader changed from 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66) to 6fec71feeb50406b9395a638b88dc370 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "6fec71feeb50406b9395a638b88dc370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:13.850445 27011 raft_consensus.cc:2468] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 2.
I20260709 13:22:13.851998 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af67d5583c4a7b80c0982db79344fd" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:13.852313 27053 leader_election.cc:304] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:13.852804 27161 raft_consensus.cc:3055] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:13.853240 27161 raft_consensus.cc:740] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:13.854234 27326 raft_consensus.cc:2804] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:13.854952 27326 raft_consensus.cc:697] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:13.856564 27011 raft_consensus.cc:1240] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Rejecting Update request from peer ed01b2067d964cfda687492d191b6c71 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:22:13.857436 27161 consensus_queue.cc:260] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.860795 27161 raft_consensus.cc:3060] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:13.856144 27326 consensus_queue.cc:237] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.870961 26911 catalog_manager.cc:5697] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 reported cstate change: term changed from 1 to 2, leader changed from ed01b2067d964cfda687492d191b6c71 (127.15.242.67) to 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:13.877007 27161 raft_consensus.cc:2468] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 2.
I20260709 13:22:13.878129 27343 consensus_queue.cc:1048] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:13.898149 27325 consensus_queue.cc:1048] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:13.907421 27343 consensus_queue.cc:1048] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:13.914430 27293 consensus_queue.cc:1048] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:13.924680 27343 consensus_queue.cc:1048] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:13.933014 27368 raft_consensus.cc:993] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71: : Instructing follower 4a40ce8ef1e646f7a376842a2287b6e6 to start an election
I20260709 13:22:13.933560 27368 raft_consensus.cc:1081] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Signalling peer 4a40ce8ef1e646f7a376842a2287b6e6 to start an election
I20260709 13:22:13.940623 27293 consensus_queue.cc:1048] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:13.945865 27086 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3396d3e3977c4cee8ff5acdc7a873501"
dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
 from {username='slave'} at 127.0.0.1:45724
I20260709 13:22:13.947063 27086 raft_consensus.cc:493] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:13.947610 27086 raft_consensus.cc:3060] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:13.957147 27368 consensus_queue.cc:1048] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:13.962585 27086 raft_consensus.cc:515] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.965184 27086 leader_election.cc:290] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 2 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:13.967026 27011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3396d3e3977c4cee8ff5acdc7a873501" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:13.967746 27011 raft_consensus.cc:3060] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:13.976640 27011 raft_consensus.cc:2468] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 2.
I20260709 13:22:13.977216 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3396d3e3977c4cee8ff5acdc7a873501" candidate_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:13.977989 27053 leader_election.cc:304] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:13.979300 27325 raft_consensus.cc:2804] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:13.980055 27325 raft_consensus.cc:697] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:13.977927 27162 raft_consensus.cc:3055] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:13.981704 27162 raft_consensus.cc:740] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:13.981261 27325 consensus_queue.cc:237] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.985563 27162 consensus_queue.cc:260] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:13.987198 27162 raft_consensus.cc:3060] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:13.996919 26911 catalog_manager.cc:5697] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 reported cstate change: term changed from 1 to 2, leader changed from ed01b2067d964cfda687492d191b6c71 (127.15.242.67) to 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66). New cstate: current_term: 2 leader_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:14.006098 27162 raft_consensus.cc:2468] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a40ce8ef1e646f7a376842a2287b6e6 in term 2.
I20260709 13:22:14.047070 27326 raft_consensus.cc:993] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6: : Instructing follower 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:14.047622 27325 raft_consensus.cc:1081] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Signalling peer 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:14.049238 27013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dacf9d04568491d9a4749a7b35558b1"
dest_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:36412
I20260709 13:22:14.049710 27013 raft_consensus.cc:493] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:14.050168 27013 raft_consensus.cc:3060] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:14.055154 27013 raft_consensus.cc:515] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:14.056941 27013 leader_election.cc:290] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Requested vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:14.057905 27086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dacf9d04568491d9a4749a7b35558b1" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:14.058194 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dacf9d04568491d9a4749a7b35558b1" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:14.059041 27086 raft_consensus.cc:3055] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:14.059731 27086 raft_consensus.cc:740] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:14.060657 27086 consensus_queue.cc:260] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:14.061833 27086 raft_consensus.cc:3060] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:14.059041 27162 raft_consensus.cc:3060] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:14.068251 27319 raft_consensus.cc:993] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6: : Instructing follower 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:14.068872 27325 raft_consensus.cc:1081] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Signalling peer 6fec71feeb50406b9395a638b88dc370 to start an election
I20260709 13:22:14.070099 27086 raft_consensus.cc:2468] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:14.071134 27162 raft_consensus.cc:2468] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:14.071251 27013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73cfe7c8c31b48e2aea8f527da7a0856"
dest_uuid: "6fec71feeb50406b9395a638b88dc370"
 from {username='slave'} at 127.0.0.1:36412
I20260709 13:22:14.071843 27013 raft_consensus.cc:493] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:14.071743 26977 leader_election.cc:304] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, 6fec71feeb50406b9395a638b88dc370; no voters: 
I20260709 13:22:14.072361 27013 raft_consensus.cc:3060] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:14.072763 27377 raft_consensus.cc:2804] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:14.073293 27377 raft_consensus.cc:697] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Becoming Leader. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:14.074209 27377 consensus_queue.cc:237] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:14.079422 27013 raft_consensus.cc:515] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:14.081650 27013 leader_election.cc:290] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Requested vote from peers 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241), ed01b2067d964cfda687492d191b6c71 (127.15.242.67:38045)
I20260709 13:22:14.082355 27086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73cfe7c8c31b48e2aea8f527da7a0856" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:14.082607 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73cfe7c8c31b48e2aea8f527da7a0856" candidate_uuid: "6fec71feeb50406b9395a638b88dc370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed01b2067d964cfda687492d191b6c71"
I20260709 13:22:14.083551 27086 raft_consensus.cc:3055] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:14.083634 27159 raft_consensus.cc:3060] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:14.082707 26909 catalog_manager.cc:5697] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 reported cstate change: term changed from 1 to 2, leader changed from 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66) to 6fec71feeb50406b9395a638b88dc370 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "6fec71feeb50406b9395a638b88dc370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:14.083983 27086 raft_consensus.cc:740] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:14.084908 27086 consensus_queue.cc:260] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:14.086220 27086 raft_consensus.cc:3060] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:14.093561 27159 raft_consensus.cc:2468] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:14.094907 26977 leader_election.cc:304] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:14.096378 27377 raft_consensus.cc:2804] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:14.096961 27377 raft_consensus.cc:697] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Becoming Leader. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:14.097887 27377 consensus_queue.cc:237] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:14.100013 27086 raft_consensus.cc:2468] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fec71feeb50406b9395a638b88dc370 in term 2.
I20260709 13:22:14.105715 26909 catalog_manager.cc:5697] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 reported cstate change: term changed from 1 to 2, leader changed from 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66) to 6fec71feeb50406b9395a638b88dc370 (127.15.242.65). New cstate: current_term: 2 leader_uuid: "6fec71feeb50406b9395a638b88dc370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:14.295787 27162 raft_consensus.cc:1275] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 4a40ce8ef1e646f7a376842a2287b6e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:14.297190 27325 consensus_queue.cc:1048] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:14.311123 27013 raft_consensus.cc:1275] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Refusing update from remote peer 4a40ce8ef1e646f7a376842a2287b6e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:14.312794 27013 raft_consensus.cc:3060] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:14.314102 27319 consensus_queue.cc:1048] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:14.319056 27013 raft_consensus.cc:1275] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Refusing update from remote peer 4a40ce8ef1e646f7a376842a2287b6e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:14.325496 27319 consensus_queue.cc:1048] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:14.334442 27162 raft_consensus.cc:1275] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 4a40ce8ef1e646f7a376842a2287b6e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:14.336055 27326 consensus_queue.cc:1048] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:14.357281 27086 raft_consensus.cc:1275] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:14.360064 27377 consensus_queue.cc:1048] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:14.424888 27162 raft_consensus.cc:1275] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:14.431317 27377 consensus_queue.cc:1048] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:14.484839 27159 raft_consensus.cc:1275] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:14.486413 27377 consensus_queue.cc:1048] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:14.493736 27162 raft_consensus.cc:1275] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 4a40ce8ef1e646f7a376842a2287b6e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:14.510999 27086 raft_consensus.cc:1275] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:14.511590 27379 consensus_queue.cc:1048] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:14.516145 27011 raft_consensus.cc:1275] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Refusing update from remote peer 4a40ce8ef1e646f7a376842a2287b6e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:14.518170 27379 consensus_queue.cc:1048] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:14.518807 27378 consensus_queue.cc:1048] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:14.606524 27086 raft_consensus.cc:1275] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:14.608243 27378 consensus_queue.cc:1048] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:14.624960 27162 raft_consensus.cc:1275] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Refusing update from remote peer 6fec71feeb50406b9395a638b88dc370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:14.627203 27378 consensus_queue.cc:1048] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:16.627722 26911 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35486:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:16.653209 26911 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35486:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:16.740574 16329 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:16.843766 27424 tablet.cc:1724] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:16.979887 27423 log.cc:927] Time spent T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370: Append to log took a long time: real 0.089s	user 0.003s	sys 0.001s
I20260709 13:22:17.071123 27451 tablet.cc:1724] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.070668 27446 tablet.cc:1724] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:17.074749 27445 log.cc:927] Time spent T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:22:17.079056 27431 log.cc:927] Time spent T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71: Append to log took a long time: real 0.123s	user 0.000s	sys 0.002s
I20260709 13:22:17.103247 27424 tablet.cc:1724] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:17.125197 27447 log.cc:927] Time spent T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:22:17.165784 27448 log.cc:927] Time spent T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71: Append to log took a long time: real 0.106s	user 0.003s	sys 0.000s
W20260709 13:22:17.170871 26977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.242.66:44241, user_credentials={real_user=slave}} blocked reactor thread for 51201.8us
I20260709 13:22:17.171061 27453 tablet.cc:1724] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.189692 27461 tablet.cc:1724] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:17.192791 27450 log.cc:927] Time spent T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:22:17.211088 27461 tablet.cc:1724] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.256836 27463 tablet.cc:1724] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.260834 27453 tablet.cc:1724] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.294575 27459 tablet.cc:1724] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.311296 27451 tablet.cc:1724] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.314839 27464 tablet.cc:1724] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.324689 27465 tablet.cc:1724] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.326872 27424 tablet.cc:1724] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.333158 27463 tablet.cc:1724] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.333712 27462 tablet.cc:1724] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.340162 27012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43ad9535642349629902c3ff840fedbd"
dest_uuid: "6fec71feeb50406b9395a638b88dc370"
mode: GRACEFUL
new_leader_uuid: "ed01b2067d964cfda687492d191b6c71"
 from {username='slave'} at 127.0.0.1:58474
I20260709 13:22:17.341146 27012 raft_consensus.cc:606] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Received request to transfer leadership to TS ed01b2067d964cfda687492d191b6c71
I20260709 13:22:17.285507 27446 tablet.cc:1724] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.354872 27424 tablet.cc:1724] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.358184 27466 tablet.cc:1724] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.375450 27468 tablet.cc:1724] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.389473 27465 tablet.cc:1724] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.410290 27466 tablet.cc:1724] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.399195 27461 tablet.cc:1724] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.402007 27468 tablet.cc:1724] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.402420 27459 tablet.cc:1724] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.406272 27454 raft_consensus.cc:993] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370: : Instructing follower ed01b2067d964cfda687492d191b6c71 to start an election
I20260709 13:22:17.414650 27454 raft_consensus.cc:1081] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Signalling peer ed01b2067d964cfda687492d191b6c71 to start an election
I20260709 13:22:17.388916 27453 tablet.cc:1724] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.417263 27085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff26d53286646eb9892a573cdb2ecfe"
dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
mode: GRACEFUL
new_leader_uuid: "ed01b2067d964cfda687492d191b6c71"
 from {username='slave'} at 127.0.0.1:43124
I20260709 13:22:17.418001 27085 raft_consensus.cc:606] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Received request to transfer leadership to TS ed01b2067d964cfda687492d191b6c71
I20260709 13:22:17.419164 27155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43ad9535642349629902c3ff840fedbd"
dest_uuid: "ed01b2067d964cfda687492d191b6c71"
 from {username='slave'} at 127.0.0.1:34490
I20260709 13:22:17.423897 27155 raft_consensus.cc:493] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.422712 16329 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:17.424767 16329 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:17.425071 27155 raft_consensus.cc:3060] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:17.428342 27468 tablet.cc:1724] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:17.434120 27155 raft_consensus.cc:515] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:17.437820 27155 leader_election.cc:290] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 3 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:17.439340 27012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ad9535642349629902c3ff840fedbd" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:17.440165 27012 raft_consensus.cc:3055] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:17.440539 27012 raft_consensus.cc:740] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fec71feeb50406b9395a638b88dc370, State: Running, Role: LEADER
I20260709 13:22:17.441565 27012 consensus_queue.cc:260] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:17.442939 27012 raft_consensus.cc:3060] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:17.445755 27085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ad9535642349629902c3ff840fedbd" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:17.446501 27085 raft_consensus.cc:3060] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:17.455336 27085 raft_consensus.cc:2468] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 3.
I20260709 13:22:17.463737 27126 leader_election.cc:304] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a40ce8ef1e646f7a376842a2287b6e6, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:17.463729 27012 raft_consensus.cc:2468] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 3.
I20260709 13:22:17.464956 27442 raft_consensus.cc:2804] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:17.465459 27442 raft_consensus.cc:697] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 3 LEADER]: Becoming Leader. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:17.466379 27442 consensus_queue.cc:237] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } }
I20260709 13:22:17.475867 26909 catalog_manager.cc:6242] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c: soft_deleted_table [id=915229e6a26a49c5b89b07f8a6b23f37] alter complete (version 1)
I20260709 13:22:17.487040 26908 catalog_manager.cc:5697] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 reported cstate change: term changed from 2 to 3, leader changed from 6fec71feeb50406b9395a638b88dc370 (127.15.242.65) to ed01b2067d964cfda687492d191b6c71 (127.15.242.67). New cstate: current_term: 3 leader_uuid: "ed01b2067d964cfda687492d191b6c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.700031 27413 raft_consensus.cc:993] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6: : Instructing follower ed01b2067d964cfda687492d191b6c71 to start an election
I20260709 13:22:17.700752 27416 raft_consensus.cc:1081] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Signalling peer ed01b2067d964cfda687492d191b6c71 to start an election
I20260709 13:22:17.702479 27155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ff26d53286646eb9892a573cdb2ecfe"
dest_uuid: "ed01b2067d964cfda687492d191b6c71"
 from {username='slave'} at 127.0.0.1:34474
I20260709 13:22:17.703004 27155 raft_consensus.cc:493] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.703316 27155 raft_consensus.cc:3060] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:17.708673 27155 raft_consensus.cc:515] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:17.710963 27155 leader_election.cc:290] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 3 election: Requested vote from peers 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085), 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241)
I20260709 13:22:17.711572 27012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff26d53286646eb9892a573cdb2ecfe" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6fec71feeb50406b9395a638b88dc370"
I20260709 13:22:17.712280 27012 raft_consensus.cc:3060] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:17.712601 27085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff26d53286646eb9892a573cdb2ecfe" candidate_uuid: "ed01b2067d964cfda687492d191b6c71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a40ce8ef1e646f7a376842a2287b6e6"
I20260709 13:22:17.713143 27085 raft_consensus.cc:3055] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:17.713366 27085 raft_consensus.cc:740] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a40ce8ef1e646f7a376842a2287b6e6, State: Running, Role: LEADER
I20260709 13:22:17.714150 27085 consensus_queue.cc:260] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:17.715476 27085 raft_consensus.cc:3060] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:17.719419 27012 raft_consensus.cc:2468] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 3.
I20260709 13:22:17.720862 27127 leader_election.cc:304] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fec71feeb50406b9395a638b88dc370, ed01b2067d964cfda687492d191b6c71; no voters: 
I20260709 13:22:17.721599 27442 raft_consensus.cc:2804] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:17.722416 27442 raft_consensus.cc:697] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 3 LEADER]: Becoming Leader. State: Replica: ed01b2067d964cfda687492d191b6c71, State: Running, Role: LEADER
I20260709 13:22:17.722957 27085 raft_consensus.cc:2468] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed01b2067d964cfda687492d191b6c71 in term 3.
I20260709 13:22:17.723404 27442 consensus_queue.cc:237] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } }
I20260709 13:22:17.734871 26908 catalog_manager.cc:5697] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 reported cstate change: term changed from 2 to 3, leader changed from 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66) to ed01b2067d964cfda687492d191b6c71 (127.15.242.67). New cstate: current_term: 3 leader_uuid: "ed01b2067d964cfda687492d191b6c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed01b2067d964cfda687492d191b6c71" member_type: VOTER last_known_addr { host: "127.15.242.67" port: 38045 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:17.861719 27012 raft_consensus.cc:1275] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 3 FOLLOWER]: Refusing update from remote peer ed01b2067d964cfda687492d191b6c71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:17.863582 27442 consensus_queue.cc:1048] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:17.875303 27085 raft_consensus.cc:1275] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 3 FOLLOWER]: Refusing update from remote peer ed01b2067d964cfda687492d191b6c71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:17.876868 27442 consensus_queue.cc:1048] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:18.226531 27012 raft_consensus.cc:1275] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 3 FOLLOWER]: Refusing update from remote peer ed01b2067d964cfda687492d191b6c71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:18.228143 27442 consensus_queue.cc:1048] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fec71feeb50406b9395a638b88dc370" member_type: VOTER last_known_addr { host: "127.15.242.65" port: 33085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:18.239935 27085 raft_consensus.cc:1275] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 3 FOLLOWER]: Refusing update from remote peer ed01b2067d964cfda687492d191b6c71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:18.241549 27481 consensus_queue.cc:1048] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a40ce8ef1e646f7a376842a2287b6e6" member_type: VOTER last_known_addr { host: "127.15.242.66" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:18.489826 16329 tablet_server.cc:179] TabletServer@127.15.242.65:0 shutting down...
I20260709 13:22:18.518915 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:18.519629 16329 tablet_replica.cc:333] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.520506 16329 raft_consensus.cc:2243] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.521107 16329 raft_consensus.cc:2272] T f7474efa812d493f99e0d67edea2a7e5 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.524904 16329 tablet_replica.cc:333] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.525671 16329 raft_consensus.cc:2243] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.526530 16329 raft_consensus.cc:2272] T 733a4719f64849ea9312c28c470fd396 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.528774 16329 tablet_replica.cc:333] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.529558 16329 raft_consensus.cc:2243] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.530457 16329 raft_consensus.cc:2272] T 73cfe7c8c31b48e2aea8f527da7a0856 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.533269 16329 tablet_replica.cc:333] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.534523 16329 raft_consensus.cc:2243] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.535128 16329 raft_consensus.cc:2272] T 400ac67bcf014728bfa8c133e03bc6f9 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.537878 16329 tablet_replica.cc:333] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.539002 16329 raft_consensus.cc:2243] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.539796 16329 raft_consensus.cc:2272] T 3396d3e3977c4cee8ff5acdc7a873501 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.541903 16329 tablet_replica.cc:333] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.542536 16329 raft_consensus.cc:2243] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.542990 16329 raft_consensus.cc:2272] T 988b8755d9ea4becafa0b5941a73badc P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.545239 16329 tablet_replica.cc:333] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.545889 16329 raft_consensus.cc:2243] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.546761 16329 raft_consensus.cc:2272] T ece4cd7e70e34b1b8160736a9054eb47 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.548840 16329 tablet_replica.cc:333] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.549531 16329 raft_consensus.cc:2243] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.549990 16329 raft_consensus.cc:2272] T 66af67d5583c4a7b80c0982db79344fd P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.552040 16329 tablet_replica.cc:333] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.552680 16329 raft_consensus.cc:2243] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.553861 16329 raft_consensus.cc:2272] T 8dacf9d04568491d9a4749a7b35558b1 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:18.554039 27053 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:22:18.556267 16329 tablet_replica.cc:333] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.557163 16329 raft_consensus.cc:2243] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:18.557650 27053 consensus_peers.cc:597] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 -> Peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Couldn't send request to peer 6fec71feeb50406b9395a638b88dc370. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:18.557674 16329 raft_consensus.cc:2272] T 43ad9535642349629902c3ff840fedbd P 6fec71feeb50406b9395a638b88dc370 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.561378 16329 tablet_replica.cc:333] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.562199 16329 raft_consensus.cc:2243] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.562996 16329 raft_consensus.cc:2272] T 9ff26d53286646eb9892a573cdb2ecfe P 6fec71feeb50406b9395a638b88dc370 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:18.565514 27127 consensus_peers.cc:597] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 -> Peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Couldn't send request to peer 6fec71feeb50406b9395a638b88dc370. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:18.566430 16329 tablet_replica.cc:333] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.567055 16329 raft_consensus.cc:2243] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.567525 16329 raft_consensus.cc:2272] T f562c6f04c364ca286276a291410d192 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.569622 16329 tablet_replica.cc:333] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.570233 16329 raft_consensus.cc:2243] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.570749 16329 raft_consensus.cc:2272] T 49637e146f304243aeffc8c6e25e4c85 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.572935 16329 tablet_replica.cc:333] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.573545 16329 raft_consensus.cc:2243] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.573990 16329 raft_consensus.cc:2272] T ed0de837d4fb416b8612d7bfee17fc2e P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.576570 16329 tablet_replica.cc:333] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.577108 16329 raft_consensus.cc:2243] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.577937 16329 raft_consensus.cc:2272] T 47485825deb14081a6adcfb26a03c1f5 P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.581388 16329 tablet_replica.cc:333] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.582160 16329 raft_consensus.cc:2243] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:18.582866 27053 consensus_peers.cc:597] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 -> Peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Couldn't send request to peer 6fec71feeb50406b9395a638b88dc370. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:18.583077 16329 raft_consensus.cc:2272] T 0d721351ee0e4501836ff08539f40750 P 6fec71feeb50406b9395a638b88dc370 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.585723 16329 tablet_replica.cc:333] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.586426 16329 raft_consensus.cc:2243] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.587322 16329 raft_consensus.cc:2272] T 7cefede0f65c4903a92f1d6e143c4cfb P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.589699 16329 tablet_replica.cc:333] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370: stopping tablet replica
I20260709 13:22:18.590320 16329 raft_consensus.cc:2243] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.591245 16329 raft_consensus.cc:2272] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 6fec71feeb50406b9395a638b88dc370 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:18.618216 27053 consensus_peers.cc:597] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 -> Peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Couldn't send request to peer 6fec71feeb50406b9395a638b88dc370. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:18.621349 27053 consensus_peers.cc:597] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 -> Peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Couldn't send request to peer 6fec71feeb50406b9395a638b88dc370. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:18.643265 16329 tablet_server.cc:196] TabletServer@127.15.242.65:0 shutdown complete.
W20260709 13:22:18.646854 27127 consensus_peers.cc:597] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 -> Peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Couldn't send request to peer 6fec71feeb50406b9395a638b88dc370. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:33085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:18.664458 27053 consensus_peers.cc:597] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 -> Peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Couldn't send request to peer 6fec71feeb50406b9395a638b88dc370. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:33085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:18.685247 16329 tablet_server.cc:179] TabletServer@127.15.242.66:0 shutting down...
I20260709 13:22:18.718183 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:18.718940 16329 tablet_replica.cc:333] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.719753 16329 raft_consensus.cc:2243] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.720693 16329 raft_consensus.cc:2272] T f7474efa812d493f99e0d67edea2a7e5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.723150 16329 tablet_replica.cc:333] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.723862 16329 raft_consensus.cc:2243] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.724393 16329 raft_consensus.cc:2272] T 733a4719f64849ea9312c28c470fd396 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.726641 16329 tablet_replica.cc:333] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.727267 16329 raft_consensus.cc:2243] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.728132 16329 raft_consensus.cc:2272] T 3396d3e3977c4cee8ff5acdc7a873501 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.730734 16329 tablet_replica.cc:333] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.731444 16329 raft_consensus.cc:2243] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.732259 16329 raft_consensus.cc:2272] T 988b8755d9ea4becafa0b5941a73badc P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.734844 16329 tablet_replica.cc:333] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.735416 16329 raft_consensus.cc:2243] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.735894 16329 raft_consensus.cc:2272] T ece4cd7e70e34b1b8160736a9054eb47 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.738206 16329 tablet_replica.cc:333] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.738754 16329 raft_consensus.cc:2243] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.739635 16329 raft_consensus.cc:2272] T 49637e146f304243aeffc8c6e25e4c85 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.741807 16329 tablet_replica.cc:333] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.742465 16329 raft_consensus.cc:2243] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.742965 16329 raft_consensus.cc:2272] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.745146 16329 tablet_replica.cc:333] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.745698 16329 raft_consensus.cc:2243] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.746543 16329 raft_consensus.cc:2272] T f562c6f04c364ca286276a291410d192 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.748736 16329 tablet_replica.cc:333] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.749327 16329 raft_consensus.cc:2243] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.749758 16329 raft_consensus.cc:2272] T 9ff26d53286646eb9892a573cdb2ecfe P 4a40ce8ef1e646f7a376842a2287b6e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.752452 16329 tablet_replica.cc:333] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.753029 16329 raft_consensus.cc:2243] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.753928 16329 raft_consensus.cc:2272] T 66af67d5583c4a7b80c0982db79344fd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.755966 16329 tablet_replica.cc:333] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.756553 16329 raft_consensus.cc:2243] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.757014 16329 raft_consensus.cc:2272] T 8dacf9d04568491d9a4749a7b35558b1 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.759019 16329 tablet_replica.cc:333] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.759557 16329 raft_consensus.cc:2243] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.759989 16329 raft_consensus.cc:2272] T 43ad9535642349629902c3ff840fedbd P 4a40ce8ef1e646f7a376842a2287b6e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.762980 16329 tablet_replica.cc:333] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.763917 16329 raft_consensus.cc:2243] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.764424 16329 raft_consensus.cc:2272] T 7cefede0f65c4903a92f1d6e143c4cfb P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.766824 16329 tablet_replica.cc:333] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.767385 16329 raft_consensus.cc:2243] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.768199 16329 raft_consensus.cc:2272] T 0d721351ee0e4501836ff08539f40750 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.770262 16329 tablet_replica.cc:333] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.770773 16329 raft_consensus.cc:2243] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.771231 16329 raft_consensus.cc:2272] T 400ac67bcf014728bfa8c133e03bc6f9 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.773227 16329 tablet_replica.cc:333] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.773752 16329 raft_consensus.cc:2243] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.774256 16329 raft_consensus.cc:2272] T 73cfe7c8c31b48e2aea8f527da7a0856 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.776199 16329 tablet_replica.cc:333] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.776687 16329 raft_consensus.cc:2243] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.777127 16329 raft_consensus.cc:2272] T ed0de837d4fb416b8612d7bfee17fc2e P 4a40ce8ef1e646f7a376842a2287b6e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.779035 16329 tablet_replica.cc:333] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6: stopping tablet replica
I20260709 13:22:18.779594 16329 raft_consensus.cc:2243] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.780159 16329 raft_consensus.cc:2272] T 47485825deb14081a6adcfb26a03c1f5 P 4a40ce8ef1e646f7a376842a2287b6e6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:18.785601 27126 consensus_peers.cc:597] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 -> Peer 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241): Couldn't send request to peer 4a40ce8ef1e646f7a376842a2287b6e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:18.803117 27127 consensus_peers.cc:597] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 -> Peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Couldn't send request to peer 6fec71feeb50406b9395a638b88dc370. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:33085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:18.810578 27126 connection.cc:573] client connection to 127.15.242.66:44241 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:22:18.815455 27126 consensus_peers.cc:597] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 -> Peer 4a40ce8ef1e646f7a376842a2287b6e6 (127.15.242.66:44241): Couldn't send request to peer 4a40ce8ef1e646f7a376842a2287b6e6. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.66:44241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:18.826859 16329 tablet_server.cc:196] TabletServer@127.15.242.66:0 shutdown complete.
I20260709 13:22:18.860231 16329 tablet_server.cc:179] TabletServer@127.15.242.67:0 shutting down...
I20260709 13:22:18.893471 16329 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:18.894388 16329 tablet_replica.cc:333] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.895180 16329 raft_consensus.cc:2243] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.895715 16329 raft_consensus.cc:2272] T f7474efa812d493f99e0d67edea2a7e5 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.897903 16329 tablet_replica.cc:333] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.898545 16329 raft_consensus.cc:2243] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.898986 16329 raft_consensus.cc:2272] T 3396d3e3977c4cee8ff5acdc7a873501 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.901069 16329 tablet_replica.cc:333] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.901971 16329 raft_consensus.cc:2243] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.902526 16329 raft_consensus.cc:2272] T ece4cd7e70e34b1b8160736a9054eb47 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.905360 16329 tablet_replica.cc:333] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
W20260709 13:22:18.905679 27127 consensus_peers.cc:597] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 -> Peer 6fec71feeb50406b9395a638b88dc370 (127.15.242.65:33085): Couldn't send request to peer 6fec71feeb50406b9395a638b88dc370. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.65:33085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:18.906402 16329 raft_consensus.cc:2243] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.906967 16329 raft_consensus.cc:2272] T 988b8755d9ea4becafa0b5941a73badc P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.909126 16329 tablet_replica.cc:333] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.909734 16329 raft_consensus.cc:2243] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.910269 16329 raft_consensus.cc:2272] T 66af67d5583c4a7b80c0982db79344fd P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.912351 16329 tablet_replica.cc:333] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.912922 16329 raft_consensus.cc:2243] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.913316 16329 raft_consensus.cc:2272] T 8dacf9d04568491d9a4749a7b35558b1 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.915355 16329 tablet_replica.cc:333] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.915901 16329 raft_consensus.cc:2243] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.916298 16329 raft_consensus.cc:2272] T 0d721351ee0e4501836ff08539f40750 P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.918524 16329 tablet_replica.cc:333] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.919114 16329 raft_consensus.cc:2243] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.919898 16329 raft_consensus.cc:2272] T 9ff26d53286646eb9892a573cdb2ecfe P ed01b2067d964cfda687492d191b6c71 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.922343 16329 tablet_replica.cc:333] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.922892 16329 raft_consensus.cc:2243] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.923309 16329 raft_consensus.cc:2272] T 733a4719f64849ea9312c28c470fd396 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.925297 16329 tablet_replica.cc:333] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.925818 16329 raft_consensus.cc:2243] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.926694 16329 raft_consensus.cc:2272] T 400ac67bcf014728bfa8c133e03bc6f9 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.928764 16329 tablet_replica.cc:333] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.929289 16329 raft_consensus.cc:2243] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.929755 16329 raft_consensus.cc:2272] T f562c6f04c364ca286276a291410d192 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.931931 16329 tablet_replica.cc:333] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.932626 16329 raft_consensus.cc:2243] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.933104 16329 raft_consensus.cc:2272] T 49637e146f304243aeffc8c6e25e4c85 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.935261 16329 tablet_replica.cc:333] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.935848 16329 raft_consensus.cc:2243] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.936254 16329 raft_consensus.cc:2272] T 73cfe7c8c31b48e2aea8f527da7a0856 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.938141 16329 tablet_replica.cc:333] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.938616 16329 raft_consensus.cc:2243] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.939318 16329 raft_consensus.cc:2272] T ed0de837d4fb416b8612d7bfee17fc2e P ed01b2067d964cfda687492d191b6c71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.941186 16329 tablet_replica.cc:333] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.941668 16329 raft_consensus.cc:2243] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.942081 16329 raft_consensus.cc:2272] T 47485825deb14081a6adcfb26a03c1f5 P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.944064 16329 tablet_replica.cc:333] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.944510 16329 raft_consensus.cc:2243] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.944919 16329 raft_consensus.cc:2272] T cbb2d42d01e7460c8d8a44c0bdfd2d5f P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.946825 16329 tablet_replica.cc:333] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.947273 16329 raft_consensus.cc:2243] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:18.947678 16329 raft_consensus.cc:2272] T 7cefede0f65c4903a92f1d6e143c4cfb P ed01b2067d964cfda687492d191b6c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.949646 16329 tablet_replica.cc:333] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71: stopping tablet replica
I20260709 13:22:18.950091 16329 raft_consensus.cc:2243] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:18.950802 16329 raft_consensus.cc:2272] T 43ad9535642349629902c3ff840fedbd P ed01b2067d964cfda687492d191b6c71 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:18.994879 16329 tablet_server.cc:196] TabletServer@127.15.242.67:0 shutdown complete.
I20260709 13:22:19.043630 16329 master.cc:562] Master@127.15.242.126:45943 shutting down...
I20260709 13:22:19.065325 16329 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.065898 16329 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.066294 16329 tablet_replica.cc:333] T 00000000000000000000000000000000 P a1ed9df55f6a4a6a9735c222cf39e15c: stopping tablet replica
I20260709 13:22:19.088821 16329 master.cc:584] Master@127.15.242.126:45943 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11494 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25990 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (303362 ms total)
[  PASSED  ] 8 tests.
I20260709 13:22:19.150490 16329 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 413 messages since previous log ~14 seconds ago
I20260709 13:22:19.150697 16329 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 418 messages since previous log ~14 seconds ago
I20260709 13:22:19.150835 16329 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 418 messages since previous log ~14 seconds ago
I20260709 13:22:19.150983 16329 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:22:19.151127 16329 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:22:19.151285 16329 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 1 messages since previous log ~184 seconds ago
I20260709 13:22:19.151427 16329 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~130 seconds ago
I20260709 13:22:19.151562 16329 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 4 messages since previous log ~169 seconds ago
I20260709 13:22:19.151764 16329 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:22:19.152004 16329 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
